Unable to comple content creation workflow #817

simhead · 2025-09-01T00:32:26Z

simhead
Sep 1, 2025

Here is the sequence of performing this workflow to create a Content:

login as Content Creator -> create course :: success
submit for review :: success
Content Reviewer -> approve and publish :: success
Check status (login as Content Creator) :: appeared as 'processing' then quickly disappeared

Upon check content job task manager, here is the log:
2025-08-29 07:10:51,513 ERROR org.sunbird.job.content.publish.helpers.CollectionPublisher [] - CollectionPublisher:: generateTOC:: Error while uploading file java.util.NoSuchElementException: None.get at scala.None$.get(Option.scala:529) ~[asset-enrichment-1.0.0.jar:?] at scala.None$.get(Option.scala:527) ~[asset-enrichment-1.0.0.jar:?] at org.sunbird.cloud.storage.service.OCIS3StorageService.<init>(OCIS3StorageService.scala:20) ~[asset-enrichment-1.0.0.jar:?] at org.sunbird.cloud.storage.factory.StorageServiceFactory$.getStorageService(StorageServiceFactory.scala:27) ~[asset-enrichment-1.0.0.jar:?] at org.sunbird.job.util.CloudStorageUtil.getService(CloudStorageUtil.scala:24) ~[asset-enrichment-1.0.0.jar:?] at org.sunbird.job.util.CloudStorageUtil.uploadFile(CloudStorageUtil.scala:39) ~[asset-enrichment-1.0.0.jar:?] at org.sunbird.job.content.publish.helpers.CollectionPublisher.generateTOC(CollectionPublisher.scala:431) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.publish.helpers.CollectionPublisher.generateTOC$(CollectionPublisher.scala:423) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.function.CollectionPublishFunction.generateTOC(CollectionPublishFunction.scala:27) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.publish.helpers.CollectionPublisher.enrichCollection(CollectionPublisher.scala:347) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.publish.helpers.CollectionPublisher.enrichCollection$(CollectionPublisher.scala:323) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.function.CollectionPublishFunction.enrichCollection(CollectionPublishFunction.scala:27) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.publish.helpers.CollectionPublisher.processCollection(CollectionPublisher.scala:273) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.publish.helpers.CollectionPublisher.getObjectWithEcar(CollectionPublisher.scala:145) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.publish.helpers.CollectionPublisher.getObjectWithEcar$(CollectionPublisher.scala:140) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.function.CollectionPublishFunction.getObjectWithEcar(CollectionPublishFunction.scala:27) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.function.CollectionPublishFunction.processElement(CollectionPublishFunction.scala:107) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.function.CollectionPublishFunction.processElement(CollectionPublishFunction.scala:27) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.BaseProcessFunction.processElement(BaseProcessFunction.scala:49) ~[asset-enrichment-1.0.0.jar:?] at org.apache.flink.streaming.api.operators.ProcessOperator.processElement(ProcessOperator.java:66) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:71) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:57) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.BroadcastingOutputCollector.collect(BroadcastingOutputCollector.java:82) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:56) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.api.operators.ProcessOperator$ContextImpl.output(ProcessOperator.java:103) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.sunbird.job.content.function.PublishEventRouter.processElement(PublishEventRouter.scala:43) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.function.PublishEventRouter.processElement(PublishEventRouter.scala:13) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.BaseProcessFunction.processElement(BaseProcessFunction.scala:49) ~[asset-enrichment-1.0.0.jar:?] at org.apache.flink.streaming.api.operators.ProcessOperator.processElement(ProcessOperator.java:66) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:205) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.processElement(AbstractStreamTaskNetworkInput.java:134) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:105) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:66) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:423) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:204) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:684) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.StreamTask.executeInvoke(StreamTask.java:639) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.StreamTask.runWithCleanUpOnFail(StreamTask.java:650) [flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:623) [flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779) [flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566) [flink-dist_2.12-1.13.6.jar:1.13.6] at java.lang.Thread.run(Unknown Source) [?:?] 2025-08-29 07:10:51,517 INFO org.sunbird.job.content.publish.helpers.CollectionPublisher [] - CollectionPublisher:: generateTOC:: Deleting Uploaded files org.sunbird.job.exception.InvalidInputException: CollectionPublisher:: generateTOC:: Error while uploading file at org.sunbird.job.content.publish.helpers.CollectionPublisher.generateTOC(CollectionPublisher.scala:441) at org.sunbird.job.content.publish.helpers.CollectionPublisher.generateTOC$(CollectionPublisher.scala:423) at org.sunbird.job.content.function.CollectionPublishFunction.generateTOC(CollectionPublishFunction.scala:27) at org.sunbird.job.content.publish.helpers.CollectionPublisher.enrichCollection(CollectionPublisher.scala:347) at org.sunbird.job.content.publish.helpers.CollectionPublisher.enrichCollection$(CollectionPublisher.scala:323) at org.sunbird.job.content.function.CollectionPublishFunction.enrichCollection(CollectionPublishFunction.scala:27) at org.sunbird.job.content.publish.helpers.CollectionPublisher.processCollection(CollectionPublisher.scala:273) at org.sunbird.job.content.publish.helpers.CollectionPublisher.getObjectWithEcar(CollectionPublisher.scala:145) at org.sunbird.job.content.publish.helpers.CollectionPublisher.getObjectWithEcar$(CollectionPublisher.scala:140) at org.sunbird.job.content.function.CollectionPublishFunction.getObjectWithEcar(CollectionPublishFunction.scala:27) at org.sunbird.job.content.function.CollectionPublishFunction.processElement(CollectionPublishFunction.scala:107) at org.sunbird.job.content.function.CollectionPublishFunction.processElement(CollectionPublishFunction.scala:27) at org.sunbird.job.BaseProcessFunction.processElement(BaseProcessFunction.scala:49) at org.apache.flink.streaming.api.operators.ProcessOperator.processElement(ProcessOperator.java:66) at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:71) at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:57) at org.apache.flink.streaming.runtime.tasks.BroadcastingOutputCollector.collect(BroadcastingOutputCollector.java:82) at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:56) at org.apache.flink.streaming.api.operators.ProcessOperator$ContextImpl.output(ProcessOperator.java:103) at org.sunbird.job.content.function.PublishEventRouter.processElement(PublishEventRouter.scala:43) at org.sunbird.job.content.function.PublishEventRouter.processElement(PublishEventRouter.scala:13) at org.sunbird.job.BaseProcessFunction.processElement(BaseProcessFunction.scala:49) at org.apache.flink.streaming.api.operators.ProcessOperator.processElement(ProcessOperator.java:66) at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:205) at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.processElement(AbstractStreamTaskNetworkInput.java:134) at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:105) at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:66) at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:423) at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:204) at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:684) at org.apache.flink.streaming.runtime.tasks.StreamTask.executeInvoke(StreamTask.java:639) at org.apache.flink.streaming.runtime.tasks.StreamTask.runWithCleanUpOnFail(StreamTask.java:650) at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:623) at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.util.NoSuchElementException: None.get at scala.None$.get(Option.scala:529) at scala.None$.get(Option.scala:527) at org.sunbird.cloud.storage.service.OCIS3StorageService.<init>(OCIS3StorageService.scala:20) at org.sunbird.cloud.storage.factory.StorageServiceFactory$.getStorageService(StorageServiceFactory.scala:27) at org.sunbird.job.util.CloudStorageUtil.getService(CloudStorageUtil.scala:24) at org.sunbird.job.util.CloudStorageUtil.uploadFile(CloudStorageUtil.scala:39) at org.sunbird.job.content.publish.helpers.CollectionPublisher.generateTOC(CollectionPublisher.scala:431) ... 35 more 2025-08-29 07:10:51,523 INFO org.sunbird.job.publish.helpers.ObjectUpdater [] - ObjectUpdater:: saveOnFailure:: Query: MATCH (n:domain{IL_UNIQUE_ID:"do_214388849672650752113"}) SET n.status="Failed", n.pkgVersion=1.0, n.publishError="CollectionPublisher:: generateTOC:: Error while uploading file", n.lastUpdatedOn="2025-08-29T07:10:51.523+0000",n.lastStatusChangedOn="2025-08-29T07:10:51.523+0000"; 2025-08-29 07:10:51,524 INFO org.sunbird.job.util.CSPMetaUtil [] - CSPMetaUtil ::: updateRelativePath ::: query before url replace :: MATCH (n:domain{IL_UNIQUE_ID:"do_214388849672650752113"}) SET n.status="Failed", n.pkgVersion=1.0, n.publishError="CollectionPublisher:: generateTOC:: Error while uploading file", n.lastUpdatedOn="2025-08-29T07:10:51.523+0000",n.lastStatusChangedOn="2025-08-29T07:10:51.523+0000"; 2025-08-29 07:10:51,524 INFO org.sunbird.job.util.CSPMetaUtil [] - CSPMetaUtil ::: updateRelativePath ::: query after url replace :: MATCH (n:domain{IL_UNIQUE_ID:"do_214388849672650752113"}) SET n.status="Failed", n.pkgVersion=1.0, n.publishError="CollectionPublisher:: generateTOC:: Error while uploading file", n.lastUpdatedOn="2025-08-29T07:10:51.523+0000",n.lastStatusChangedOn="2025-08-29T07:10:51.523+0000"; 2025-08-29 07:10:51,623 ERROR org.sunbird.job.content.function.CollectionPublishFunction [] - CollectionPublishFunction::Error while publishing collection :: 0 and Offset: 2. Error : CollectionPublisher:: generateTOC:: Error while uploading file org.sunbird.job.exception.InvalidInputException: CollectionPublisher:: generateTOC:: Error while uploading file at org.sunbird.job.content.publish.helpers.CollectionPublisher.generateTOC(CollectionPublisher.scala:441) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.publish.helpers.CollectionPublisher.generateTOC$(CollectionPublisher.scala:423) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.function.CollectionPublishFunction.generateTOC(CollectionPublishFunction.scala:27) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.publish.helpers.CollectionPublisher.enrichCollection(CollectionPublisher.scala:347) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.publish.helpers.CollectionPublisher.enrichCollection$(CollectionPublisher.scala:323) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.function.CollectionPublishFunction.enrichCollection(CollectionPublishFunction.scala:27) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.publish.helpers.CollectionPublisher.processCollection(CollectionPublisher.scala:273) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.publish.helpers.CollectionPublisher.getObjectWithEcar(CollectionPublisher.scala:145) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.publish.helpers.CollectionPublisher.getObjectWithEcar$(CollectionPublisher.scala:140) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.function.CollectionPublishFunction.getObjectWithEcar(CollectionPublishFunction.scala:27) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.function.CollectionPublishFunction.processElement(CollectionPublishFunction.scala:107) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.function.CollectionPublishFunction.processElement(CollectionPublishFunction.scala:27) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.BaseProcessFunction.processElement(BaseProcessFunction.scala:49) ~[asset-enrichment-1.0.0.jar:?] at org.apache.flink.streaming.api.operators.ProcessOperator.processElement(ProcessOperator.java:66) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:71) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:57) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.BroadcastingOutputCollector.collect(BroadcastingOutputCollector.java:82) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:56) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.api.operators.ProcessOperator$ContextImpl.output(ProcessOperator.java:103) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.sunbird.job.content.function.PublishEventRouter.processElement(PublishEventRouter.scala:43) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.content.function.PublishEventRouter.processElement(PublishEventRouter.scala:13) ~[content-publish-1.0.0.jar:?] at org.sunbird.job.BaseProcessFunction.processElement(BaseProcessFunction.scala:49) ~[asset-enrichment-1.0.0.jar:?] at org.apache.flink.streaming.api.operators.ProcessOperator.processElement(ProcessOperator.java:66) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:205) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.processElement(AbstractStreamTaskNetworkInput.java:134) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:105) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:66) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:423) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:204) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:684) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.StreamTask.executeInvoke(StreamTask.java:639) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.StreamTask.runWithCleanUpOnFail(StreamTask.java:650) [flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:623) [flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779) [flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566) [flink-dist_2.12-1.13.6.jar:1.13.6] at java.lang.Thread.run(Unknown Source) [?:?] Caused by: java.util.NoSuchElementException: None.get at scala.None$.get(Option.scala:529) ~[asset-enrichment-1.0.0.jar:?] at scala.None$.get(Option.scala:527) ~[asset-enrichment-1.0.0.jar:?] at org.sunbird.cloud.storage.service.OCIS3StorageService.<init>(OCIS3StorageService.scala:20) ~[asset-enrichment-1.0.0.jar:?] at org.sunbird.cloud.storage.factory.StorageServiceFactory$.getStorageService(StorageServiceFactory.scala:27) ~[asset-enrichment-1.0.0.jar:?] at org.sunbird.job.util.CloudStorageUtil.getService(CloudStorageUtil.scala:24) ~[asset-enrichment-1.0.0.jar:?] at org.sunbird.job.util.CloudStorageUtil.uploadFile(CloudStorageUtil.scala:39) ~[asset-enrichment-1.0.0.jar:?] at org.sunbird.job.content.publish.helpers.CollectionPublisher.generateTOC(CollectionPublisher.scala:431) ~[content-publish-1.0.0.jar:?] ... 35 more

simhead · 2025-09-01T00:34:04Z

simhead
Sep 1, 2025
Author

As suggested by Jerald's team, I double checked the existence of 'content-plugins/org.ekstep.navigation-1.0/renderer/controller/navigation_ctrl.js' file in the OCI object storage as below:
oci os object list --namespace-name idnlppwjcf2n --bucket-name storage_container_public --prefix content-plugins/org.ekstep.navigation-1.0/renderer/controller/navigation_ctrl.js

{
"data": [
{
"archival-state": null,
"etag": "10018ff1-734e-4667-a87f-fe01ad7fa928",
"md5": "co4jt+nZlEEp7wSjFYZNTg==",
"name": "content-plugins/org.ekstep.navigation-1.0/renderer/controller/navigation_ctrl.js",
"size": 8211,
"storage-tier": "Standard",
"time-created": "2025-08-25T09:09:00.475000+00:00",
"time-modified": "2025-08-25T09:09:00.475000+00:00"
}
],
"prefixes": []
}

Please advise.

3 replies

simhead · 2025-09-09T07:27:36Z

simhead
Sep 9, 2025
Author

upgraded to v7.7.0 and I am now more specific error as below:

2025-09-09 07:25:16,762 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - publish-event-router -> (content-publish-process -> (Sink: Unnamed, Sink: Unnamed, Sink: Unnamed), collection-publish-process -> (Sink: Unnamed, Sink: Unnamed)) (1/1) (289c0e9a17ec20fb29e0011f82139fd8) switched from RUNNING to FAILED on 10.244.5.54:6122-ab659a @ 10-244-5-54.content-publish-taskmanager.sunbird.svc.cluster.local (dataPort=40915).
org.sunbird.cloud.storage.exception.StorageServiceException: Unknown storage type found
	at org.sunbird.cloud.storage.factory.StorageServiceFactory$.getStorageService(StorageServiceFactory.scala:29) ~[asset-enrichment-1.0.0.jar:?]
	at org.sunbird.job.util.CloudStorageUtil.getService(CloudStorageUtil.scala:24) ~[asset-enrichment-1.0.0.jar:?]
	at org.sunbird.job.util.CloudStorageUtil.downloadFile(CloudStorageUtil.scala:63) ~[asset-enrichment-1.0.0.jar:?]
	at org.sunbird.job.content.publish.helpers.ExtractableMimeTypeHelper$.$anonfun$downloadAssetFiles$1(ExtractableMimeTypeHelper.scala:225) ~[content-publish-1.0.0.jar:?]
	at scala.collection.immutable.List.map(List.scala:293) ~[asset-enrichment-1.0.0.jar:?]
	at org.sunbird.job.content.publish.helpers.ExtractableMimeTypeHelper$.downloadAssetFiles(ExtractableMimeTypeHelper.scala:198) ~[content-publish-1.0.0.jar:?]
	at org.sunbird.job.content.publish.helpers.ExtractableMimeTypeHelper$.processAssetsDownload(ExtractableMimeTypeHelper.scala:193) ~[content-publish-1.0.0.jar:?]
	at org.sunbird.job.content.publish.helpers.ExtractableMimeTypeHelper$.localizeAssets(ExtractableMimeTypeHelper.scala:189) ~[content-publish-1.0.0.jar:?]
	at org.sunbird.job.content.publish.helpers.ExtractableMimeTypeHelper$.processECMLBody(ExtractableMimeTypeHelper.scala:60) ~[content-publish-1.0.0.jar:?]
	at org.sunbird.job.content.function.ContentPublishFunction.processElement(ContentPublishFunction.scala:81) ~[content-publish-1.0.0.jar:?]
	at org.sunbird.job.content.function.ContentPublishFunction.processElement(ContentPublishFunction.scala:26) ~[content-publish-1.0.0.jar:?]
	at org.sunbird.job.BaseProcessFunction.processElement(BaseProcessFunction.scala:49) ~[asset-enrichment-1.0.0.jar:?]
	at org.apache.flink.streaming.api.operators.ProcessOperator.processElement(ProcessOperator.java:66) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:71) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:57) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.BroadcastingOutputCollector.collect(BroadcastingOutputCollector.java:82) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:56) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.api.operators.ProcessOperator$ContextImpl.output(ProcessOperator.java:103) ~[transaction-event-processor-1.0.0.jar:?]
	at org.sunbird.job.content.function.PublishEventRouter.processElement(PublishEventRouter.scala:39) ~[content-publish-1.0.0.jar:?]
	at org.sunbird.job.content.function.PublishEventRouter.processElement(PublishEventRouter.scala:13) ~[content-publish-1.0.0.jar:?]
	at org.sunbird.job.BaseProcessFunction.processElement(BaseProcessFunction.scala:49) ~[asset-enrichment-1.0.0.jar:?]
	at org.apache.flink.streaming.api.operators.ProcessOperator.processElement(ProcessOperator.java:66) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:205) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.processElement(AbstractStreamTaskNetworkInput.java:134) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:105) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:66) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:423) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:204) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:684) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.StreamTask.executeInvoke(StreamTask.java:639) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runWithCleanUpOnFail(StreamTask.java:650) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:623) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566) ~[transaction-event-processor-1.0.0.jar:?]
	at java.lang.Thread.run(Unknown Source) ~[?:?]
2025-09-09 07:25:16,773 INFO  org.apache.flink.runtime.scheduler.adaptive.AdaptiveScheduler [] - Restarting job.
org.sunbird.cloud.storage.exception.StorageServiceException: Unknown storage type found
	at org.sunbird.cloud.storage.factory.StorageServiceFactory$.getStorageService(StorageServiceFactory.scala:29) ~[asset-enrichment-1.0.0.jar:?]
	at org.sunbird.job.util.CloudStorageUtil.getService(CloudStorageUtil.scala:24) ~[asset-enrichment-1.0.0.jar:?]
	at org.sunbird.job.util.CloudStorageUtil.downloadFile(CloudStorageUtil.scala:63) ~[asset-enrichment-1.0.0.jar:?]
	at org.sunbird.job.content.publish.helpers.ExtractableMimeTypeHelper$.$anonfun$downloadAssetFiles$1(ExtractableMimeTypeHelper.scala:225) ~[content-publish-1.0.0.jar:?]
	at scala.collection.immutable.List.map(List.scala:293) ~[asset-enrichment-1.0.0.jar:?]
	at org.sunbird.job.content.publish.helpers.ExtractableMimeTypeHelper$.downloadAssetFiles(ExtractableMimeTypeHelper.scala:198) ~[content-publish-1.0.0.jar:?]
	at org.sunbird.job.content.publish.helpers.ExtractableMimeTypeHelper$.processAssetsDownload(ExtractableMimeTypeHelper.scala:193) ~[content-publish-1.0.0.jar:?]
	at org.sunbird.job.content.publish.helpers.ExtractableMimeTypeHelper$.localizeAssets(ExtractableMimeTypeHelper.scala:189) ~[content-publish-1.0.0.jar:?]
	at org.sunbird.job.content.publish.helpers.ExtractableMimeTypeHelper$.processECMLBody(ExtractableMimeTypeHelper.scala:60) ~[content-publish-1.0.0.jar:?]
	at org.sunbird.job.content.function.ContentPublishFunction.processElement(ContentPublishFunction.scala:81) ~[content-publish-1.0.0.jar:?]
	at org.sunbird.job.content.function.ContentPublishFunction.processElement(ContentPublishFunction.scala:26) ~[content-publish-1.0.0.jar:?]
	at org.sunbird.job.BaseProcessFunction.processElement(BaseProcessFunction.scala:49) ~[asset-enrichment-1.0.0.jar:?]
	at org.apache.flink.streaming.api.operators.ProcessOperator.processElement(ProcessOperator.java:66) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:71) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:57) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.BroadcastingOutputCollector.collect(BroadcastingOutputCollector.java:82) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:56) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.api.operators.ProcessOperator$ContextImpl.output(ProcessOperator.java:103) ~[transaction-event-processor-1.0.0.jar:?]
	at org.sunbird.job.content.function.PublishEventRouter.processElement(PublishEventRouter.scala:39) ~[content-publish-1.0.0.jar:?]
	at org.sunbird.job.content.function.PublishEventRouter.processElement(PublishEventRouter.scala:13) ~[content-publish-1.0.0.jar:?]
	at org.sunbird.job.BaseProcessFunction.processElement(BaseProcessFunction.scala:49) ~[asset-enrichment-1.0.0.jar:?]
	at org.apache.flink.streaming.api.operators.ProcessOperator.processElement(ProcessOperator.java:66) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:205) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.processElement(AbstractStreamTaskNetworkInput.java:134) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:105) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:66) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:423) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:204) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:684) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.StreamTask.executeInvoke(StreamTask.java:639) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.StreamTask.runWithCleanUpOnFail(StreamTask.java:650) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:623) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:779) ~[transaction-event-processor-1.0.0.jar:?]
	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566) ~[transaction-event-processor-1.0.0.jar:?]
	at java.lang.Thread.run(Unknown Source) ~[?:?]
2025-09-09 07:25:16,776 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Job content-publish (6516c383da4bfcfcf76cecb5b75bb266) switched from state RUNNING to CANCELLING.
2025-09-09 07:25:16,777 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: content-publish-consumer (1/1) (149ef22aa800cd80c20f04ae90de2c54) switched from RUNNING to CANCELING.
2025-09-09 07:25:16,853 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Source: content-publish-consumer (1/1) (149ef22aa800cd80c20f04ae90de2c54) switched from CANCELING to CANCELED.
2025-09-09 07:25:16,855 INFO  org.apache.flink.runtime.executiongraph.ExecutionGraph       [] - Job content-publish (6516c383da4bfcfcf76cecb5b75bb266) switched from state CANCELLING to CANCELED.
2025-09-09 07:25:16,855 INFO  org.apache.flink.runtime.checkpoint.CheckpointCoordinator    [] - Stopping checkpoint coordinator for job 6516c383da4bfcfcf76cecb5b75bb266.

so what are the supported storage types?

0 replies

simhead · 2025-09-09T07:32:19Z

simhead
Sep 9, 2025
Author

this is what I am using:

cloud_storage_type="s3"
cloud_storage_key="<key>"
cloud_storage_secret="<secret>"
cloud_storage_container="ed-ocioketest-public-b67a2dc1f5"
cloud_storage_endpoint="https://<namespace>.compat.objectstorage.us-ashburn-1.oraclecloud.com"
schema.basePath="https://objectstorage.us-ashburn-1.oraclecloud.com/n/<namespace>/b/ed-ocioketest-public-b67a2dc1f5/o/schemas/local"

1 reply

aimansharief Sep 9, 2025

@simhead set the cloud_storage_typevalue to oci.

simhead · 2025-09-10T03:22:24Z

simhead
Sep 10, 2025
Author

ok using oci fixed the issue, but some other issue popped up.
First let me share the current content creation status:

Course - working
Resource - working
Collection - working
Uploading - working
Large Uploading - working

Closing this ticket and will create other specific content issue tickets separately

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Sunbird-ED (Sunbird for Education)

Unable to comple content creation workflow #817

Uh oh!

{{title}}

Uh oh!

Replies: 4 comments 4 replies

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

Sunbird-ED (Sunbird for Education)

Unable to comple content creation workflow #817

Uh oh!

simhead Sep 1, 2025

Replies: 4 comments · 4 replies

Uh oh!

simhead Sep 1, 2025 Author

Uh oh!

aimansharief Sep 1, 2025

Uh oh!

aimansharief Sep 2, 2025

Uh oh!

aimansharief Sep 2, 2025

Uh oh!

simhead Sep 9, 2025 Author

Uh oh!

simhead Sep 9, 2025 Author

Uh oh!

aimansharief Sep 9, 2025

Uh oh!

simhead Sep 10, 2025 Author

simhead
Sep 1, 2025

Replies: 4 comments 4 replies

simhead
Sep 1, 2025
Author

simhead
Sep 9, 2025
Author

simhead
Sep 9, 2025
Author

simhead
Sep 10, 2025
Author