Encoding Failed

[ranjitsingha]

Version

Media3 main branch

More version details

Codec exception:

CodecInfo {
type=VideoEncoder, 
configuration Format= { 
exo-pixel-width-height-ratio-float=1.0, 
sar-width=1, 
color-format=2130708361, 
i-frame-interval=1.0, 
mime=video/avc, bitrate=9673973, 
color-standard=2, 
operating-rate=2147483647, 
color-transfer=3, 
sar-height=1, 
is-autoselect=0, 
is-default=0, 
color-range=2, 
frame-rate=30, 
rotation-degrees=0, 
height=1080, 
is-forced-subtitle=0, 
level=16384, 
profile=8, 
codecs-string=avc1.4D0028, 
priority=1, 
encoder-delay=0, 
width=1920, 
bitrate-mode=1, 
encoder-padding=0}, 

name=OMX.qcom.video.encoder.avc}

Devices that reproduce the issue

Vivo Y51A
Android 13

Vivo 1935
Android 10

iQOO Z6 Pro
Android 14

Devices that do not reproduce the issue

Infinix Hot 10s
running android 11

Reproducible in the demo app?

Yes

Reproduction steps

I am reporting a persistent Codec exception that occurs when exporting certain source videos with a BitmapOverlay effect. The issue is reproducible on several devices with Qualcomm chipsets (specific Vivo and iQOO models listed), while it works correctly on others.

The export is configured with .setVideoMimeType(MimeTypes.VIDEO_H264) and fails immediately with the error name=OMX.qcom.video.encoder.avc, pointing to a hardware encoder configuration failure.

Notably, the issue seems to be dependent on the source video's characteristics. On the same problematic device, some videos will export correctly while others trigger the Codec exception, even with identical export settings. This suggests the failure is related to the specific combination of the source video's properties (like resolution, profile, or bitrate) and the hardware encoder's limitations.

We have determined that the standard fallback mechanism is not working in this case. Using .setEnableFallback(true) on the DefaultEncoderFactory does not solve the problem; the hardware encoder still fails, and it does not fall back to software.

Expected result

Actual result

Media

None

Bug Report

• You will email the zip file produced by adb bugreport to android-media-github@google.com after filing this issue.

[oceanjules]

Can you provide the error logs you are observing?

[ranjitsingha]

Can you provide the error logs you are observing?

@oceanjules CodecInfo {
type=VideoEncoder,
configuration Format= {
exo-pixel-width-height-ratio-float=1.0,
sar-width=1,
color-format=2130708361,
i-frame-interval=1.0,
mime=video/avc, bitrate=9673973,
color-standard=2,
operating-rate=2147483647,
color-transfer=3,
sar-height=1,
is-autoselect=0,
is-default=0,
color-range=2,
frame-rate=30,
rotation-degrees=0,
height=1080,
is-forced-subtitle=0,
level=16384,
profile=8,
codecs-string=avc1.4D0028,
priority=1,
encoder-delay=0,
width=1920,
bitrate-mode=1,
encoder-padding=0},

name=OMX.qcom.video.encoder.avc}

[ranjitsingha]

@oceanjules Caused by android.media.MediaCodec$CodecException: Failed to initialize OMX.qcom.video.encoder.avc, error 0xfffffff4 (NO_MEMORY)
at android.media.MediaCodec.native_setup(MediaCodec.java)
at android.media.MediaCodec.(MediaCodec.java:1999)
at android.media.MediaCodec.(MediaCodec.java:1977)
at android.media.MediaCodec.createByCodecName(MediaCodec.java:1947)
at androidx.media3.transformer.DefaultCodec.(DefaultCodec.java:126)
at androidx.media3.transformer.DefaultEncoderFactory.createForVideoEncoding(DefaultEncoderFactory.java:469)
at androidx.media3.transformer.DefaultEncoderFactory.createForVideoEncoding(DefaultEncoderFactory.java)
at androidx.media3.transformer.CapturingEncoderFactory.createForVideoEncoding(CapturingEncoderFactory.java:44)
at androidx.media3.transformer.VideoSampleExporter$EncoderWrapper.getSurfaceInfo(VideoSampleExporter.java:367)
at androidx.media3.transformer.VideoSampleExporter$VideoGraphWrapper.onOutputSizeChanged(VideoSampleExporter.java:582)
at androidx.media3.effect.SingleInputVideoGraph$1.lambda$onOutputSizeChanged$0(SingleInputVideoGraph.java:157)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java)
at androidx.media3.effect.SingleInputVideoGraph$1.onOutputSizeChanged(SingleInputVideoGraph.java:157)
at androidx.media3.effect.FinalShaderProgramWrapper.lambda$ensureConfigured$7(FinalShaderProgramWrapper.java:544)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java)
at androidx.media3.effect.FinalShaderProgramWrapper.ensureConfigured(FinalShaderProgramWrapper.java:542)
at androidx.media3.effect.FinalShaderProgramWrapper.renderFrame(FinalShaderProgramWrapper.java:453)
at androidx.media3.effect.FinalShaderProgramWrapper.queueInputFrame(FinalShaderProgramWrapper.java:233)
at androidx.media3.effect.FrameConsumptionManager.lambda$queueInputFrame$1(FrameConsumptionManager.java:93)
at androidx.media3.effect.VideoFrameProcessingTaskExecutor.lambda$wrapTaskAndSubmitToExecutorService$3(VideoFrameProcessingTaskExecutor.java:290)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:487)
at java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:644)
at java.lang.Thread.run(Thread.java:1012)

[ychaparov]

It is possible that these devices cannot simultaneously use both a hardware decoder and a hardware encoder at the requested video resolution.

Can you check if overriding the devicePrefersSoftwareDecoder to always return true fixes the issue?

Can you try exporting the video at a lower resolution, such as 1280x720 or even 640x360 (using a Presentation effect)?

Assigning to @kggibson for follow-up and consideration if encoder fallback should try using software encoder

[SathyaKrishnaPrabhuTadepalli]

@ychaparov The devicePrefersSoftwareDecoder is private static method. How it can be overriden?

[ychaparov]

You would need to compile media3 libraries from the code in this repository

[ranjitsingha]

It is possible that these devices cannot simultaneously use both a hardware decoder and a hardware encoder at the requested video resolution.

Can you check if overriding the devicePrefersSoftwareDecoder to always return true fixes the issue?

Can you try exporting the video at a lower resolution, such as 1280x720 or even 640x360 (using a Presentation effect)?

Assigning to @kggibson for follow-up and consideration if encoder fallback should try using software encoder

Sry I can't do that because I can't compile media3

[ranjitsingha]

@ychaparov this is my code:
(Am i doing anything wrong ?)

@UnstableApi
    private void exportVideo() {
        try {
            MediaItem mediaItem = MediaItem.fromUri(viewModel.getVideoUri().getValue());
            final List<SubtitleEntry> subs = viewModel.getSubtitles().getValue();

            final int videoWidth = viewModel.getVideoWidth();
            final int videoHeight = viewModel.getVideoHeight();
            if (videoWidth == 0 || videoHeight == 0) {
                updateUIForError("Video dimensions not ready.");
                return;
            }

            CaptionOverlayView previewOverlay = activity.findViewById(R.id.captionOverlay);
            if (previewOverlay.getWidth() == 0 || previewOverlay.getHeight() == 0) {
                updateUIForError("Preview dimensions not available.");
                return;
            }

            final int viewWidth = previewOverlay.getWidth();
            final int viewHeight = previewOverlay.getHeight();
            float videoAspectRatio = (float) videoWidth / videoHeight;
            float viewAspectRatio = (float) viewWidth / viewHeight;
            final int previewContentWidth;
            final int previewContentHeight;
            if (videoAspectRatio > viewAspectRatio) {
                previewContentWidth = viewWidth;
                previewContentHeight = (int) (viewWidth / videoAspectRatio);
            } else {
                previewContentHeight = viewHeight;
                previewContentWidth = (int) (viewHeight * videoAspectRatio);
            }

            CaptionStyle style = activity.buildCurrentStyle();
            final CaptionOverlayView overlayViewForExport = new CaptionOverlayView(activity);

            overlayViewForExport.setSubtitles(subs);
            overlayViewForExport.setStyle(style);
            overlayViewForExport.measure(View.MeasureSpec.makeMeasureSpec(previewContentWidth, View.MeasureSpec.EXACTLY), View.MeasureSpec.makeMeasureSpec(previewContentHeight, View.MeasureSpec.EXACTLY));
            overlayViewForExport.layout(0, 0, previewContentWidth, previewContentHeight);

            BitmapOverlay captionOverlay = new BitmapOverlay() {
                private Bitmap tempBitmap;
                private Canvas tempCanvas;
                private Bitmap finalBitmap;
                private Canvas finalCanvas;
                private final Matrix matrix = new Matrix();
                private final Paint paint = new Paint(Paint.FILTER_BITMAP_FLAG);

                @NonNull
                @Override
                public Bitmap getBitmap(long presentationTimeUs) {
                    overlayViewForExport.setPositionUs(presentationTimeUs);

                    if (tempBitmap == null || tempBitmap.getWidth() != previewContentWidth || tempBitmap.getHeight() != previewContentHeight) {
                        if (tempBitmap != null) tempBitmap.recycle();
                        tempBitmap = Bitmap.createBitmap(previewContentWidth, previewContentHeight, Bitmap.Config.ARGB_8888);
                        tempCanvas = new Canvas(tempBitmap);
                    }

                    if (finalBitmap == null || finalBitmap.getWidth() != videoWidth || finalBitmap.getHeight() != videoHeight) {
                        if (finalBitmap != null) finalBitmap.recycle();
                        finalBitmap = Bitmap.createBitmap(videoWidth, videoHeight, Bitmap.Config.ARGB_8888);
                        finalCanvas = new Canvas(finalBitmap);
                    }

                    tempBitmap.eraseColor(android.graphics.Color.TRANSPARENT);
                    overlayViewForExport.draw(tempCanvas);

                    finalBitmap.eraseColor(android.graphics.Color.TRANSPARENT);

                    float scale = (float) videoWidth / previewContentWidth;
                    matrix.reset();
                    matrix.postScale(scale, scale);
                    finalCanvas.drawBitmap(tempBitmap, matrix, paint);

                    return finalBitmap;
                }
            };

            OverlayEffect overlayEffect = new OverlayEffect(ImmutableList.of(captionOverlay));
            Effects effects = new Effects(ImmutableList.of(), ImmutableList.of(overlayEffect));
            EditedMediaItem editedMediaItem = new EditedMediaItem.Builder(mediaItem).setEffects(effects).build();

            DefaultEncoderFactory encoderFactory = new DefaultEncoderFactory.Builder(requireContext())
                    .setEnableFallback(true)
                    .build();

            transformer = new Transformer.Builder(requireContext().getApplicationContext())
                    .setEncoderFactory(encoderFactory)
                    .addListener(getTransformerListener())
                    .build();

            transformer.start(editedMediaItem, tempOutputFile.getAbsolutePath());
            progressHandler.post(progressRunnable);

        } catch (Exception e) {
            updateUIForError("Error preparing export: " + e.getMessage());
            FirebaseCrashlytics.getInstance().recordException(e);
        }
    }

[ychaparov]

I don't think you're doing something wrong - some devices struggle with higher-resolution videos.

Please try my earlier suggestion:

Can you try exporting the video at a lower resolution, such as 1280x720 or even 640x360 (using a Presentation effect)?