SurfaceProcessor

fun onInputSurface(request: SurfaceRequest): Unit

Invoked when CameraX requires an input Surface for reading original frames.

CameraX requests Surfaces when the upstream pipeline is reconfigured. For example, when UseCases are bound to lifecycle.

With OpenGL, the implementation should create a Surface backed by SurfaceTexture with the size of getResolution, then listen for the setOnFrameAvailableListener to get the incoming frames. The Surface should not be released until the callback provided in provideSurface is invoked. CameraX may request new input Surface before releasing the existing one.

If the implementation encounters errors in creating the input Surface, it should throw an ProcessingException to notify CameraX.

The implementation can replace a previously provided Surface by invoking invalidate. Once invoked, CameraX will restart the camera pipeline and call onInputSurface again with another SurfaceRequest.

The value of the getTransformMatrix will need an additional transformation. CameraX calculates the additional transformation based on UseCase configurations such as ViewPort and target rotation, and provide the value via updateTransformMatrix. Code sample:

// Create Surface based on the request.
SurfaceTexture surfaceTexture = SurfaceTexture(textureName);
surfaceTexture.setDefaultBufferSize(request.resolution.width, request.resolution.height);
Surface surface = Surface(surfaceTexture);

// Provide the Surface to CameraX, and cleanup when it's no longer used.
surfaceRequest.provideSurface(surface, executor, result -> {
    surfaceTexture.setOnFrameAvailableListener(null)
    surfaceTexture.release()
    surface.release()
});

// Listen to the incoming frames.
surfaceTexture.setOnFrameAvailableListener(surfaceTexture -> {
    // Process the incoming frames and draw to the output Surface from #onOutputSurface
}, handler);

fun onOutputSurface(surfaceOutput: SurfaceOutput): Unit

Invoked when CameraX provides output Surface(s) for drawing processed frames.

CameraX provides the output Surfaces when the downstream pipeline is reconfigured, for example, when UseCases are bound or the preview viewfinder is reset.

The provided Surfaces are for drawing processed frames. The implementation must get the Surface via getSurface and provide a < listening to the end-of-life event of the Surface. Then, the implementation should call close after it stops drawing to the Surface. CameraX may provide new output Surface before requesting to close the existing one.

If the implementation encounters an error and cannot consume the Surface, it should throw an ProcessingException to notify CameraX.

When drawing to the Surface, the implementation should apply an additional transformation to the input Surface by calling updateTransformMatrix with the value of getTransformMatrix} from the input Surface.