android.hardware.camera2
The android.hardware.camera2 package provides an interface to
individual camera devices connected to an Android device. It replaces
the deprecated Camera
class.
This package models a camera device as a pipeline, which takes in input requests for capturing a single frame, captures the single image per the request, and then outputs one capture result metadata packet, plus a set of output image buffers for the request. The requests are processed in-order, and multiple requests can be in flight at once. Since the camera device is a pipeline with multiple stages, having multiple requests in flight is required to maintain full framerate on most Android devices.
To enumerate, query, and open available camera devices, obtain a
CameraManager
instance.
Individual CameraDevices
provide a set of static property information that
describes the hardware device and the available settings and output
parameters for the device. This information is provided through the
CameraCharacteristics
object, and is
available through getCameraCharacteristics(String)
To capture or stream images from a camera device, the application
must first create a camera capture session
with a set of output Surfaces for use with the camera device, with
createCaptureSession(SessionConfiguration)
. Each
Surface has to be pre-configured with an appropriate
size and format
(if applicable) to match the sizes and formats
available from the camera device. A target Surface can be obtained
from a variety of classes, including SurfaceView
,
SurfaceTexture
via
Surface(SurfaceTexture)
,
MediaCodec
, MediaRecorder
,
Allocation
, and ImageReader
.
Generally, camera preview images are sent to SurfaceView
or TextureView
(via its
SurfaceTexture
). Capture of JPEG images or
RAW buffers for DngCreator
can be
done with ImageReader
with the JPEG
and RAW_SENSOR
formats. Application-driven
processing of camera data in OpenGL ES, or directly in managed or
native code is best done through SurfaceTexture
, or ImageReader
with a YUV_420_888
format,
respectively.
By default, YUV-format buffers provided by the camera are using the
JFIF YUV<->RGB transform matrix (equivalent to Rec.601 full-range
encoding), and after conversion to RGB with this matrix, the resulting
RGB data is in the sRGB colorspace. Captured JPEG images may contain
an ICC profile to specify their color space information; if not, they
should be assumed to be in the sRGB space as well. On some devices,
the output colorspace can be changed via setColorSpace(Named)
.
Note that although the YUV->RGB transform is the JFIF matrix (Rec.601 full-range), due to legacy and compatibility reasons, the output is in the sRGB colorspace, which uses the Rec.709 color primaries. Image processing code can safely treat the output RGB as being in the sRGB colorspace.
The application then needs to construct a CaptureRequest
, which defines all the
capture parameters needed by a camera device to capture a single
image. The request also lists which of the configured output Surfaces
should be used as targets for this capture. The CameraDevice has a
factory method
for creating a request builder
for a
given use case, which is optimized for the Android device the
application is running on.
Once the request has been set up, it can be handed to the active
capture session either for a one-shot capture
or for
an endlessly repeating
use. Both methods also have a variant that accepts a list
of requests to use as a burst capture / repeating burst. Repeating
requests have a lower priority than captures, so a request submitted
through capture()
while there's a repeating request
configured will be captured before any new instances of the currently
repeating (burst) capture will begin capture.
After processing a request, the camera device will produce a TotalCaptureResult
object, which contains
information about the state of the camera device at time of capture,
and the final settings used. These may vary somewhat from the request,
if rounding or resolving contradictory parameters was necessary. The
camera device will also send a frame of image data into each of the
output Surfaces
included in the request. These are produced
asynchronously relative to the output CaptureResult, sometimes
substantially later.
Classes
CameraCaptureSession |
A configured capture session for a CameraDevice , used for capturing images from the
camera or reprocessing images captured from the camera in the same session previously.
|
CameraCaptureSession.CaptureCallback |
A callback object for tracking the progress of a |
CameraCaptureSession.StateCallback | A callback object for receiving updates about the state of a camera capture session. |
CameraCharacteristics |
The properties describing a
|
CameraCharacteristics.Key<T> |
A Key is used to do camera characteristics field lookups with
CameraCharacteristics#get .
|
CameraConstrainedHighSpeedCaptureSession |
A constrained high speed capture session for a CameraDevice , used for capturing high
speed images from the CameraDevice for high speed video recording use case.
|
CameraDevice |
The CameraDevice class is a representation of a single camera connected to an Android device, allowing for fine-grain control of image capture and post-processing at high frame rates. |
CameraDevice.CameraDeviceSetup |
CameraDeviceSetup is a limited representation of CameraDevice that can be used to
query device specific information which would otherwise need a CameraDevice instance.
|
CameraDevice.StateCallback | A callback objects for receiving updates about the state of a camera device. |
CameraExtensionCharacteristics |
Allows clients to query availability and supported resolutions of camera extensions. |
CameraExtensionSession | A camera capture session that enables access to device-specific camera extensions, which often use multi-frame bursts and sophisticated post-process algorithms for image capture. |
CameraExtensionSession.ExtensionCaptureCallback |
A callback object for tracking the progress of a
CaptureRequest submitted to the camera device.
|
CameraExtensionSession.StateCallback | A callback object for receiving updates about the state of a camera extension session. |
CameraExtensionSession.StillCaptureLatency |
Realtime calculated still CameraExtensionSession.capture(CaptureRequest, Executor, ExtensionCaptureCallback) latency.
|
CameraManager |
A system service manager for detecting, characterizing, and connecting to
|
CameraManager.AvailabilityCallback | A callback for camera devices becoming available or unavailable to open. |
CameraManager.TorchCallback | A callback for camera flash torch modes becoming unavailable, disabled, or enabled. |
CameraMetadata<TKey> | The base class for camera controls and information. |
CameraOfflineSession |
A camera capture session that was switched to offline mode via successful call to
CameraCaptureSession#switchToOffline .
|
CameraOfflineSession.CameraOfflineSessionCallback | |
CaptureFailure | A report of failed capture for a single image capture from the image sensor. |
CaptureRequest |
An immutable package of settings and outputs needed to capture a single image from the camera device. |
CaptureRequest.Builder | A builder for capture requests. |
CaptureRequest.Key<T> |
A Key is used to do capture request field lookups with
CaptureRequest#get or to set fields with
CaptureRequest.Builder#set(Key, Object) .
|
CaptureResult |
The subset of the results of a single image capture from the image sensor. |
CaptureResult.Key<T> |
A Key is used to do capture result field lookups with
CaptureResult#get .
|
DngCreator |
The DngCreator class provides functions to write raw pixel data as a DNG file.
|
MultiResolutionImageReader |
The MultiResolutionImageReader class wraps a group of |
TotalCaptureResult |
The total assembled results of a single image capture from the image sensor. |
Exceptions
CameraAccessException |
|
Classes
- CameraCaptureSession
- CameraCaptureSession.CaptureCallback
- CameraCaptureSession.StateCallback
- CameraCharacteristics
- CameraCharacteristics.Key
- CameraConstrainedHighSpeedCaptureSession
- CameraDevice
- CameraDevice.CameraDeviceSetup
- CameraDevice.StateCallback
- CameraExtensionCharacteristics
- CameraExtensionSession
- CameraExtensionSession.ExtensionCaptureCallback
- CameraExtensionSession.StateCallback
- CameraExtensionSession.StillCaptureLatency
- CameraManager
- CameraManager.AvailabilityCallback
- CameraManager.TorchCallback
- CameraMetadata
- CameraOfflineSession
- CameraOfflineSession.CameraOfflineSessionCallback
- CaptureFailure
- CaptureRequest
- CaptureRequest.Builder
- CaptureRequest.Key
- CaptureResult
- CaptureResult.Key
- DngCreator
- MultiResolutionImageReader
- TotalCaptureResult
Exceptions