• FFmpeg源代码简单分析-其他-libswscale的sws_getContext()


    参考链接

    libswscale的sws_getContext()

    • FFmpeg中类库libswsscale用于图像处理(缩放,YUV/RGB格式转换)
    • libswscale是一个主要用于处理图片像素数据的类库。
    • 可以完成图片像素格式的转换,图片的拉伸等工作。
    • 有关libswscale的使用可以参考文章:最简单的基于FFmpeg的libswscale的示例(YUV转RGB)_雷霄骅的博客-CSDN博客_ffmpeg yuv422转rgb
    • libswscale常用的函数数量很少,一般情况下就3个:
      • sws_getContext():初始化一个SwsContext。
      • sws_scale():处理图像数据。
      • sws_freeContext():释放一个SwsContext。
    • 其中sws_getContext()也可以用sws_getCachedContext()取代。
    • sws_getContext()是初始化SwsContext的函数。
    • sws_getContext()的声明位于libswscale\swscale.h,如下所示。
    1. /**
    2. * Allocate and return an SwsContext. You need it to perform
    3. * scaling/conversion operations using sws_scale().
    4. *
    5. * @param srcW the width of the source image
    6. * @param srcH the height of the source image
    7. * @param srcFormat the source image format
    8. * @param dstW the width of the destination image
    9. * @param dstH the height of the destination image
    10. * @param dstFormat the destination image format
    11. * @param flags specify which algorithm and options to use for rescaling
    12. * @param param extra parameters to tune the used scaler
    13. * For SWS_BICUBIC param[0] and [1] tune the shape of the basis
    14. * function, param[0] tunes f(1) and param[1] f麓(1)
    15. * For SWS_GAUSS param[0] tunes the exponent and thus cutoff
    16. * frequency
    17. * For SWS_LANCZOS param[0] tunes the width of the window function
    18. * @return a pointer to an allocated context, or NULL in case of error
    19. * @note this function is to be removed after a saner alternative is
    20. * written
    21. */
    22. struct SwsContext *sws_getContext(int srcW, int srcH, enum AVPixelFormat srcFormat,
    23. int dstW, int dstH, enum AVPixelFormat dstFormat,
    24. int flags, SwsFilter *srcFilter,
    25. SwsFilter *dstFilter, const double *param);
    • 该函数包含以下参数:
      • srcW:源图像的宽
      • srcH:源图像的高
      • srcFormat:源图像的像素格式
      • dstW:目标图像的宽
      • dstH:目标图像的高
      • dstFormat:目标图像的像素格式
      • flags:设定图像拉伸使用的算法
    • 成功执行的话返回生成的SwsContext,否则返回NULL。
    • sws_getContext()的定义位于libswscale\utils.c,如下所示。
    1. SwsContext *sws_getContext(int srcW, int srcH, enum AVPixelFormat srcFormat,
    2. int dstW, int dstH, enum AVPixelFormat dstFormat,
    3. int flags, SwsFilter *srcFilter,
    4. SwsFilter *dstFilter, const double *param)
    5. {
    6. SwsContext *c;
    7. c = sws_alloc_set_opts(srcW, srcH, srcFormat,
    8. dstW, dstH, dstFormat,
    9. flags, param);
    10. if (!c)
    11. return NULL;
    12. if (sws_init_context(c, srcFilter, dstFilter) < 0) {
    13. sws_freeContext(c);
    14. return NULL;
    15. }
    16. return c;
    17. }
    •  从sws_getContext()的定义中可以看出,它首先调用了一个函数sws_alloc_set_opts,sws_alloc_set_opts函数包含了先前的sws_alloc_context()函数,目的保持不变给SwsContext分配内存。
    • 然后将传入的源图像,目标图像的宽高,像素格式,以及标志位分别赋值给该SwsContext相应的字段。最后调用一个函数sws_init_context()完成初始化工作。
    • 下面我们分别看一下sws_alloc_set_opts、sws_alloc_context()和sws_init_context()这几个函数。

    sws_alloc_set_opts 

    1. /**
    2. * Allocate and return an SwsContext.
    3. * This is like sws_getContext() but does not perform the init step, allowing
    4. * the user to set additional AVOptions.
    5. *
    6. * @see sws_getContext()
    7. */
    8. struct SwsContext *sws_alloc_set_opts(int srcW, int srcH, enum AVPixelFormat srcFormat,
    9. int dstW, int dstH, enum AVPixelFormat dstFormat,
    10. int flags, const double *param);
    1. SwsContext *sws_alloc_set_opts(int srcW, int srcH, enum AVPixelFormat srcFormat,
    2. int dstW, int dstH, enum AVPixelFormat dstFormat,
    3. int flags, const double *param)
    4. {
    5. SwsContext *c;
    6. if (!(c = sws_alloc_context()))
    7. return NULL;
    8. c->flags = flags;
    9. c->srcW = srcW;
    10. c->srcH = srcH;
    11. c->dstW = dstW;
    12. c->dstH = dstH;
    13. c->srcFormat = srcFormat;
    14. c->dstFormat = dstFormat;
    15. if (param) {
    16. c->param[0] = param[0];
    17. c->param[1] = param[1];
    18. }
    19. return c;
    20. }

     sws_alloc_context()

    • sws_alloc_context()是FFmpeg的一个API,用于给SwsContext分配内存,它的声明如下所示。 
    1. /**
    2. * Allocate an empty SwsContext. This must be filled and passed to
    3. * sws_init_context(). For filling see AVOptions, options.c and
    4. * sws_setColorspaceDetails().
    5. */
    6. struct SwsContext *sws_alloc_context(void);
    • sws_alloc_context()的定义位于libswscale\utils.c,如下所示。
    • 从代码中可以看出,sws_alloc_context()首先调用av_mallocz()为SwsContext结构体分配了一块内存;
    • 然后设置了该结构体的AVClass,并且给该结构体的字段设置了默认值。
    1. SwsContext *sws_alloc_context(void)
    2. {
    3. SwsContext *c = av_mallocz(sizeof(SwsContext));
    4. av_assert0(offsetof(SwsContext, redDither) + DITHER32_INT == offsetof(SwsContext, dither32));
    5. if (c) {
    6. c->av_class = &ff_sws_context_class;
    7. av_opt_set_defaults(c);
    8. atomic_init(&c->stride_unaligned_warned, 0);
    9. atomic_init(&c->data_unaligned_warned, 0);
    10. }
    11. return c;
    12. }

    sws_init_context

    • sws_init_context()的是FFmpeg的一个API,用于初始化SwsContext。
    1. /**
    2. * Initialize the swscaler context sws_context.
    3. *
    4. * @return zero or positive value on success, a negative value on
    5. * error
    6. */
    7. av_warn_unused_result
    8. int sws_init_context(struct SwsContext *sws_context, SwsFilter *srcFilter, SwsFilter *dstFilter);
    • sws_init_context()的函数定义非常的长,位于libswscale\utils.c,如下所示。
    1. av_cold int sws_init_context(SwsContext *c, SwsFilter *srcFilter,
    2. SwsFilter *dstFilter)
    3. {
    4. int i;
    5. int usesVFilter, usesHFilter;
    6. int unscaled;
    7. SwsFilter dummyFilter = { NULL, NULL, NULL, NULL };
    8. int srcW = c->srcW;
    9. int srcH = c->srcH;
    10. int dstW = c->dstW;
    11. int dstH = c->dstH;
    12. int dst_stride = FFALIGN(dstW * sizeof(int16_t) + 66, 16);
    13. int flags, cpu_flags;
    14. enum AVPixelFormat srcFormat = c->srcFormat;
    15. enum AVPixelFormat dstFormat = c->dstFormat;
    16. const AVPixFmtDescriptor *desc_src;
    17. const AVPixFmtDescriptor *desc_dst;
    18. int ret = 0;
    19. enum AVPixelFormat tmpFmt;
    20. static const float float_mult = 1.0f / 255.0f;
    21. static AVOnce rgb2rgb_once = AV_ONCE_INIT;
    22. if (c->nb_threads != 1) {
    23. ret = context_init_threaded(c, srcFilter, dstFilter);
    24. if (ret < 0 || c->nb_threads > 1)
    25. return ret;
    26. // threading disabled in this build, init as single-threaded
    27. }
    28. cpu_flags = av_get_cpu_flags();
    29. flags = c->flags;
    30. emms_c();
    31. if (ff_thread_once(&rgb2rgb_once, ff_sws_rgb2rgb_init) != 0)
    32. return AVERROR_UNKNOWN;
    33. unscaled = (srcW == dstW && srcH == dstH);
    34. c->srcRange |= handle_jpeg(&c->srcFormat);
    35. c->dstRange |= handle_jpeg(&c->dstFormat);
    36. if(srcFormat!=c->srcFormat || dstFormat!=c->dstFormat)
    37. av_log(c, AV_LOG_WARNING, "deprecated pixel format used, make sure you did set range correctly\n");
    38. if (!c->contrast && !c->saturation && !c->dstFormatBpp)
    39. sws_setColorspaceDetails(c, ff_yuv2rgb_coeffs[SWS_CS_DEFAULT], c->srcRange,
    40. ff_yuv2rgb_coeffs[SWS_CS_DEFAULT],
    41. c->dstRange, 0, 1 << 16, 1 << 16);
    42. handle_formats(c);
    43. srcFormat = c->srcFormat;
    44. dstFormat = c->dstFormat;
    45. desc_src = av_pix_fmt_desc_get(srcFormat);
    46. desc_dst = av_pix_fmt_desc_get(dstFormat);
    47. // If the source has no alpha then disable alpha blendaway
    48. if (c->src0Alpha)
    49. c->alphablend = SWS_ALPHA_BLEND_NONE;
    50. if (!(unscaled && sws_isSupportedEndiannessConversion(srcFormat) &&
    51. av_pix_fmt_swap_endianness(srcFormat) == dstFormat)) {
    52. if (!sws_isSupportedInput(srcFormat)) {
    53. av_log(c, AV_LOG_ERROR, "%s is not supported as input pixel format\n",
    54. av_get_pix_fmt_name(srcFormat));
    55. return AVERROR(EINVAL);
    56. }
    57. if (!sws_isSupportedOutput(dstFormat)) {
    58. av_log(c, AV_LOG_ERROR, "%s is not supported as output pixel format\n",
    59. av_get_pix_fmt_name(dstFormat));
    60. return AVERROR(EINVAL);
    61. }
    62. }
    63. av_assert2(desc_src && desc_dst);
    64. i = flags & (SWS_POINT |
    65. SWS_AREA |
    66. SWS_BILINEAR |
    67. SWS_FAST_BILINEAR |
    68. SWS_BICUBIC |
    69. SWS_X |
    70. SWS_GAUSS |
    71. SWS_LANCZOS |
    72. SWS_SINC |
    73. SWS_SPLINE |
    74. SWS_BICUBLIN);
    75. /* provide a default scaler if not set by caller */
    76. if (!i) {
    77. if (dstW < srcW && dstH < srcH)
    78. flags |= SWS_BICUBIC;
    79. else if (dstW > srcW && dstH > srcH)
    80. flags |= SWS_BICUBIC;
    81. else
    82. flags |= SWS_BICUBIC;
    83. c->flags = flags;
    84. } else if (i & (i - 1)) {
    85. av_log(c, AV_LOG_ERROR,
    86. "Exactly one scaler algorithm must be chosen, got %X\n", i);
    87. return AVERROR(EINVAL);
    88. }
    89. /* sanity check */
    90. if (srcW < 1 || srcH < 1 || dstW < 1 || dstH < 1) {
    91. /* FIXME check if these are enough and try to lower them after
    92. * fixing the relevant parts of the code */
    93. av_log(c, AV_LOG_ERROR, "%dx%d -> %dx%d is invalid scaling dimension\n",
    94. srcW, srcH, dstW, dstH);
    95. return AVERROR(EINVAL);
    96. }
    97. if (flags & SWS_FAST_BILINEAR) {
    98. if (srcW < 8 || dstW < 8) {
    99. flags ^= SWS_FAST_BILINEAR | SWS_BILINEAR;
    100. c->flags = flags;
    101. }
    102. }
    103. if (!dstFilter)
    104. dstFilter = &dummyFilter;
    105. if (!srcFilter)
    106. srcFilter = &dummyFilter;
    107. c->lumXInc = (((int64_t)srcW << 16) + (dstW >> 1)) / dstW;
    108. c->lumYInc = (((int64_t)srcH << 16) + (dstH >> 1)) / dstH;
    109. c->dstFormatBpp = av_get_bits_per_pixel(desc_dst);
    110. c->srcFormatBpp = av_get_bits_per_pixel(desc_src);
    111. c->vRounder = 4 * 0x0001000100010001ULL;
    112. usesVFilter = (srcFilter->lumV && srcFilter->lumV->length > 1) ||
    113. (srcFilter->chrV && srcFilter->chrV->length > 1) ||
    114. (dstFilter->lumV && dstFilter->lumV->length > 1) ||
    115. (dstFilter->chrV && dstFilter->chrV->length > 1);
    116. usesHFilter = (srcFilter->lumH && srcFilter->lumH->length > 1) ||
    117. (srcFilter->chrH && srcFilter->chrH->length > 1) ||
    118. (dstFilter->lumH && dstFilter->lumH->length > 1) ||
    119. (dstFilter->chrH && dstFilter->chrH->length > 1);
    120. av_pix_fmt_get_chroma_sub_sample(srcFormat, &c->chrSrcHSubSample, &c->chrSrcVSubSample);
    121. av_pix_fmt_get_chroma_sub_sample(dstFormat, &c->chrDstHSubSample, &c->chrDstVSubSample);
    122. c->dst_slice_align = 1 << c->chrDstVSubSample;
    123. if (isAnyRGB(dstFormat) && !(flags&SWS_FULL_CHR_H_INT)) {
    124. if (dstW&1) {
    125. av_log(c, AV_LOG_DEBUG, "Forcing full internal H chroma due to odd output size\n");
    126. flags |= SWS_FULL_CHR_H_INT;
    127. c->flags = flags;
    128. }
    129. if ( c->chrSrcHSubSample == 0
    130. && c->chrSrcVSubSample == 0
    131. && c->dither != SWS_DITHER_BAYER //SWS_FULL_CHR_H_INT is currently not supported with SWS_DITHER_BAYER
    132. && !(c->flags & SWS_FAST_BILINEAR)
    133. ) {
    134. av_log(c, AV_LOG_DEBUG, "Forcing full internal H chroma due to input having non subsampled chroma\n");
    135. flags |= SWS_FULL_CHR_H_INT;
    136. c->flags = flags;
    137. }
    138. }
    139. if (c->dither == SWS_DITHER_AUTO) {
    140. if (flags & SWS_ERROR_DIFFUSION)
    141. c->dither = SWS_DITHER_ED;
    142. }
    143. if(dstFormat == AV_PIX_FMT_BGR4_BYTE ||
    144. dstFormat == AV_PIX_FMT_RGB4_BYTE ||
    145. dstFormat == AV_PIX_FMT_BGR8 ||
    146. dstFormat == AV_PIX_FMT_RGB8) {
    147. if (c->dither == SWS_DITHER_AUTO)
    148. c->dither = (flags & SWS_FULL_CHR_H_INT) ? SWS_DITHER_ED : SWS_DITHER_BAYER;
    149. if (!(flags & SWS_FULL_CHR_H_INT)) {
    150. if (c->dither == SWS_DITHER_ED || c->dither == SWS_DITHER_A_DITHER || c->dither == SWS_DITHER_X_DITHER || c->dither == SWS_DITHER_NONE) {
    151. av_log(c, AV_LOG_DEBUG,
    152. "Desired dithering only supported in full chroma interpolation for destination format '%s'\n",
    153. av_get_pix_fmt_name(dstFormat));
    154. flags |= SWS_FULL_CHR_H_INT;
    155. c->flags = flags;
    156. }
    157. }
    158. if (flags & SWS_FULL_CHR_H_INT) {
    159. if (c->dither == SWS_DITHER_BAYER) {
    160. av_log(c, AV_LOG_DEBUG,
    161. "Ordered dither is not supported in full chroma interpolation for destination format '%s'\n",
    162. av_get_pix_fmt_name(dstFormat));
    163. c->dither = SWS_DITHER_ED;
    164. }
    165. }
    166. }
    167. if (isPlanarRGB(dstFormat)) {
    168. if (!(flags & SWS_FULL_CHR_H_INT)) {
    169. av_log(c, AV_LOG_DEBUG,
    170. "%s output is not supported with half chroma resolution, switching to full\n",
    171. av_get_pix_fmt_name(dstFormat));
    172. flags |= SWS_FULL_CHR_H_INT;
    173. c->flags = flags;
    174. }
    175. }
    176. /* reuse chroma for 2 pixels RGB/BGR unless user wants full
    177. * chroma interpolation */
    178. if (flags & SWS_FULL_CHR_H_INT &&
    179. isAnyRGB(dstFormat) &&
    180. !isPlanarRGB(dstFormat) &&
    181. dstFormat != AV_PIX_FMT_RGBA64LE &&
    182. dstFormat != AV_PIX_FMT_RGBA64BE &&
    183. dstFormat != AV_PIX_FMT_BGRA64LE &&
    184. dstFormat != AV_PIX_FMT_BGRA64BE &&
    185. dstFormat != AV_PIX_FMT_RGB48LE &&
    186. dstFormat != AV_PIX_FMT_RGB48BE &&
    187. dstFormat != AV_PIX_FMT_BGR48LE &&
    188. dstFormat != AV_PIX_FMT_BGR48BE &&
    189. dstFormat != AV_PIX_FMT_RGBA &&
    190. dstFormat != AV_PIX_FMT_ARGB &&
    191. dstFormat != AV_PIX_FMT_BGRA &&
    192. dstFormat != AV_PIX_FMT_ABGR &&
    193. dstFormat != AV_PIX_FMT_RGB24 &&
    194. dstFormat != AV_PIX_FMT_BGR24 &&
    195. dstFormat != AV_PIX_FMT_BGR4_BYTE &&
    196. dstFormat != AV_PIX_FMT_RGB4_BYTE &&
    197. dstFormat != AV_PIX_FMT_BGR8 &&
    198. dstFormat != AV_PIX_FMT_RGB8
    199. ) {
    200. av_log(c, AV_LOG_WARNING,
    201. "full chroma interpolation for destination format '%s' not yet implemented\n",
    202. av_get_pix_fmt_name(dstFormat));
    203. flags &= ~SWS_FULL_CHR_H_INT;
    204. c->flags = flags;
    205. }
    206. if (isAnyRGB(dstFormat) && !(flags & SWS_FULL_CHR_H_INT))
    207. c->chrDstHSubSample = 1;
    208. // drop some chroma lines if the user wants it
    209. c->vChrDrop = (flags & SWS_SRC_V_CHR_DROP_MASK) >>
    210. SWS_SRC_V_CHR_DROP_SHIFT;
    211. c->chrSrcVSubSample += c->vChrDrop;
    212. /* drop every other pixel for chroma calculation unless user
    213. * wants full chroma */
    214. if (isAnyRGB(srcFormat) && !(flags & SWS_FULL_CHR_H_INP) &&
    215. srcFormat != AV_PIX_FMT_RGB8 && srcFormat != AV_PIX_FMT_BGR8 &&
    216. srcFormat != AV_PIX_FMT_RGB4 && srcFormat != AV_PIX_FMT_BGR4 &&
    217. srcFormat != AV_PIX_FMT_RGB4_BYTE && srcFormat != AV_PIX_FMT_BGR4_BYTE &&
    218. srcFormat != AV_PIX_FMT_GBRP9BE && srcFormat != AV_PIX_FMT_GBRP9LE &&
    219. srcFormat != AV_PIX_FMT_GBRP10BE && srcFormat != AV_PIX_FMT_GBRP10LE &&
    220. srcFormat != AV_PIX_FMT_GBRAP10BE && srcFormat != AV_PIX_FMT_GBRAP10LE &&
    221. srcFormat != AV_PIX_FMT_GBRP12BE && srcFormat != AV_PIX_FMT_GBRP12LE &&
    222. srcFormat != AV_PIX_FMT_GBRAP12BE && srcFormat != AV_PIX_FMT_GBRAP12LE &&
    223. srcFormat != AV_PIX_FMT_GBRP14BE && srcFormat != AV_PIX_FMT_GBRP14LE &&
    224. srcFormat != AV_PIX_FMT_GBRP16BE && srcFormat != AV_PIX_FMT_GBRP16LE &&
    225. srcFormat != AV_PIX_FMT_GBRAP16BE && srcFormat != AV_PIX_FMT_GBRAP16LE &&
    226. srcFormat != AV_PIX_FMT_GBRPF32BE && srcFormat != AV_PIX_FMT_GBRPF32LE &&
    227. srcFormat != AV_PIX_FMT_GBRAPF32BE && srcFormat != AV_PIX_FMT_GBRAPF32LE &&
    228. ((dstW >> c->chrDstHSubSample) <= (srcW >> 1) ||
    229. (flags & SWS_FAST_BILINEAR)))
    230. c->chrSrcHSubSample = 1;
    231. // Note the AV_CEIL_RSHIFT is so that we always round toward +inf.
    232. c->chrSrcW = AV_CEIL_RSHIFT(srcW, c->chrSrcHSubSample);
    233. c->chrSrcH = AV_CEIL_RSHIFT(srcH, c->chrSrcVSubSample);
    234. c->chrDstW = AV_CEIL_RSHIFT(dstW, c->chrDstHSubSample);
    235. c->chrDstH = AV_CEIL_RSHIFT(dstH, c->chrDstVSubSample);
    236. if (!FF_ALLOCZ_TYPED_ARRAY(c->formatConvBuffer, FFALIGN(srcW * 2 + 78, 16) * 2))
    237. goto nomem;
    238. c->frame_src = av_frame_alloc();
    239. c->frame_dst = av_frame_alloc();
    240. if (!c->frame_src || !c->frame_dst)
    241. goto nomem;
    242. c->srcBpc = desc_src->comp[0].depth;
    243. if (c->srcBpc < 8)
    244. c->srcBpc = 8;
    245. c->dstBpc = desc_dst->comp[0].depth;
    246. if (c->dstBpc < 8)
    247. c->dstBpc = 8;
    248. if (isAnyRGB(srcFormat) || srcFormat == AV_PIX_FMT_PAL8)
    249. c->srcBpc = 16;
    250. if (c->dstBpc == 16)
    251. dst_stride <<= 1;
    252. if (INLINE_MMXEXT(cpu_flags) && c->srcBpc == 8 && c->dstBpc <= 14) {
    253. c->canMMXEXTBeUsed = dstW >= srcW && (dstW & 31) == 0 &&
    254. c->chrDstW >= c->chrSrcW &&
    255. (srcW & 15) == 0;
    256. if (!c->canMMXEXTBeUsed && dstW >= srcW && c->chrDstW >= c->chrSrcW && (srcW & 15) == 0
    257. && (flags & SWS_FAST_BILINEAR)) {
    258. if (flags & SWS_PRINT_INFO)
    259. av_log(c, AV_LOG_INFO,
    260. "output width is not a multiple of 32 -> no MMXEXT scaler\n");
    261. }
    262. if (usesHFilter || isNBPS(c->srcFormat) || is16BPS(c->srcFormat) || isAnyRGB(c->srcFormat))
    263. c->canMMXEXTBeUsed = 0;
    264. } else
    265. c->canMMXEXTBeUsed = 0;
    266. c->chrXInc = (((int64_t)c->chrSrcW << 16) + (c->chrDstW >> 1)) / c->chrDstW;
    267. c->chrYInc = (((int64_t)c->chrSrcH << 16) + (c->chrDstH >> 1)) / c->chrDstH;
    268. /* Match pixel 0 of the src to pixel 0 of dst and match pixel n-2 of src
    269. * to pixel n-2 of dst, but only for the FAST_BILINEAR mode otherwise do
    270. * correct scaling.
    271. * n-2 is the last chrominance sample available.
    272. * This is not perfect, but no one should notice the difference, the more
    273. * correct variant would be like the vertical one, but that would require
    274. * some special code for the first and last pixel */
    275. if (flags & SWS_FAST_BILINEAR) {
    276. if (c->canMMXEXTBeUsed) {
    277. c->lumXInc += 20;
    278. c->chrXInc += 20;
    279. }
    280. // we don't use the x86 asm scaler if MMX is available
    281. else if (INLINE_MMX(cpu_flags) && c->dstBpc <= 14) {
    282. c->lumXInc = ((int64_t)(srcW - 2) << 16) / (dstW - 2) - 20;
    283. c->chrXInc = ((int64_t)(c->chrSrcW - 2) << 16) / (c->chrDstW - 2) - 20;
    284. }
    285. }
    286. // hardcoded for now
    287. c->gamma_value = 2.2;
    288. tmpFmt = AV_PIX_FMT_RGBA64LE;
    289. if (!unscaled && c->gamma_flag && (srcFormat != tmpFmt || dstFormat != tmpFmt)) {
    290. SwsContext *c2;
    291. c->cascaded_context[0] = NULL;
    292. ret = av_image_alloc(c->cascaded_tmp, c->cascaded_tmpStride,
    293. srcW, srcH, tmpFmt, 64);
    294. if (ret < 0)
    295. return ret;
    296. c->cascaded_context[0] = sws_getContext(srcW, srcH, srcFormat,
    297. srcW, srcH, tmpFmt,
    298. flags, NULL, NULL, c->param);
    299. if (!c->cascaded_context[0]) {
    300. return AVERROR(ENOMEM);
    301. }
    302. c->cascaded_context[1] = sws_getContext(srcW, srcH, tmpFmt,
    303. dstW, dstH, tmpFmt,
    304. flags, srcFilter, dstFilter, c->param);
    305. if (!c->cascaded_context[1])
    306. return AVERROR(ENOMEM);
    307. c2 = c->cascaded_context[1];
    308. c2->is_internal_gamma = 1;
    309. c2->gamma = alloc_gamma_tbl( c->gamma_value);
    310. c2->inv_gamma = alloc_gamma_tbl(1.f/c->gamma_value);
    311. if (!c2->gamma || !c2->inv_gamma)
    312. return AVERROR(ENOMEM);
    313. // is_internal_flag is set after creating the context
    314. // to properly create the gamma convert FilterDescriptor
    315. // we have to re-initialize it
    316. ff_free_filters(c2);
    317. if ((ret = ff_init_filters(c2)) < 0) {
    318. sws_freeContext(c2);
    319. c->cascaded_context[1] = NULL;
    320. return ret;
    321. }
    322. c->cascaded_context[2] = NULL;
    323. if (dstFormat != tmpFmt) {
    324. ret = av_image_alloc(c->cascaded1_tmp, c->cascaded1_tmpStride,
    325. dstW, dstH, tmpFmt, 64);
    326. if (ret < 0)
    327. return ret;
    328. c->cascaded_context[2] = sws_getContext(dstW, dstH, tmpFmt,
    329. dstW, dstH, dstFormat,
    330. flags, NULL, NULL, c->param);
    331. if (!c->cascaded_context[2])
    332. return AVERROR(ENOMEM);
    333. }
    334. return 0;
    335. }
    336. if (isBayer(srcFormat)) {
    337. if (!unscaled ||
    338. (dstFormat != AV_PIX_FMT_RGB24 && dstFormat != AV_PIX_FMT_YUV420P &&
    339. dstFormat != AV_PIX_FMT_RGB48)) {
    340. enum AVPixelFormat tmpFormat = isBayer16BPS(srcFormat) ? AV_PIX_FMT_RGB48 : AV_PIX_FMT_RGB24;
    341. ret = av_image_alloc(c->cascaded_tmp, c->cascaded_tmpStride,
    342. srcW, srcH, tmpFormat, 64);
    343. if (ret < 0)
    344. return ret;
    345. c->cascaded_context[0] = sws_getContext(srcW, srcH, srcFormat,
    346. srcW, srcH, tmpFormat,
    347. flags, srcFilter, NULL, c->param);
    348. if (!c->cascaded_context[0])
    349. return AVERROR(ENOMEM);
    350. c->cascaded_context[1] = sws_getContext(srcW, srcH, tmpFormat,
    351. dstW, dstH, dstFormat,
    352. flags, NULL, dstFilter, c->param);
    353. if (!c->cascaded_context[1])
    354. return AVERROR(ENOMEM);
    355. return 0;
    356. }
    357. }
    358. if (unscaled && c->srcBpc == 8 && dstFormat == AV_PIX_FMT_GRAYF32){
    359. for (i = 0; i < 256; ++i){
    360. c->uint2float_lut[i] = (float)i * float_mult;
    361. }
    362. }
    363. // float will be converted to uint16_t
    364. if ((srcFormat == AV_PIX_FMT_GRAYF32BE || srcFormat == AV_PIX_FMT_GRAYF32LE) &&
    365. (!unscaled || unscaled && dstFormat != srcFormat && (srcFormat != AV_PIX_FMT_GRAYF32 ||
    366. dstFormat != AV_PIX_FMT_GRAY8))){
    367. c->srcBpc = 16;
    368. }
    369. if (CONFIG_SWSCALE_ALPHA && isALPHA(srcFormat) && !isALPHA(dstFormat)) {
    370. enum AVPixelFormat tmpFormat = alphaless_fmt(srcFormat);
    371. if (tmpFormat != AV_PIX_FMT_NONE && c->alphablend != SWS_ALPHA_BLEND_NONE) {
    372. if (!unscaled ||
    373. dstFormat != tmpFormat ||
    374. usesHFilter || usesVFilter ||
    375. c->srcRange != c->dstRange
    376. ) {
    377. c->cascaded_mainindex = 1;
    378. ret = av_image_alloc(c->cascaded_tmp, c->cascaded_tmpStride,
    379. srcW, srcH, tmpFormat, 64);
    380. if (ret < 0)
    381. return ret;
    382. c->cascaded_context[0] = sws_alloc_set_opts(srcW, srcH, srcFormat,
    383. srcW, srcH, tmpFormat,
    384. flags, c->param);
    385. if (!c->cascaded_context[0])
    386. return AVERROR(EINVAL);
    387. c->cascaded_context[0]->alphablend = c->alphablend;
    388. ret = sws_init_context(c->cascaded_context[0], NULL , NULL);
    389. if (ret < 0)
    390. return ret;
    391. c->cascaded_context[1] = sws_alloc_set_opts(srcW, srcH, tmpFormat,
    392. dstW, dstH, dstFormat,
    393. flags, c->param);
    394. if (!c->cascaded_context[1])
    395. return AVERROR(EINVAL);
    396. c->cascaded_context[1]->srcRange = c->srcRange;
    397. c->cascaded_context[1]->dstRange = c->dstRange;
    398. ret = sws_init_context(c->cascaded_context[1], srcFilter , dstFilter);
    399. if (ret < 0)
    400. return ret;
    401. return 0;
    402. }
    403. }
    404. }
    405. #if HAVE_MMAP && HAVE_MPROTECT && defined(MAP_ANONYMOUS)
    406. #define USE_MMAP 1
    407. #else
    408. #define USE_MMAP 0
    409. #endif
    410. /* precalculate horizontal scaler filter coefficients */
    411. {
    412. #if HAVE_MMXEXT_INLINE
    413. // can't downscale !!!
    414. if (c->canMMXEXTBeUsed && (flags & SWS_FAST_BILINEAR)) {
    415. c->lumMmxextFilterCodeSize = ff_init_hscaler_mmxext(dstW, c->lumXInc, NULL,
    416. NULL, NULL, 8);
    417. c->chrMmxextFilterCodeSize = ff_init_hscaler_mmxext(c->chrDstW, c->chrXInc,
    418. NULL, NULL, NULL, 4);
    419. #if USE_MMAP
    420. c->lumMmxextFilterCode = mmap(NULL, c->lumMmxextFilterCodeSize,
    421. PROT_READ | PROT_WRITE,
    422. MAP_PRIVATE | MAP_ANONYMOUS,
    423. -1, 0);
    424. c->chrMmxextFilterCode = mmap(NULL, c->chrMmxextFilterCodeSize,
    425. PROT_READ | PROT_WRITE,
    426. MAP_PRIVATE | MAP_ANONYMOUS,
    427. -1, 0);
    428. #elif HAVE_VIRTUALALLOC
    429. c->lumMmxextFilterCode = VirtualAlloc(NULL,
    430. c->lumMmxextFilterCodeSize,
    431. MEM_COMMIT,
    432. PAGE_EXECUTE_READWRITE);
    433. c->chrMmxextFilterCode = VirtualAlloc(NULL,
    434. c->chrMmxextFilterCodeSize,
    435. MEM_COMMIT,
    436. PAGE_EXECUTE_READWRITE);
    437. #else
    438. c->lumMmxextFilterCode = av_malloc(c->lumMmxextFilterCodeSize);
    439. c->chrMmxextFilterCode = av_malloc(c->chrMmxextFilterCodeSize);
    440. #endif
    441. #ifdef MAP_ANONYMOUS
    442. if (c->lumMmxextFilterCode == MAP_FAILED || c->chrMmxextFilterCode == MAP_FAILED)
    443. #else
    444. if (!c->lumMmxextFilterCode || !c->chrMmxextFilterCode)
    445. #endif
    446. {
    447. av_log(c, AV_LOG_ERROR, "Failed to allocate MMX2FilterCode\n");
    448. return AVERROR(ENOMEM);
    449. }
    450. if (!FF_ALLOCZ_TYPED_ARRAY(c->hLumFilter, dstW / 8 + 8) ||
    451. !FF_ALLOCZ_TYPED_ARRAY(c->hChrFilter, c->chrDstW / 4 + 8) ||
    452. !FF_ALLOCZ_TYPED_ARRAY(c->hLumFilterPos, dstW / 2 / 8 + 8) ||
    453. !FF_ALLOCZ_TYPED_ARRAY(c->hChrFilterPos, c->chrDstW / 2 / 4 + 8))
    454. goto nomem;
    455. ff_init_hscaler_mmxext( dstW, c->lumXInc, c->lumMmxextFilterCode,
    456. c->hLumFilter, (uint32_t*)c->hLumFilterPos, 8);
    457. ff_init_hscaler_mmxext(c->chrDstW, c->chrXInc, c->chrMmxextFilterCode,
    458. c->hChrFilter, (uint32_t*)c->hChrFilterPos, 4);
    459. #if USE_MMAP
    460. if ( mprotect(c->lumMmxextFilterCode, c->lumMmxextFilterCodeSize, PROT_EXEC | PROT_READ) == -1
    461. || mprotect(c->chrMmxextFilterCode, c->chrMmxextFilterCodeSize, PROT_EXEC | PROT_READ) == -1) {
    462. av_log(c, AV_LOG_ERROR, "mprotect failed, cannot use fast bilinear scaler\n");
    463. ret = AVERROR(EINVAL);
    464. goto fail;
    465. }
    466. #endif
    467. } else
    468. #endif /* HAVE_MMXEXT_INLINE */
    469. {
    470. const int filterAlign = X86_MMX(cpu_flags) ? 4 :
    471. PPC_ALTIVEC(cpu_flags) ? 8 :
    472. have_neon(cpu_flags) ? 4 : 1;
    473. if ((ret = initFilter(&c->hLumFilter, &c->hLumFilterPos,
    474. &c->hLumFilterSize, c->lumXInc,
    475. srcW, dstW, filterAlign, 1 << 14,
    476. (flags & SWS_BICUBLIN) ? (flags | SWS_BICUBIC) : flags,
    477. cpu_flags, srcFilter->lumH, dstFilter->lumH,
    478. c->param,
    479. get_local_pos(c, 0, 0, 0),
    480. get_local_pos(c, 0, 0, 0))) < 0)
    481. goto fail;
    482. if (ff_shuffle_filter_coefficients(c, c->hLumFilterPos, c->hLumFilterSize, c->hLumFilter, dstW) < 0)
    483. goto nomem;
    484. if ((ret = initFilter(&c->hChrFilter, &c->hChrFilterPos,
    485. &c->hChrFilterSize, c->chrXInc,
    486. c->chrSrcW, c->chrDstW, filterAlign, 1 << 14,
    487. (flags & SWS_BICUBLIN) ? (flags | SWS_BILINEAR) : flags,
    488. cpu_flags, srcFilter->chrH, dstFilter->chrH,
    489. c->param,
    490. get_local_pos(c, c->chrSrcHSubSample, c->src_h_chr_pos, 0),
    491. get_local_pos(c, c->chrDstHSubSample, c->dst_h_chr_pos, 0))) < 0)
    492. goto fail;
    493. if (ff_shuffle_filter_coefficients(c, c->hChrFilterPos, c->hChrFilterSize, c->hChrFilter, c->chrDstW) < 0)
    494. goto nomem;
    495. }
    496. } // initialize horizontal stuff
    497. /* precalculate vertical scaler filter coefficients */
    498. {
    499. const int filterAlign = X86_MMX(cpu_flags) ? 2 :
    500. PPC_ALTIVEC(cpu_flags) ? 8 :
    501. have_neon(cpu_flags) ? 2 : 1;
    502. if ((ret = initFilter(&c->vLumFilter, &c->vLumFilterPos, &c->vLumFilterSize,
    503. c->lumYInc, srcH, dstH, filterAlign, (1 << 12),
    504. (flags & SWS_BICUBLIN) ? (flags | SWS_BICUBIC) : flags,
    505. cpu_flags, srcFilter->lumV, dstFilter->lumV,
    506. c->param,
    507. get_local_pos(c, 0, 0, 1),
    508. get_local_pos(c, 0, 0, 1))) < 0)
    509. goto fail;
    510. if ((ret = initFilter(&c->vChrFilter, &c->vChrFilterPos, &c->vChrFilterSize,
    511. c->chrYInc, c->chrSrcH, c->chrDstH,
    512. filterAlign, (1 << 12),
    513. (flags & SWS_BICUBLIN) ? (flags | SWS_BILINEAR) : flags,
    514. cpu_flags, srcFilter->chrV, dstFilter->chrV,
    515. c->param,
    516. get_local_pos(c, c->chrSrcVSubSample, c->src_v_chr_pos, 1),
    517. get_local_pos(c, c->chrDstVSubSample, c->dst_v_chr_pos, 1))) < 0)
    518. goto fail;
    519. #if HAVE_ALTIVEC
    520. if (!FF_ALLOC_TYPED_ARRAY(c->vYCoeffsBank, c->vLumFilterSize * c->dstH) ||
    521. !FF_ALLOC_TYPED_ARRAY(c->vCCoeffsBank, c->vChrFilterSize * c->chrDstH))
    522. goto nomem;
    523. for (i = 0; i < c->vLumFilterSize * c->dstH; i++) {
    524. int j;
    525. short *p = (short *)&c->vYCoeffsBank[i];
    526. for (j = 0; j < 8; j++)
    527. p[j] = c->vLumFilter[i];
    528. }
    529. for (i = 0; i < c->vChrFilterSize * c->chrDstH; i++) {
    530. int j;
    531. short *p = (short *)&c->vCCoeffsBank[i];
    532. for (j = 0; j < 8; j++)
    533. p[j] = c->vChrFilter[i];
    534. }
    535. #endif
    536. }
    537. for (i = 0; i < 4; i++)
    538. if (!FF_ALLOCZ_TYPED_ARRAY(c->dither_error[i], c->dstW + 2))
    539. goto nomem;
    540. c->needAlpha = (CONFIG_SWSCALE_ALPHA && isALPHA(c->srcFormat) && isALPHA(c->dstFormat)) ? 1 : 0;
    541. // 64 / c->scalingBpp is the same as 16 / sizeof(scaling_intermediate)
    542. c->uv_off = (dst_stride>>1) + 64 / (c->dstBpc &~ 7);
    543. c->uv_offx2 = dst_stride + 16;
    544. av_assert0(c->chrDstH <= dstH);
    545. if (flags & SWS_PRINT_INFO) {
    546. const char *scaler = NULL, *cpucaps;
    547. for (i = 0; i < FF_ARRAY_ELEMS(scale_algorithms); i++) {
    548. if (flags & scale_algorithms[i].flag) {
    549. scaler = scale_algorithms[i].description;
    550. break;
    551. }
    552. }
    553. if (!scaler)
    554. scaler = "ehh flags invalid?!";
    555. av_log(c, AV_LOG_INFO, "%s scaler, from %s to %s%s ",
    556. scaler,
    557. av_get_pix_fmt_name(srcFormat),
    558. #ifdef DITHER1XBPP
    559. dstFormat == AV_PIX_FMT_BGR555 || dstFormat == AV_PIX_FMT_BGR565 ||
    560. dstFormat == AV_PIX_FMT_RGB444BE || dstFormat == AV_PIX_FMT_RGB444LE ||
    561. dstFormat == AV_PIX_FMT_BGR444BE || dstFormat == AV_PIX_FMT_BGR444LE ?
    562. "dithered " : "",
    563. #else
    564. "",
    565. #endif
    566. av_get_pix_fmt_name(dstFormat));
    567. if (INLINE_MMXEXT(cpu_flags))
    568. cpucaps = "MMXEXT";
    569. else if (INLINE_AMD3DNOW(cpu_flags))
    570. cpucaps = "3DNOW";
    571. else if (INLINE_MMX(cpu_flags))
    572. cpucaps = "MMX";
    573. else if (PPC_ALTIVEC(cpu_flags))
    574. cpucaps = "AltiVec";
    575. else
    576. cpucaps = "C";
    577. av_log(c, AV_LOG_INFO, "using %s\n", cpucaps);
    578. av_log(c, AV_LOG_VERBOSE, "%dx%d -> %dx%d\n", srcW, srcH, dstW, dstH);
    579. av_log(c, AV_LOG_DEBUG,
    580. "lum srcW=%d srcH=%d dstW=%d dstH=%d xInc=%d yInc=%d\n",
    581. c->srcW, c->srcH, c->dstW, c->dstH, c->lumXInc, c->lumYInc);
    582. av_log(c, AV_LOG_DEBUG,
    583. "chr srcW=%d srcH=%d dstW=%d dstH=%d xInc=%d yInc=%d\n",
    584. c->chrSrcW, c->chrSrcH, c->chrDstW, c->chrDstH,
    585. c->chrXInc, c->chrYInc);
    586. }
    587. /* alpha blend special case, note this has been split via cascaded contexts if its scaled */
    588. if (unscaled && !usesHFilter && !usesVFilter &&
    589. c->alphablend != SWS_ALPHA_BLEND_NONE &&
    590. isALPHA(srcFormat) &&
    591. (c->srcRange == c->dstRange || isAnyRGB(dstFormat)) &&
    592. alphaless_fmt(srcFormat) == dstFormat
    593. ) {
    594. c->convert_unscaled = ff_sws_alphablendaway;
    595. if (flags & SWS_PRINT_INFO)
    596. av_log(c, AV_LOG_INFO,
    597. "using alpha blendaway %s -> %s special converter\n",
    598. av_get_pix_fmt_name(srcFormat), av_get_pix_fmt_name(dstFormat));
    599. return 0;
    600. }
    601. /* unscaled special cases */
    602. if (unscaled && !usesHFilter && !usesVFilter &&
    603. (c->srcRange == c->dstRange || isAnyRGB(dstFormat) ||
    604. isFloat(srcFormat) || isFloat(dstFormat))){
    605. ff_get_unscaled_swscale(c);
    606. if (c->convert_unscaled) {
    607. if (flags & SWS_PRINT_INFO)
    608. av_log(c, AV_LOG_INFO,
    609. "using unscaled %s -> %s special converter\n",
    610. av_get_pix_fmt_name(srcFormat), av_get_pix_fmt_name(dstFormat));
    611. return 0;
    612. }
    613. }
    614. ff_sws_init_scale(c);
    615. return ff_init_filters(c);
    616. nomem:
    617. ret = AVERROR(ENOMEM);
    618. fail: // FIXME replace things by appropriate error codes
    619. if (ret == RETCODE_USE_CASCADE) {
    620. int tmpW = sqrt(srcW * (int64_t)dstW);
    621. int tmpH = sqrt(srcH * (int64_t)dstH);
    622. enum AVPixelFormat tmpFormat = AV_PIX_FMT_YUV420P;
    623. if (isALPHA(srcFormat))
    624. tmpFormat = AV_PIX_FMT_YUVA420P;
    625. if (srcW*(int64_t)srcH <= 4LL*dstW*dstH)
    626. return AVERROR(EINVAL);
    627. ret = av_image_alloc(c->cascaded_tmp, c->cascaded_tmpStride,
    628. tmpW, tmpH, tmpFormat, 64);
    629. if (ret < 0)
    630. return ret;
    631. c->cascaded_context[0] = sws_getContext(srcW, srcH, srcFormat,
    632. tmpW, tmpH, tmpFormat,
    633. flags, srcFilter, NULL, c->param);
    634. if (!c->cascaded_context[0])
    635. return AVERROR(ENOMEM);
    636. c->cascaded_context[1] = sws_getContext(tmpW, tmpH, tmpFormat,
    637. dstW, dstH, dstFormat,
    638. flags, NULL, dstFilter, c->param);
    639. if (!c->cascaded_context[1])
    640. return AVERROR(ENOMEM);
    641. return 0;
    642. }
    643. return ret;
    644. }
    • sws_init_context()除了对SwsContext中的各种变量进行赋值之外,主要按照顺序完成了以下一些工作:
    • 1.  通过sws_rgb2rgb_init()初始化RGB转RGB(或者YUV转YUV)的函数(注意不包含RGB与YUV相互转换的函数)。sws_rgb2rgb_init函数被ff_sws_rgb2rgb_init取代,但是二者内部的函数实现是一样的
    • 2.  通过判断输入输出图像的宽高来判断图像是否需要拉伸。如果图像需要拉伸,那么unscaled变量会被标记为1。
    • 3.  通过sws_setColorspaceDetails()初始化颜色空间。
    • 4.  一些输入参数的检测。例如:如果没有设置图像拉伸方法的话,默认设置为SWS_BICUBIC;如果输入和输出图像的宽高小于等于0的话,也会返回错误信息。
    • 5.  初始化Filter。这一步根据拉伸方法的不同,初始化不同的Filter。
    • 6.  如果flags中设置了“打印信息”选项SWS_PRINT_INFO,则输出信息。
    • 7.  如果不需要拉伸的话,调用ff_get_unscaled_swscale()将特定的像素转换函数的指针赋值给SwsContext中的swscale指针。
    • 8.  如果需要拉伸的话,调用ff_getSwsFunc()将通用的swscale()赋值给SwsContext中的swscale指针(这个地方有点绕,但是确实是这样的)。没有找到对应的代码进行论证  ff_getSwsFunc函数已被弃用

    下面分别记录一下上述步骤的实现。

     1.初始化RGB转RGB(或者YUV转YUV)的函数。注意这部分函数不包含RGB与YUV相互转换的函数。

    ff_sws_rgb2rgb_init()

    • ff_sws_rgb2rgb_init()的定义位于libswscale\rgb2rgb.c,如下所示。
    1. /*
    2. * RGB15->RGB16 original by Strepto/Astral
    3. * ported to gcc & bugfixed : A'rpi
    4. * MMXEXT, 3DNOW optimization by Nick Kurshev
    5. * 32-bit C version, and and&add trick by Michael Niedermayer
    6. */
    7. av_cold void ff_sws_rgb2rgb_init(void)
    8. {
    9. rgb2rgb_init_c();
    10. if (ARCH_AARCH64)
    11. rgb2rgb_init_aarch64();
    12. if (ARCH_X86)
    13. rgb2rgb_init_x86();
    14. }
    • 从ff_sws_rgb2rgb_init()代码中可以看出,有两个初始化函数:
    • rgb2rgb_init_c()是初始化C语言版本的RGB互转(或者YUV互转)的函数,
    • rgb2rgb_init_x86()则是初始化X86汇编版本的RGB互转的函数。
    • PS:在libswscale中有一点需要注意:很多的函数名称中包含类似“_c”这样的字符串,代表了该函数是C语言写的。与之对应的还有其它标记,比如“_mmx”,“sse2”等。

    rgb2rgb_init_c()

    • 首先来看一下C语言版本的RGB互转函数的初始化函数rgb2rgb_init_c(),
    • 定义位于libswscale\rgb2rgb_template.c,如下所示。 
    1. static av_cold void rgb2rgb_init_c(void)
    2. {
    3. rgb15to16 = rgb15to16_c;
    4. rgb15tobgr24 = rgb15tobgr24_c;
    5. rgb15to32 = rgb15to32_c;
    6. rgb16tobgr24 = rgb16tobgr24_c;
    7. rgb16to32 = rgb16to32_c;
    8. rgb16to15 = rgb16to15_c;
    9. rgb24tobgr16 = rgb24tobgr16_c;
    10. rgb24tobgr15 = rgb24tobgr15_c;
    11. rgb24tobgr32 = rgb24tobgr32_c;
    12. rgb32to16 = rgb32to16_c;
    13. rgb32to15 = rgb32to15_c;
    14. rgb32tobgr24 = rgb32tobgr24_c;
    15. rgb24to15 = rgb24to15_c;
    16. rgb24to16 = rgb24to16_c;
    17. rgb24tobgr24 = rgb24tobgr24_c;
    18. #if HAVE_BIGENDIAN
    19. shuffle_bytes_0321 = shuffle_bytes_2103_c;
    20. shuffle_bytes_2103 = shuffle_bytes_0321_c;
    21. #else
    22. shuffle_bytes_0321 = shuffle_bytes_0321_c;
    23. shuffle_bytes_2103 = shuffle_bytes_2103_c;
    24. #endif
    25. shuffle_bytes_1230 = shuffle_bytes_1230_c;
    26. shuffle_bytes_3012 = shuffle_bytes_3012_c;
    27. shuffle_bytes_3210 = shuffle_bytes_3210_c;
    28. rgb32tobgr16 = rgb32tobgr16_c;
    29. rgb32tobgr15 = rgb32tobgr15_c;
    30. yv12toyuy2 = yv12toyuy2_c;
    31. yv12touyvy = yv12touyvy_c;
    32. yuv422ptoyuy2 = yuv422ptoyuy2_c;
    33. yuv422ptouyvy = yuv422ptouyvy_c;
    34. yuy2toyv12 = yuy2toyv12_c;
    35. planar2x = planar2x_c;
    36. ff_rgb24toyv12 = ff_rgb24toyv12_c;
    37. interleaveBytes = interleaveBytes_c;
    38. deinterleaveBytes = deinterleaveBytes_c;
    39. vu9_to_vu12 = vu9_to_vu12_c;
    40. yvu9_to_yuy2 = yvu9_to_yuy2_c;
    41. uyvytoyuv420 = uyvytoyuv420_c;
    42. uyvytoyuv422 = uyvytoyuv422_c;
    43. yuyvtoyuv420 = yuyvtoyuv420_c;
    44. yuyvtoyuv422 = yuyvtoyuv422_c;
    45. }
    • 可以看出rgb2rgb_init_c()执行后,会把C语言版本的图像格式转换函数赋值给系统的函数指针。
    • 下面我们选择几个函数看一下这些转换函数的定义。

    rgb24tobgr24_c

    • rgb24tobgr24_c()完成了RGB24向BGR24格式的转换。函数的定义如下所示。从代码中可以看出,该函数实现了“R”与“B”之间位置的对调,从而完成了这两种格式之间的转换。
    1. static inline void rgb24tobgr24_c(const uint8_t *src, uint8_t *dst, int src_size)
    2. {
    3. unsigned i;
    4. for (i = 0; i < src_size; i += 3) {
    5. register uint8_t x = src[i + 2];
    6. dst[i + 1] = src[i + 1];
    7. dst[i + 2] = src[i + 0];
    8. dst[i + 0] = x;
    9. }
    10. }

    rgb24to16_c()

    • rgb24to16_c()完成了RGB24向RGB16像素格式的转换。
    • 函数的定义如下所示。 
    1. static inline void rgb24to16_c(const uint8_t *src, uint8_t *dst, int src_size)
    2. {
    3. uint16_t *d = (uint16_t *)dst;
    4. const uint8_t *s = src;
    5. const uint8_t *end = s + src_size;
    6. while (s < end) {
    7. const int r = *s++;
    8. const int g = *s++;
    9. const int b = *s++;
    10. *d++ = (b >> 3) | ((g & 0xFC) << 3) | ((r & 0xF8) << 8);
    11. }
    12. }

    yuyvtoyuv422_c()

    • yuyvtoyuv422_c()完成了YUYV向YUV422像素格式的转换。函数的定义如下所示。
    1. static void yuyvtoyuv422_c(uint8_t *ydst, uint8_t *udst, uint8_t *vdst,
    2. const uint8_t *src, int width, int height,
    3. int lumStride, int chromStride, int srcStride)
    4. {
    5. int y;
    6. const int chromWidth = AV_CEIL_RSHIFT(width, 1);
    7. for (y = 0; y < height; y++) {
    8. extract_even_c(src, ydst, width);
    9. extract_odd2_c(src, udst, vdst, chromWidth);
    10. src += srcStride;
    11. ydst += lumStride;
    12. udst += chromStride;
    13. vdst += chromStride;
    14. }
    15. }
    •  该函数将YUYV像素数据分离成为Y,U,V三个分量的像素数据。
    • 其中extract_even_c()用于获取一行像素中序数为偶数的像素,对应提取了YUYV像素格式中的“Y”。
    • extract_odd2_c()用于获取一行像素中序数为奇数的像素,并且把这些像素值再次按照奇偶的不同,存储于两个数组中。
    • 对应提取了YUYV像素格式中的“U”和“V”。
    • extract_even_c()定义如下所示。
    1. static void extract_even_c(const uint8_t *src, uint8_t *dst, int count)
    2. {
    3. dst += count;
    4. src += count * 2;
    5. count = -count;
    6. while (count < 0) {
    7. dst[count] = src[2 * count];
    8. count++;
    9. }
    10. }
    • extract_odd2_c()定义如下所示。
    1. static void extract_odd2_c(const uint8_t *src, uint8_t *dst0, uint8_t *dst1,
    2. int count)
    3. {
    4. dst0 += count;
    5. dst1 += count;
    6. src += count * 4;
    7. count = -count;
    8. src++;
    9. while (count < 0) {
    10. dst0[count] = src[4 * count + 0];
    11. dst1[count] = src[4 * count + 2];
    12. count++;
    13. }
    14. }

    rgb2rgb_init_x86

    • rgb2rgb_init_x86()用于初始化基于X86汇编语言的RGB互转的代码。由于对汇编不是很熟,不再作详细分析,出于和rgb2rgb_init_c()相对比的目的,列出它的代码。
    • 它的代码位于libswscale\x86\rgb2rgb.c,如下所示。
    • PS:所有和汇编有关的代码都位于libswscale目录的x86子目录下。
    1. av_cold void rgb2rgb_init_x86(void)
    2. {
    3. int cpu_flags = av_get_cpu_flags();
    4. #if HAVE_INLINE_ASM
    5. if (INLINE_MMX(cpu_flags))
    6. rgb2rgb_init_mmx();
    7. if (INLINE_AMD3DNOW(cpu_flags))
    8. rgb2rgb_init_3dnow();
    9. if (INLINE_MMXEXT(cpu_flags))
    10. rgb2rgb_init_mmxext();
    11. if (INLINE_SSE2(cpu_flags))
    12. rgb2rgb_init_sse2();
    13. if (INLINE_AVX(cpu_flags))
    14. rgb2rgb_init_avx();
    15. #endif /* HAVE_INLINE_ASM */
    16. if (EXTERNAL_MMXEXT(cpu_flags)) {
    17. shuffle_bytes_2103 = ff_shuffle_bytes_2103_mmxext;
    18. }
    19. if (EXTERNAL_SSE2(cpu_flags)) {
    20. #if ARCH_X86_64
    21. uyvytoyuv422 = ff_uyvytoyuv422_sse2;
    22. #endif
    23. }
    24. if (EXTERNAL_SSSE3(cpu_flags)) {
    25. shuffle_bytes_0321 = ff_shuffle_bytes_0321_ssse3;
    26. shuffle_bytes_2103 = ff_shuffle_bytes_2103_ssse3;
    27. shuffle_bytes_1230 = ff_shuffle_bytes_1230_ssse3;
    28. shuffle_bytes_3012 = ff_shuffle_bytes_3012_ssse3;
    29. shuffle_bytes_3210 = ff_shuffle_bytes_3210_ssse3;
    30. }
    31. #if ARCH_X86_64
    32. if (EXTERNAL_AVX2_FAST(cpu_flags)) {
    33. shuffle_bytes_0321 = ff_shuffle_bytes_0321_avx2;
    34. shuffle_bytes_2103 = ff_shuffle_bytes_2103_avx2;
    35. shuffle_bytes_1230 = ff_shuffle_bytes_1230_avx2;
    36. shuffle_bytes_3012 = ff_shuffle_bytes_3012_avx2;
    37. shuffle_bytes_3210 = ff_shuffle_bytes_3210_avx2;
    38. }
    39. if (EXTERNAL_AVX(cpu_flags)) {
    40. uyvytoyuv422 = ff_uyvytoyuv422_avx;
    41. }
    42. #endif
    43. }
    •  可以看出,rgb2rgb_init_x86()首先调用了av_get_cpu_flags()获取CPU支持的特性,根据特性调用rgb2rgb_init_mmx(),rgb2rgb_init_3dnow(),rgb2rgb_init_mmxext(),rgb2rgb_init_sse2(),rgb2rgb_init_avx()等函数。

    2.判断图像是否需要拉伸

    •  这一步主要通过比较输入图像和输出图像的宽高实现。
    • 系统使用一个unscaled变量记录图像是否需要拉伸,如下所示。
    • unscaled = (srcW == dstW && srcH == dstH);

    3.初始化颜色空间。

    • 初始化颜色空间通过函数sws_setColorspaceDetails()完成。
    • sws_setColorspaceDetails()是FFmpeg的一个API函数,它的声明如下所示:
    1. /**
    2. * @param dstRange flag indicating the while-black range of the output (1=jpeg / 0=mpeg)
    3. * @param srcRange flag indicating the while-black range of the input (1=jpeg / 0=mpeg)
    4. * @param table the yuv2rgb coefficients describing the output yuv space, normally ff_yuv2rgb_coeffs[x]
    5. * @param inv_table the yuv2rgb coefficients describing the input yuv space, normally ff_yuv2rgb_coeffs[x]
    6. * @param brightness 16.16 fixed point brightness correction
    7. * @param contrast 16.16 fixed point contrast correction
    8. * @param saturation 16.16 fixed point saturation correction
    9. #if LIBSWSCALE_VERSION_MAJOR > 6
    10. * @return negative error code on error, non negative otherwise
    11. #else
    12. * @return -1 if not supported
    13. #endif
    14. */
    15. int sws_setColorspaceDetails(struct SwsContext *c, const int inv_table[4],
    16. int srcRange, const int table[4], int dstRange,
    17. int brightness, int contrast, int saturation);
    • 简单解释一下几个参数的含义:
      • c:需要设定的SwsContext。
      • inv_table:描述输出YUV颜色空间的参数表。
      • srcRange:输入图像的取值范围(“1”代表JPEG标准,取值范围是0-255;“0”代表MPEG标准,取值范围是16-235)。
      • table:描述输入YUV颜色空间的参数表。
      • dstRange:输出图像的取值范围。
      • brightness:未研究。
      • contrast:未研究。
      • saturation:未研究。
    • 如果返回-1代表设置不成功。
    • 其中描述颜色空间的参数表可以通过sws_getCoefficients()获取。
    • 该函数在后文中再详细记录。
    • sws_setColorspaceDetails()的定义位于libswscale\utils.c,如下所示。
    1. int sws_setColorspaceDetails(struct SwsContext *c, const int inv_table[4],
    2. int srcRange, const int table[4], int dstRange,
    3. int brightness, int contrast, int saturation)
    4. {
    5. const AVPixFmtDescriptor *desc_dst;
    6. const AVPixFmtDescriptor *desc_src;
    7. int need_reinit = 0;
    8. if (c->nb_slice_ctx) {
    9. int parent_ret = 0;
    10. for (int i = 0; i < c->nb_slice_ctx; i++) {
    11. int ret = sws_setColorspaceDetails(c->slice_ctx[i], inv_table,
    12. srcRange, table, dstRange,
    13. brightness, contrast, saturation);
    14. if (ret < 0)
    15. parent_ret = ret;
    16. }
    17. return parent_ret;
    18. }
    19. handle_formats(c);
    20. desc_dst = av_pix_fmt_desc_get(c->dstFormat);
    21. desc_src = av_pix_fmt_desc_get(c->srcFormat);
    22. if(range_override_needed(c->dstFormat))
    23. dstRange = 0;
    24. if(range_override_needed(c->srcFormat))
    25. srcRange = 0;
    26. if (c->srcRange != srcRange ||
    27. c->dstRange != dstRange ||
    28. c->brightness != brightness ||
    29. c->contrast != contrast ||
    30. c->saturation != saturation ||
    31. memcmp(c->srcColorspaceTable, inv_table, sizeof(int) * 4) ||
    32. memcmp(c->dstColorspaceTable, table, sizeof(int) * 4)
    33. )
    34. need_reinit = 1;
    35. memmove(c->srcColorspaceTable, inv_table, sizeof(int) * 4);
    36. memmove(c->dstColorspaceTable, table, sizeof(int) * 4);
    37. c->brightness = brightness;
    38. c->contrast = contrast;
    39. c->saturation = saturation;
    40. c->srcRange = srcRange;
    41. c->dstRange = dstRange;
    42. //The srcBpc check is possibly wrong but we seem to lack a definitive reference to test this
    43. //and what we have in ticket 2939 looks better with this check
    44. if (need_reinit && (c->srcBpc == 8 || !isYUV(c->srcFormat)))
    45. ff_sws_init_range_convert(c);
    46. c->dstFormatBpp = av_get_bits_per_pixel(desc_dst);
    47. c->srcFormatBpp = av_get_bits_per_pixel(desc_src);
    48. if (c->cascaded_context[c->cascaded_mainindex])
    49. return sws_setColorspaceDetails(c->cascaded_context[c->cascaded_mainindex],inv_table, srcRange,table, dstRange, brightness, contrast, saturation);
    50. if (!need_reinit)
    51. return 0;
    52. if ((isYUV(c->dstFormat) || isGray(c->dstFormat)) && (isYUV(c->srcFormat) || isGray(c->srcFormat))) {
    53. if (!c->cascaded_context[0] &&
    54. memcmp(c->dstColorspaceTable, c->srcColorspaceTable, sizeof(int) * 4) &&
    55. c->srcW && c->srcH && c->dstW && c->dstH) {
    56. enum AVPixelFormat tmp_format;
    57. int tmp_width, tmp_height;
    58. int srcW = c->srcW;
    59. int srcH = c->srcH;
    60. int dstW = c->dstW;
    61. int dstH = c->dstH;
    62. int ret;
    63. av_log(c, AV_LOG_VERBOSE, "YUV color matrix differs for YUV->YUV, using intermediate RGB to convert\n");
    64. if (isNBPS(c->dstFormat) || is16BPS(c->dstFormat)) {
    65. if (isALPHA(c->srcFormat) && isALPHA(c->dstFormat)) {
    66. tmp_format = AV_PIX_FMT_BGRA64;
    67. } else {
    68. tmp_format = AV_PIX_FMT_BGR48;
    69. }
    70. } else {
    71. if (isALPHA(c->srcFormat) && isALPHA(c->dstFormat)) {
    72. tmp_format = AV_PIX_FMT_BGRA;
    73. } else {
    74. tmp_format = AV_PIX_FMT_BGR24;
    75. }
    76. }
    77. if (srcW*srcH > dstW*dstH) {
    78. tmp_width = dstW;
    79. tmp_height = dstH;
    80. } else {
    81. tmp_width = srcW;
    82. tmp_height = srcH;
    83. }
    84. ret = av_image_alloc(c->cascaded_tmp, c->cascaded_tmpStride,
    85. tmp_width, tmp_height, tmp_format, 64);
    86. if (ret < 0)
    87. return ret;
    88. c->cascaded_context[0] = sws_alloc_set_opts(srcW, srcH, c->srcFormat,
    89. tmp_width, tmp_height, tmp_format,
    90. c->flags, c->param);
    91. if (!c->cascaded_context[0])
    92. return -1;
    93. c->cascaded_context[0]->alphablend = c->alphablend;
    94. ret = sws_init_context(c->cascaded_context[0], NULL , NULL);
    95. if (ret < 0)
    96. return ret;
    97. //we set both src and dst depending on that the RGB side will be ignored
    98. sws_setColorspaceDetails(c->cascaded_context[0], inv_table,
    99. srcRange, table, dstRange,
    100. brightness, contrast, saturation);
    101. c->cascaded_context[1] = sws_alloc_set_opts(tmp_width, tmp_height, tmp_format,
    102. dstW, dstH, c->dstFormat,
    103. c->flags, c->param);
    104. if (!c->cascaded_context[1])
    105. return -1;
    106. c->cascaded_context[1]->srcRange = srcRange;
    107. c->cascaded_context[1]->dstRange = dstRange;
    108. ret = sws_init_context(c->cascaded_context[1], NULL , NULL);
    109. if (ret < 0)
    110. return ret;
    111. sws_setColorspaceDetails(c->cascaded_context[1], inv_table,
    112. srcRange, table, dstRange,
    113. 0, 1 << 16, 1 << 16);
    114. return 0;
    115. }
    116. //We do not support this combination currently, we need to cascade more contexts to compensate
    117. if (c->cascaded_context[0] && memcmp(c->dstColorspaceTable, c->srcColorspaceTable, sizeof(int) * 4))
    118. return -1; //AVERROR_PATCHWELCOME;
    119. return 0;
    120. }
    121. if (!isYUV(c->dstFormat) && !isGray(c->dstFormat)) {
    122. ff_yuv2rgb_c_init_tables(c, inv_table, srcRange, brightness,
    123. contrast, saturation);
    124. // FIXME factorize
    125. if (ARCH_PPC)
    126. ff_yuv2rgb_init_tables_ppc(c, inv_table, brightness,
    127. contrast, saturation);
    128. }
    129. fill_rgb2yuv_table(c, table, dstRange);
    130. return 0;
    131. }
    • 从sws_setColorspaceDetails()定义中可以看出,该函数将输入的参数分别赋值给了相应的变量,并且在最后调用了一个函数fill_rgb2yuv_table()。
    • fill_rgb2yuv_table()函数还没有弄懂,暂时不记录。

    sws_getCoefficients()

    • sws_getCoefficients()用于获取描述颜色空间的参数表。
    • 它的声明如下
    1. /**
    2. * Return a pointer to yuv<->rgb coefficients for the given colorspace
    3. * suitable for sws_setColorspaceDetails().
    4. *
    5. * @param colorspace One of the SWS_CS_* macros. If invalid,
    6. * SWS_CS_DEFAULT is used.
    7. */
    8. const int *sws_getCoefficients(int colorspace);
    • 其中colorspace可以取值如下变量。
    • 默认的取值SWS_CS_DEFAULT等同于SWS_CS_ITU601或者SWS_CS_SMPTE170M。
    1. #define SWS_CS_ITU709 1
    2. #define SWS_CS_FCC 4
    3. #define SWS_CS_ITU601 5
    4. #define SWS_CS_ITU624 5
    5. #define SWS_CS_SMPTE170M 5
    6. #define SWS_CS_SMPTE240M 7
    7. #define SWS_CS_DEFAULT 5
    8. #define SWS_CS_BT2020 9
    • 下面看一下sws_getCoefficients()的定义,位于libswscale\yuv2rgb.c,如下所示。 
    1. const int *sws_getCoefficients(int colorspace)
    2. {
    3. if (colorspace > 10 || colorspace < 0 || colorspace == 8)
    4. colorspace = SWS_CS_DEFAULT;
    5. return ff_yuv2rgb_coeffs[colorspace];
    6. }
    • 可以看出它返回了一个名称为ff_yuv2rgb_coeffs的数组中的一个元素,该数组的定义如下所示。
    1. /* Color space conversion coefficients for YCbCr -> RGB mapping.
    2. *
    3. * Entries are {crv, cbu, cgu, cgv}
    4. *
    5. * crv = (255 / 224) * 65536 * (1 - cr) / 0.5
    6. * cbu = (255 / 224) * 65536 * (1 - cb) / 0.5
    7. * cgu = (255 / 224) * 65536 * (cb / cg) * (1 - cb) / 0.5
    8. * cgv = (255 / 224) * 65536 * (cr / cg) * (1 - cr) / 0.5
    9. *
    10. * where Y = cr * R + cg * G + cb * B and cr + cg + cb = 1.
    11. */
    12. const int32_t ff_yuv2rgb_coeffs[11][4] = {
    13. { 117489, 138438, 13975, 34925 }, /* no sequence_display_extension */
    14. { 117489, 138438, 13975, 34925 }, /* ITU-R Rec. 709 (1990) */
    15. { 104597, 132201, 25675, 53279 }, /* unspecified */
    16. { 104597, 132201, 25675, 53279 }, /* reserved */
    17. { 104448, 132798, 24759, 53109 }, /* FCC */
    18. { 104597, 132201, 25675, 53279 }, /* ITU-R Rec. 624-4 System B, G */
    19. { 104597, 132201, 25675, 53279 }, /* SMPTE 170M */
    20. { 117579, 136230, 16907, 35559 }, /* SMPTE 240M (1987) */
    21. { 0 }, /* YCgCo */
    22. { 110013, 140363, 12277, 42626 }, /* Bt-2020-NCL */
    23. { 110013, 140363, 12277, 42626 }, /* Bt-2020-CL */
    24. };

     4.一些输入参数的检测。

    • 例如:如果没有设置图像拉伸方法的话,默认设置为SWS_BICUBIC;
    • 如果输入和输出图像的宽高小于等于0的话,也会返回错误信息。
    • 有关这方面的代码比较多,简单举个例子。
    1. i = flags & (SWS_POINT |
    2. SWS_AREA |
    3. SWS_BILINEAR |
    4. SWS_FAST_BILINEAR |
    5. SWS_BICUBIC |
    6. SWS_X |
    7. SWS_GAUSS |
    8. SWS_LANCZOS |
    9. SWS_SINC |
    10. SWS_SPLINE |
    11. SWS_BICUBLIN);
    12. /* provide a default scaler if not set by caller */
    13. if (!i) {
    14. if (dstW < srcW && dstH < srcH)
    15. flags |= SWS_BICUBIC;
    16. else if (dstW > srcW && dstH > srcH)
    17. flags |= SWS_BICUBIC;
    18. else
    19. flags |= SWS_BICUBIC;
    20. c->flags = flags;
    21. } else if (i & (i - 1)) {
    22. av_log(c, AV_LOG_ERROR,
    23. "Exactly one scaler algorithm must be chosen, got %X\n", i);
    24. return AVERROR(EINVAL);
    25. }
    26. /* sanity check */
    27. if (srcW < 1 || srcH < 1 || dstW < 1 || dstH < 1) {
    28. /* FIXME check if these are enough and try to lower them after
    29. * fixing the relevant parts of the code */
    30. av_log(c, AV_LOG_ERROR, "%dx%d -> %dx%d is invalid scaling dimension\n",
    31. srcW, srcH, dstW, dstH);
    32. return AVERROR(EINVAL);
    33. }

    5.初始化Filter。这一步根据拉伸方法的不同,初始化不同的Filter。

    • 这一部分的工作在函数initFilter()中完成,暂时不详细分析。

    6.如果flags中设置了“打印信息”选项SWS_PRINT_INFO,则输出信息。

    • SwsContext初始化的时候,可以给flags设置SWS_PRINT_INFO标记。
    • 这样SwsContext初始化完成的时候就可以打印出一些配置信息。
    • 与打印相关的代码如下所示。
    1. if (flags & SWS_PRINT_INFO) {
    2. const char *scaler = NULL, *cpucaps;
    3. for (i = 0; i < FF_ARRAY_ELEMS(scale_algorithms); i++) {
    4. if (flags & scale_algorithms[i].flag) {
    5. scaler = scale_algorithms[i].description;
    6. break;
    7. }
    8. }
    9. if (!scaler)
    10. scaler = "ehh flags invalid?!";
    11. av_log(c, AV_LOG_INFO, "%s scaler, from %s to %s%s ",
    12. scaler,
    13. av_get_pix_fmt_name(srcFormat),
    14. #ifdef DITHER1XBPP
    15. dstFormat == AV_PIX_FMT_BGR555 || dstFormat == AV_PIX_FMT_BGR565 ||
    16. dstFormat == AV_PIX_FMT_RGB444BE || dstFormat == AV_PIX_FMT_RGB444LE ||
    17. dstFormat == AV_PIX_FMT_BGR444BE || dstFormat == AV_PIX_FMT_BGR444LE ?
    18. "dithered " : "",
    19. #else
    20. "",
    21. #endif
    22. av_get_pix_fmt_name(dstFormat));
    23. if (INLINE_MMXEXT(cpu_flags))
    24. cpucaps = "MMXEXT";
    25. else if (INLINE_AMD3DNOW(cpu_flags))
    26. cpucaps = "3DNOW";
    27. else if (INLINE_MMX(cpu_flags))
    28. cpucaps = "MMX";
    29. else if (PPC_ALTIVEC(cpu_flags))
    30. cpucaps = "AltiVec";
    31. else
    32. cpucaps = "C";
    33. av_log(c, AV_LOG_INFO, "using %s\n", cpucaps);
    34. av_log(c, AV_LOG_VERBOSE, "%dx%d -> %dx%d\n", srcW, srcH, dstW, dstH);
    35. av_log(c, AV_LOG_DEBUG,
    36. "lum srcW=%d srcH=%d dstW=%d dstH=%d xInc=%d yInc=%d\n",
    37. c->srcW, c->srcH, c->dstW, c->dstH, c->lumXInc, c->lumYInc);
    38. av_log(c, AV_LOG_DEBUG,
    39. "chr srcW=%d srcH=%d dstW=%d dstH=%d xInc=%d yInc=%d\n",
    40. c->chrSrcW, c->chrSrcH, c->chrDstW, c->chrDstH,
    41. c->chrXInc, c->chrYInc);
    42. }

     7.如果不需要拉伸的话,就会调用ff_get_unscaled_swscale()将特定的像素转换函数的指针赋值给SwsContext中的swscale指针。
    ff_get_unscaled_swscale()

    • ff_get_unscaled_swscale()的定义如下所示。
    • 该函数根据输入图像像素格式和输出图像像素格式,选择不同的像素格式转换函数。
    1. void ff_get_unscaled_swscale(SwsContext *c)
    2. {
    3. const enum AVPixelFormat srcFormat = c->srcFormat;
    4. const enum AVPixelFormat dstFormat = c->dstFormat;
    5. const int flags = c->flags;
    6. const int dstH = c->dstH;
    7. const int dstW = c->dstW;
    8. int needsDither;
    9. needsDither = isAnyRGB(dstFormat) &&
    10. c->dstFormatBpp < 24 &&
    11. (c->dstFormatBpp < c->srcFormatBpp || (!isAnyRGB(srcFormat)));
    12. /* yv12_to_nv12 */
    13. if ((srcFormat == AV_PIX_FMT_YUV420P || srcFormat == AV_PIX_FMT_YUVA420P) &&
    14. (dstFormat == AV_PIX_FMT_NV12 || dstFormat == AV_PIX_FMT_NV21)) {
    15. c->convert_unscaled = planarToNv12Wrapper;
    16. }
    17. /* yv24_to_nv24 */
    18. if ((srcFormat == AV_PIX_FMT_YUV444P || srcFormat == AV_PIX_FMT_YUVA444P) &&
    19. (dstFormat == AV_PIX_FMT_NV24 || dstFormat == AV_PIX_FMT_NV42)) {
    20. c->convert_unscaled = planarToNv24Wrapper;
    21. }
    22. /* nv12_to_yv12 */
    23. if (dstFormat == AV_PIX_FMT_YUV420P &&
    24. (srcFormat == AV_PIX_FMT_NV12 || srcFormat == AV_PIX_FMT_NV21)) {
    25. c->convert_unscaled = nv12ToPlanarWrapper;
    26. }
    27. /* nv24_to_yv24 */
    28. if (dstFormat == AV_PIX_FMT_YUV444P &&
    29. (srcFormat == AV_PIX_FMT_NV24 || srcFormat == AV_PIX_FMT_NV42)) {
    30. c->convert_unscaled = nv24ToPlanarWrapper;
    31. }
    32. /* yuv2bgr */
    33. if ((srcFormat == AV_PIX_FMT_YUV420P || srcFormat == AV_PIX_FMT_YUV422P ||
    34. srcFormat == AV_PIX_FMT_YUVA420P) && isAnyRGB(dstFormat) &&
    35. !(flags & SWS_ACCURATE_RND) && (c->dither == SWS_DITHER_BAYER || c->dither == SWS_DITHER_AUTO) && !(dstH & 1)) {
    36. c->convert_unscaled = ff_yuv2rgb_get_func_ptr(c);
    37. c->dst_slice_align = 2;
    38. }
    39. /* yuv420p1x_to_p01x */
    40. if ((srcFormat == AV_PIX_FMT_YUV420P10 || srcFormat == AV_PIX_FMT_YUVA420P10 ||
    41. srcFormat == AV_PIX_FMT_YUV420P12 ||
    42. srcFormat == AV_PIX_FMT_YUV420P14 ||
    43. srcFormat == AV_PIX_FMT_YUV420P16 || srcFormat == AV_PIX_FMT_YUVA420P16) &&
    44. (dstFormat == AV_PIX_FMT_P010 || dstFormat == AV_PIX_FMT_P016)) {
    45. c->convert_unscaled = planarToP01xWrapper;
    46. }
    47. /* yuv420p_to_p01xle */
    48. if ((srcFormat == AV_PIX_FMT_YUV420P || srcFormat == AV_PIX_FMT_YUVA420P) &&
    49. (dstFormat == AV_PIX_FMT_P010LE || dstFormat == AV_PIX_FMT_P016LE)) {
    50. c->convert_unscaled = planar8ToP01xleWrapper;
    51. }
    52. if (srcFormat == AV_PIX_FMT_YUV410P && !(dstH & 3) &&
    53. (dstFormat == AV_PIX_FMT_YUV420P || dstFormat == AV_PIX_FMT_YUVA420P) &&
    54. !(flags & SWS_BITEXACT)) {
    55. c->convert_unscaled = yvu9ToYv12Wrapper;
    56. c->dst_slice_align = 4;
    57. }
    58. /* bgr24toYV12 */
    59. if (srcFormat == AV_PIX_FMT_BGR24 &&
    60. (dstFormat == AV_PIX_FMT_YUV420P || dstFormat == AV_PIX_FMT_YUVA420P) &&
    61. !(flags & SWS_ACCURATE_RND) && !(dstW&1))
    62. c->convert_unscaled = bgr24ToYv12Wrapper;
    63. /* RGB/BGR -> RGB/BGR (no dither needed forms) */
    64. if (isAnyRGB(srcFormat) && isAnyRGB(dstFormat) && findRgbConvFn(c)
    65. && (!needsDither || (c->flags&(SWS_FAST_BILINEAR|SWS_POINT))))
    66. c->convert_unscaled = rgbToRgbWrapper;
    67. /* RGB to planar RGB */
    68. if ((srcFormat == AV_PIX_FMT_GBRP && dstFormat == AV_PIX_FMT_GBRAP) ||
    69. (srcFormat == AV_PIX_FMT_GBRAP && dstFormat == AV_PIX_FMT_GBRP))
    70. c->convert_unscaled = planarRgbToplanarRgbWrapper;
    71. #define isByteRGB(f) ( \
    72. f == AV_PIX_FMT_RGB32 || \
    73. f == AV_PIX_FMT_RGB32_1 || \
    74. f == AV_PIX_FMT_RGB24 || \
    75. f == AV_PIX_FMT_BGR32 || \
    76. f == AV_PIX_FMT_BGR32_1 || \
    77. f == AV_PIX_FMT_BGR24)
    78. if (srcFormat == AV_PIX_FMT_GBRP && isPlanar(srcFormat) && isByteRGB(dstFormat))
    79. c->convert_unscaled = planarRgbToRgbWrapper;
    80. if (srcFormat == AV_PIX_FMT_GBRAP && isByteRGB(dstFormat))
    81. c->convert_unscaled = planarRgbaToRgbWrapper;
    82. if ((srcFormat == AV_PIX_FMT_RGB48LE || srcFormat == AV_PIX_FMT_RGB48BE ||
    83. srcFormat == AV_PIX_FMT_BGR48LE || srcFormat == AV_PIX_FMT_BGR48BE ||
    84. srcFormat == AV_PIX_FMT_RGBA64LE || srcFormat == AV_PIX_FMT_RGBA64BE ||
    85. srcFormat == AV_PIX_FMT_BGRA64LE || srcFormat == AV_PIX_FMT_BGRA64BE) &&
    86. (dstFormat == AV_PIX_FMT_GBRP9LE || dstFormat == AV_PIX_FMT_GBRP9BE ||
    87. dstFormat == AV_PIX_FMT_GBRP10LE || dstFormat == AV_PIX_FMT_GBRP10BE ||
    88. dstFormat == AV_PIX_FMT_GBRP12LE || dstFormat == AV_PIX_FMT_GBRP12BE ||
    89. dstFormat == AV_PIX_FMT_GBRP14LE || dstFormat == AV_PIX_FMT_GBRP14BE ||
    90. dstFormat == AV_PIX_FMT_GBRP16LE || dstFormat == AV_PIX_FMT_GBRP16BE ||
    91. dstFormat == AV_PIX_FMT_GBRAP10LE || dstFormat == AV_PIX_FMT_GBRAP10BE ||
    92. dstFormat == AV_PIX_FMT_GBRAP12LE || dstFormat == AV_PIX_FMT_GBRAP12BE ||
    93. dstFormat == AV_PIX_FMT_GBRAP16LE || dstFormat == AV_PIX_FMT_GBRAP16BE ))
    94. c->convert_unscaled = Rgb16ToPlanarRgb16Wrapper;
    95. if ((srcFormat == AV_PIX_FMT_GBRP9LE || srcFormat == AV_PIX_FMT_GBRP9BE ||
    96. srcFormat == AV_PIX_FMT_GBRP16LE || srcFormat == AV_PIX_FMT_GBRP16BE ||
    97. srcFormat == AV_PIX_FMT_GBRP10LE || srcFormat == AV_PIX_FMT_GBRP10BE ||
    98. srcFormat == AV_PIX_FMT_GBRP12LE || srcFormat == AV_PIX_FMT_GBRP12BE ||
    99. srcFormat == AV_PIX_FMT_GBRP14LE || srcFormat == AV_PIX_FMT_GBRP14BE ||
    100. srcFormat == AV_PIX_FMT_GBRAP10LE || srcFormat == AV_PIX_FMT_GBRAP10BE ||
    101. srcFormat == AV_PIX_FMT_GBRAP12LE || srcFormat == AV_PIX_FMT_GBRAP12BE ||
    102. srcFormat == AV_PIX_FMT_GBRAP16LE || srcFormat == AV_PIX_FMT_GBRAP16BE) &&
    103. (dstFormat == AV_PIX_FMT_RGB48LE || dstFormat == AV_PIX_FMT_RGB48BE ||
    104. dstFormat == AV_PIX_FMT_BGR48LE || dstFormat == AV_PIX_FMT_BGR48BE ||
    105. dstFormat == AV_PIX_FMT_RGBA64LE || dstFormat == AV_PIX_FMT_RGBA64BE ||
    106. dstFormat == AV_PIX_FMT_BGRA64LE || dstFormat == AV_PIX_FMT_BGRA64BE))
    107. c->convert_unscaled = planarRgb16ToRgb16Wrapper;
    108. if (av_pix_fmt_desc_get(srcFormat)->comp[0].depth == 8 &&
    109. isPackedRGB(srcFormat) && dstFormat == AV_PIX_FMT_GBRP)
    110. c->convert_unscaled = rgbToPlanarRgbWrapper;
    111. if (isBayer(srcFormat)) {
    112. if (dstFormat == AV_PIX_FMT_RGB24)
    113. c->convert_unscaled = bayer_to_rgb24_wrapper;
    114. else if (dstFormat == AV_PIX_FMT_RGB48)
    115. c->convert_unscaled = bayer_to_rgb48_wrapper;
    116. else if (dstFormat == AV_PIX_FMT_YUV420P)
    117. c->convert_unscaled = bayer_to_yv12_wrapper;
    118. else if (!isBayer(dstFormat)) {
    119. av_log(c, AV_LOG_ERROR, "unsupported bayer conversion\n");
    120. av_assert0(0);
    121. }
    122. }
    123. /* bswap 16 bits per pixel/component packed formats */
    124. if (IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_BAYER_BGGR16) ||
    125. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_BAYER_RGGB16) ||
    126. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_BAYER_GBRG16) ||
    127. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_BAYER_GRBG16) ||
    128. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_BGR444) ||
    129. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_BGR48) ||
    130. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_BGR555) ||
    131. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_BGR565) ||
    132. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_BGRA64) ||
    133. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_GRAY9) ||
    134. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_GRAY10) ||
    135. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_GRAY12) ||
    136. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_GRAY14) ||
    137. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_GRAY16) ||
    138. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YA16) ||
    139. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_AYUV64) ||
    140. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_GBRP9) ||
    141. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_GBRP10) ||
    142. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_GBRP12) ||
    143. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_GBRP14) ||
    144. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_GBRP16) ||
    145. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_GBRAP10) ||
    146. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_GBRAP12) ||
    147. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_GBRAP16) ||
    148. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_RGB444) ||
    149. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_RGB48) ||
    150. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_RGB555) ||
    151. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_RGB565) ||
    152. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_RGBA64) ||
    153. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_XYZ12) ||
    154. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YUV420P9) ||
    155. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YUV420P10) ||
    156. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YUV420P12) ||
    157. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YUV420P14) ||
    158. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YUV420P16) ||
    159. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YUV422P9) ||
    160. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YUV422P10) ||
    161. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YUV422P12) ||
    162. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YUV422P14) ||
    163. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YUV422P16) ||
    164. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YUV440P10) ||
    165. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YUV440P12) ||
    166. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YUV444P9) ||
    167. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YUV444P10) ||
    168. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YUV444P12) ||
    169. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YUV444P14) ||
    170. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_YUV444P16))
    171. c->convert_unscaled = bswap_16bpc;
    172. /* bswap 32 bits per pixel/component formats */
    173. if (IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_GBRPF32) ||
    174. IS_DIFFERENT_ENDIANESS(srcFormat, dstFormat, AV_PIX_FMT_GBRAPF32))
    175. c->convert_unscaled = bswap_32bpc;
    176. if (usePal(srcFormat) && isByteRGB(dstFormat))
    177. c->convert_unscaled = palToRgbWrapper;
    178. if (srcFormat == AV_PIX_FMT_YUV422P) {
    179. if (dstFormat == AV_PIX_FMT_YUYV422)
    180. c->convert_unscaled = yuv422pToYuy2Wrapper;
    181. else if (dstFormat == AV_PIX_FMT_UYVY422)
    182. c->convert_unscaled = yuv422pToUyvyWrapper;
    183. }
    184. /* uint Y to float Y */
    185. if (srcFormat == AV_PIX_FMT_GRAY8 && dstFormat == AV_PIX_FMT_GRAYF32){
    186. c->convert_unscaled = uint_y_to_float_y_wrapper;
    187. }
    188. /* float Y to uint Y */
    189. if (srcFormat == AV_PIX_FMT_GRAYF32 && dstFormat == AV_PIX_FMT_GRAY8){
    190. c->convert_unscaled = float_y_to_uint_y_wrapper;
    191. }
    192. /* LQ converters if -sws 0 or -sws 4*/
    193. if (c->flags&(SWS_FAST_BILINEAR|SWS_POINT)) {
    194. /* yv12_to_yuy2 */
    195. if (srcFormat == AV_PIX_FMT_YUV420P || srcFormat == AV_PIX_FMT_YUVA420P) {
    196. if (dstFormat == AV_PIX_FMT_YUYV422)
    197. c->convert_unscaled = planarToYuy2Wrapper;
    198. else if (dstFormat == AV_PIX_FMT_UYVY422)
    199. c->convert_unscaled = planarToUyvyWrapper;
    200. }
    201. }
    202. if (srcFormat == AV_PIX_FMT_YUYV422 &&
    203. (dstFormat == AV_PIX_FMT_YUV420P || dstFormat == AV_PIX_FMT_YUVA420P))
    204. c->convert_unscaled = yuyvToYuv420Wrapper;
    205. if (srcFormat == AV_PIX_FMT_UYVY422 &&
    206. (dstFormat == AV_PIX_FMT_YUV420P || dstFormat == AV_PIX_FMT_YUVA420P))
    207. c->convert_unscaled = uyvyToYuv420Wrapper;
    208. if (srcFormat == AV_PIX_FMT_YUYV422 && dstFormat == AV_PIX_FMT_YUV422P)
    209. c->convert_unscaled = yuyvToYuv422Wrapper;
    210. if (srcFormat == AV_PIX_FMT_UYVY422 && dstFormat == AV_PIX_FMT_YUV422P)
    211. c->convert_unscaled = uyvyToYuv422Wrapper;
    212. #define isPlanarGray(x) (isGray(x) && (x) != AV_PIX_FMT_YA8 && (x) != AV_PIX_FMT_YA16LE && (x) != AV_PIX_FMT_YA16BE)
    213. /* simple copy */
    214. if ( srcFormat == dstFormat ||
    215. (srcFormat == AV_PIX_FMT_YUVA420P && dstFormat == AV_PIX_FMT_YUV420P) ||
    216. (srcFormat == AV_PIX_FMT_YUV420P && dstFormat == AV_PIX_FMT_YUVA420P) ||
    217. (isFloat(srcFormat) == isFloat(dstFormat)) && ((isPlanarYUV(srcFormat) && isPlanarGray(dstFormat)) ||
    218. (isPlanarYUV(dstFormat) && isPlanarGray(srcFormat)) ||
    219. (isPlanarGray(dstFormat) && isPlanarGray(srcFormat)) ||
    220. (isPlanarYUV(srcFormat) && isPlanarYUV(dstFormat) &&
    221. c->chrDstHSubSample == c->chrSrcHSubSample &&
    222. c->chrDstVSubSample == c->chrSrcVSubSample &&
    223. !isSemiPlanarYUV(srcFormat) && !isSemiPlanarYUV(dstFormat))))
    224. {
    225. if (isPacked(c->srcFormat))
    226. c->convert_unscaled = packedCopyWrapper;
    227. else /* Planar YUV or gray */
    228. c->convert_unscaled = planarCopyWrapper;
    229. }
    230. if (ARCH_PPC)
    231. ff_get_unscaled_swscale_ppc(c);
    232. if (ARCH_ARM)
    233. ff_get_unscaled_swscale_arm(c);
    234. if (ARCH_AARCH64)
    235. ff_get_unscaled_swscale_aarch64(c);
    236. }
    • 从ff_get_unscaled_swscale()源代码中可以看出,赋值给SwsContext的swscale指针的函数名称大多数为XXXWrapper()。实际上这些函数封装了一些基本的像素格式转换函数。
    • 例如yuyvToYuv422Wrapper()的定义如下所示。
    1. static int yuyvToYuv422Wrapper(SwsContext *c, const uint8_t *src[],
    2. int srcStride[], int srcSliceY, int srcSliceH,
    3. uint8_t *dstParam[], int dstStride[])
    4. {
    5. uint8_t *ydst = dstParam[0] + dstStride[0] * srcSliceY;
    6. uint8_t *udst = dstParam[1] + dstStride[1] * srcSliceY;
    7. uint8_t *vdst = dstParam[2] + dstStride[2] * srcSliceY;
    8. yuyvtoyuv422(ydst, udst, vdst, src[0], c->srcW, srcSliceH, dstStride[0],
    9. dstStride[1], srcStride[0]);
    10. return srcSliceH;
    11. }
    •  从yuyvToYuv422Wrapper()的定义中可以看出,它调用了yuyvtoyuv422()。
    • 而yuyvtoyuv422()则是rgb2rgb.c中的一个函数,用于将YUVU转换为YUV422(该函数在前文中已经记录)。

    8.如果需要拉伸的话,就会调用ff_getSwsFunc()将通用的swscale()赋值给SwsContext中的swscale指针,然后返回。

    • 上一步骤(图像不用缩放)实际上是一种不太常见的情况,更多的情况下会执行本步骤。
    • 这个时候就会调用ff_getSwsFunc()获取图像的缩放函数。

    ff_getSwsFunc()

    • ff_getSwsFunc()用于获取通用的swscale()函数。
    • ff_getSwsFunc 已被 弃用
    1. SwsFunc ff_getSwsFunc(SwsContext *c)
    2. {
    3. sws_init_swscale(c);
    4. if (ARCH_PPC)
    5. ff_sws_init_swscale_ppc(c);
    6. if (ARCH_X86)
    7. ff_sws_init_swscale_x86(c);
    8. return swscale;
    9. }
    • ff_sws_init_scale函数的内部执行逻辑和 ff_getSwsFunc 类似
    1. void ff_sws_init_scale(SwsContext *c)
    2. {
    3. sws_init_swscale(c);
    4. if (ARCH_PPC)
    5. ff_sws_init_swscale_ppc(c);
    6. if (ARCH_X86)
    7. ff_sws_init_swscale_x86(c);
    8. if (ARCH_AARCH64)
    9. ff_sws_init_swscale_aarch64(c);
    10. if (ARCH_ARM)
    11. ff_sws_init_swscale_arm(c);
    12. }
    • 从源代码中可以看出ff_getSwsFunc()调用了函数sws_init_swscale()。
    • 如果系统支持X86汇编的话,还会调用ff_sws_init_swscale_x86()。

    sws_init_swscale()

    • sws_init_swscale()的定义位于libswscale\swscale.c,如下所示。
    1. static av_cold void sws_init_swscale(SwsContext *c)
    2. {
    3. enum AVPixelFormat srcFormat = c->srcFormat;
    4. ff_sws_init_output_funcs(c, &c->yuv2plane1, &c->yuv2planeX,
    5. &c->yuv2nv12cX, &c->yuv2packed1,
    6. &c->yuv2packed2, &c->yuv2packedX, &c->yuv2anyX);
    7. ff_sws_init_input_funcs(c);
    8. if (c->srcBpc == 8) {
    9. if (c->dstBpc <= 14) {
    10. c->hyScale = c->hcScale = hScale8To15_c;
    11. if (c->flags & SWS_FAST_BILINEAR) {
    12. c->hyscale_fast = ff_hyscale_fast_c;
    13. c->hcscale_fast = ff_hcscale_fast_c;
    14. }
    15. } else {
    16. c->hyScale = c->hcScale = hScale8To19_c;
    17. }
    18. } else {
    19. c->hyScale = c->hcScale = c->dstBpc > 14 ? hScale16To19_c
    20. : hScale16To15_c;
    21. }
    22. ff_sws_init_range_convert(c);
    23. if (!(isGray(srcFormat) || isGray(c->dstFormat) ||
    24. srcFormat == AV_PIX_FMT_MONOBLACK || srcFormat == AV_PIX_FMT_MONOWHITE))
    25. c->needs_hcscale = 1;
    26. }
    •  从函数中可以看出,sws_init_swscale()主要调用了3个函数:ff_sws_init_output_funcs(),ff_sws_init_input_funcs(),ff_sws_init_range_convert()。
    • 其中,ff_sws_init_output_funcs()用于初始化输出的函数,ff_sws_init_input_funcs()用于初始化输入的函数,ff_sws_init_range_convert()用于初始化像素值范围转换的函数。

    ff_sws_init_output_funcs()

    • ff_sws_init_output_funcs()用于初始化“输出函数”。“输出函数”在libswscale中的作用就是将处理后的一行像素数据输出出来。
    • ff_sws_init_output_funcs()的定义位于libswscale\output.c,如下所示。
    1. av_cold void ff_sws_init_output_funcs(SwsContext *c,
    2. yuv2planar1_fn *yuv2plane1,
    3. yuv2planarX_fn *yuv2planeX,
    4. yuv2interleavedX_fn *yuv2nv12cX,
    5. yuv2packed1_fn *yuv2packed1,
    6. yuv2packed2_fn *yuv2packed2,
    7. yuv2packedX_fn *yuv2packedX,
    8. yuv2anyX_fn *yuv2anyX)
    9. {
    10. enum AVPixelFormat dstFormat = c->dstFormat;
    11. const AVPixFmtDescriptor *desc = av_pix_fmt_desc_get(dstFormat);
    12. if (isSemiPlanarYUV(dstFormat) && isDataInHighBits(dstFormat)) {
    13. av_assert0(desc->comp[0].depth == 10);
    14. *yuv2plane1 = isBE(dstFormat) ? yuv2p010l1_BE_c : yuv2p010l1_LE_c;
    15. *yuv2planeX = isBE(dstFormat) ? yuv2p010lX_BE_c : yuv2p010lX_LE_c;
    16. *yuv2nv12cX = isBE(dstFormat) ? yuv2p010cX_BE_c : yuv2p010cX_LE_c;
    17. } else if (is16BPS(dstFormat)) {
    18. *yuv2planeX = isBE(dstFormat) ? yuv2planeX_16BE_c : yuv2planeX_16LE_c;
    19. *yuv2plane1 = isBE(dstFormat) ? yuv2plane1_16BE_c : yuv2plane1_16LE_c;
    20. if (isSemiPlanarYUV(dstFormat)) {
    21. *yuv2nv12cX = isBE(dstFormat) ? yuv2nv12cX_16BE_c : yuv2nv12cX_16LE_c;
    22. }
    23. } else if (isNBPS(dstFormat)) {
    24. if (desc->comp[0].depth == 9) {
    25. *yuv2planeX = isBE(dstFormat) ? yuv2planeX_9BE_c : yuv2planeX_9LE_c;
    26. *yuv2plane1 = isBE(dstFormat) ? yuv2plane1_9BE_c : yuv2plane1_9LE_c;
    27. } else if (desc->comp[0].depth == 10) {
    28. *yuv2planeX = isBE(dstFormat) ? yuv2planeX_10BE_c : yuv2planeX_10LE_c;
    29. *yuv2plane1 = isBE(dstFormat) ? yuv2plane1_10BE_c : yuv2plane1_10LE_c;
    30. } else if (desc->comp[0].depth == 12) {
    31. *yuv2planeX = isBE(dstFormat) ? yuv2planeX_12BE_c : yuv2planeX_12LE_c;
    32. *yuv2plane1 = isBE(dstFormat) ? yuv2plane1_12BE_c : yuv2plane1_12LE_c;
    33. } else if (desc->comp[0].depth == 14) {
    34. *yuv2planeX = isBE(dstFormat) ? yuv2planeX_14BE_c : yuv2planeX_14LE_c;
    35. *yuv2plane1 = isBE(dstFormat) ? yuv2plane1_14BE_c : yuv2plane1_14LE_c;
    36. } else
    37. av_assert0(0);
    38. } else if (dstFormat == AV_PIX_FMT_GRAYF32BE) {
    39. *yuv2planeX = yuv2planeX_floatBE_c;
    40. *yuv2plane1 = yuv2plane1_floatBE_c;
    41. } else if (dstFormat == AV_PIX_FMT_GRAYF32LE) {
    42. *yuv2planeX = yuv2planeX_floatLE_c;
    43. *yuv2plane1 = yuv2plane1_floatLE_c;
    44. } else {
    45. *yuv2plane1 = yuv2plane1_8_c;
    46. *yuv2planeX = yuv2planeX_8_c;
    47. if (isSemiPlanarYUV(dstFormat))
    48. *yuv2nv12cX = yuv2nv12cX_c;
    49. }
    50. if(c->flags & SWS_FULL_CHR_H_INT) {
    51. switch (dstFormat) {
    52. case AV_PIX_FMT_RGBA:
    53. #if CONFIG_SMALL
    54. *yuv2packedX = yuv2rgba32_full_X_c;
    55. *yuv2packed2 = yuv2rgba32_full_2_c;
    56. *yuv2packed1 = yuv2rgba32_full_1_c;
    57. #else
    58. #if CONFIG_SWSCALE_ALPHA
    59. if (c->needAlpha) {
    60. *yuv2packedX = yuv2rgba32_full_X_c;
    61. *yuv2packed2 = yuv2rgba32_full_2_c;
    62. *yuv2packed1 = yuv2rgba32_full_1_c;
    63. } else
    64. #endif /* CONFIG_SWSCALE_ALPHA */
    65. {
    66. *yuv2packedX = yuv2rgbx32_full_X_c;
    67. *yuv2packed2 = yuv2rgbx32_full_2_c;
    68. *yuv2packed1 = yuv2rgbx32_full_1_c;
    69. }
    70. #endif /* !CONFIG_SMALL */
    71. break;
    72. case AV_PIX_FMT_ARGB:
    73. #if CONFIG_SMALL
    74. *yuv2packedX = yuv2argb32_full_X_c;
    75. *yuv2packed2 = yuv2argb32_full_2_c;
    76. *yuv2packed1 = yuv2argb32_full_1_c;
    77. #else
    78. #if CONFIG_SWSCALE_ALPHA
    79. if (c->needAlpha) {
    80. *yuv2packedX = yuv2argb32_full_X_c;
    81. *yuv2packed2 = yuv2argb32_full_2_c;
    82. *yuv2packed1 = yuv2argb32_full_1_c;
    83. } else
    84. #endif /* CONFIG_SWSCALE_ALPHA */
    85. {
    86. *yuv2packedX = yuv2xrgb32_full_X_c;
    87. *yuv2packed2 = yuv2xrgb32_full_2_c;
    88. *yuv2packed1 = yuv2xrgb32_full_1_c;
    89. }
    90. #endif /* !CONFIG_SMALL */
    91. break;
    92. case AV_PIX_FMT_BGRA:
    93. #if CONFIG_SMALL
    94. *yuv2packedX = yuv2bgra32_full_X_c;
    95. *yuv2packed2 = yuv2bgra32_full_2_c;
    96. *yuv2packed1 = yuv2bgra32_full_1_c;
    97. #else
    98. #if CONFIG_SWSCALE_ALPHA
    99. if (c->needAlpha) {
    100. *yuv2packedX = yuv2bgra32_full_X_c;
    101. *yuv2packed2 = yuv2bgra32_full_2_c;
    102. *yuv2packed1 = yuv2bgra32_full_1_c;
    103. } else
    104. #endif /* CONFIG_SWSCALE_ALPHA */
    105. {
    106. *yuv2packedX = yuv2bgrx32_full_X_c;
    107. *yuv2packed2 = yuv2bgrx32_full_2_c;
    108. *yuv2packed1 = yuv2bgrx32_full_1_c;
    109. }
    110. #endif /* !CONFIG_SMALL */
    111. break;
    112. case AV_PIX_FMT_ABGR:
    113. #if CONFIG_SMALL
    114. *yuv2packedX = yuv2abgr32_full_X_c;
    115. *yuv2packed2 = yuv2abgr32_full_2_c;
    116. *yuv2packed1 = yuv2abgr32_full_1_c;
    117. #else
    118. #if CONFIG_SWSCALE_ALPHA
    119. if (c->needAlpha) {
    120. *yuv2packedX = yuv2abgr32_full_X_c;
    121. *yuv2packed2 = yuv2abgr32_full_2_c;
    122. *yuv2packed1 = yuv2abgr32_full_1_c;
    123. } else
    124. #endif /* CONFIG_SWSCALE_ALPHA */
    125. {
    126. *yuv2packedX = yuv2xbgr32_full_X_c;
    127. *yuv2packed2 = yuv2xbgr32_full_2_c;
    128. *yuv2packed1 = yuv2xbgr32_full_1_c;
    129. }
    130. #endif /* !CONFIG_SMALL */
    131. break;
    132. case AV_PIX_FMT_RGBA64LE:
    133. #if CONFIG_SWSCALE_ALPHA
    134. if (c->needAlpha) {
    135. *yuv2packedX = yuv2rgba64le_full_X_c;
    136. *yuv2packed2 = yuv2rgba64le_full_2_c;
    137. *yuv2packed1 = yuv2rgba64le_full_1_c;
    138. } else
    139. #endif /* CONFIG_SWSCALE_ALPHA */
    140. {
    141. *yuv2packedX = yuv2rgbx64le_full_X_c;
    142. *yuv2packed2 = yuv2rgbx64le_full_2_c;
    143. *yuv2packed1 = yuv2rgbx64le_full_1_c;
    144. }
    145. break;
    146. case AV_PIX_FMT_RGBA64BE:
    147. #if CONFIG_SWSCALE_ALPHA
    148. if (c->needAlpha) {
    149. *yuv2packedX = yuv2rgba64be_full_X_c;
    150. *yuv2packed2 = yuv2rgba64be_full_2_c;
    151. *yuv2packed1 = yuv2rgba64be_full_1_c;
    152. } else
    153. #endif /* CONFIG_SWSCALE_ALPHA */
    154. {
    155. *yuv2packedX = yuv2rgbx64be_full_X_c;
    156. *yuv2packed2 = yuv2rgbx64be_full_2_c;
    157. *yuv2packed1 = yuv2rgbx64be_full_1_c;
    158. }
    159. break;
    160. case AV_PIX_FMT_BGRA64LE:
    161. #if CONFIG_SWSCALE_ALPHA
    162. if (c->needAlpha) {
    163. *yuv2packedX = yuv2bgra64le_full_X_c;
    164. *yuv2packed2 = yuv2bgra64le_full_2_c;
    165. *yuv2packed1 = yuv2bgra64le_full_1_c;
    166. } else
    167. #endif /* CONFIG_SWSCALE_ALPHA */
    168. {
    169. *yuv2packedX = yuv2bgrx64le_full_X_c;
    170. *yuv2packed2 = yuv2bgrx64le_full_2_c;
    171. *yuv2packed1 = yuv2bgrx64le_full_1_c;
    172. }
    173. break;
    174. case AV_PIX_FMT_BGRA64BE:
    175. #if CONFIG_SWSCALE_ALPHA
    176. if (c->needAlpha) {
    177. *yuv2packedX = yuv2bgra64be_full_X_c;
    178. *yuv2packed2 = yuv2bgra64be_full_2_c;
    179. *yuv2packed1 = yuv2bgra64be_full_1_c;
    180. } else
    181. #endif /* CONFIG_SWSCALE_ALPHA */
    182. {
    183. *yuv2packedX = yuv2bgrx64be_full_X_c;
    184. *yuv2packed2 = yuv2bgrx64be_full_2_c;
    185. *yuv2packed1 = yuv2bgrx64be_full_1_c;
    186. }
    187. break;
    188. case AV_PIX_FMT_RGB24:
    189. *yuv2packedX = yuv2rgb24_full_X_c;
    190. *yuv2packed2 = yuv2rgb24_full_2_c;
    191. *yuv2packed1 = yuv2rgb24_full_1_c;
    192. break;
    193. case AV_PIX_FMT_BGR24:
    194. *yuv2packedX = yuv2bgr24_full_X_c;
    195. *yuv2packed2 = yuv2bgr24_full_2_c;
    196. *yuv2packed1 = yuv2bgr24_full_1_c;
    197. break;
    198. case AV_PIX_FMT_RGB48LE:
    199. *yuv2packedX = yuv2rgb48le_full_X_c;
    200. *yuv2packed2 = yuv2rgb48le_full_2_c;
    201. *yuv2packed1 = yuv2rgb48le_full_1_c;
    202. break;
    203. case AV_PIX_FMT_BGR48LE:
    204. *yuv2packedX = yuv2bgr48le_full_X_c;
    205. *yuv2packed2 = yuv2bgr48le_full_2_c;
    206. *yuv2packed1 = yuv2bgr48le_full_1_c;
    207. break;
    208. case AV_PIX_FMT_RGB48BE:
    209. *yuv2packedX = yuv2rgb48be_full_X_c;
    210. *yuv2packed2 = yuv2rgb48be_full_2_c;
    211. *yuv2packed1 = yuv2rgb48be_full_1_c;
    212. break;
    213. case AV_PIX_FMT_BGR48BE:
    214. *yuv2packedX = yuv2bgr48be_full_X_c;
    215. *yuv2packed2 = yuv2bgr48be_full_2_c;
    216. *yuv2packed1 = yuv2bgr48be_full_1_c;
    217. break;
    218. case AV_PIX_FMT_BGR4_BYTE:
    219. *yuv2packedX = yuv2bgr4_byte_full_X_c;
    220. *yuv2packed2 = yuv2bgr4_byte_full_2_c;
    221. *yuv2packed1 = yuv2bgr4_byte_full_1_c;
    222. break;
    223. case AV_PIX_FMT_RGB4_BYTE:
    224. *yuv2packedX = yuv2rgb4_byte_full_X_c;
    225. *yuv2packed2 = yuv2rgb4_byte_full_2_c;
    226. *yuv2packed1 = yuv2rgb4_byte_full_1_c;
    227. break;
    228. case AV_PIX_FMT_BGR8:
    229. *yuv2packedX = yuv2bgr8_full_X_c;
    230. *yuv2packed2 = yuv2bgr8_full_2_c;
    231. *yuv2packed1 = yuv2bgr8_full_1_c;
    232. break;
    233. case AV_PIX_FMT_RGB8:
    234. *yuv2packedX = yuv2rgb8_full_X_c;
    235. *yuv2packed2 = yuv2rgb8_full_2_c;
    236. *yuv2packed1 = yuv2rgb8_full_1_c;
    237. break;
    238. case AV_PIX_FMT_GBRP:
    239. case AV_PIX_FMT_GBRP9BE:
    240. case AV_PIX_FMT_GBRP9LE:
    241. case AV_PIX_FMT_GBRP10BE:
    242. case AV_PIX_FMT_GBRP10LE:
    243. case AV_PIX_FMT_GBRP12BE:
    244. case AV_PIX_FMT_GBRP12LE:
    245. case AV_PIX_FMT_GBRP14BE:
    246. case AV_PIX_FMT_GBRP14LE:
    247. case AV_PIX_FMT_GBRAP:
    248. case AV_PIX_FMT_GBRAP10BE:
    249. case AV_PIX_FMT_GBRAP10LE:
    250. case AV_PIX_FMT_GBRAP12BE:
    251. case AV_PIX_FMT_GBRAP12LE:
    252. *yuv2anyX = yuv2gbrp_full_X_c;
    253. break;
    254. case AV_PIX_FMT_GBRP16BE:
    255. case AV_PIX_FMT_GBRP16LE:
    256. case AV_PIX_FMT_GBRAP16BE:
    257. case AV_PIX_FMT_GBRAP16LE:
    258. *yuv2anyX = yuv2gbrp16_full_X_c;
    259. break;
    260. case AV_PIX_FMT_GBRPF32BE:
    261. case AV_PIX_FMT_GBRPF32LE:
    262. case AV_PIX_FMT_GBRAPF32BE:
    263. case AV_PIX_FMT_GBRAPF32LE:
    264. *yuv2anyX = yuv2gbrpf32_full_X_c;
    265. break;
    266. }
    267. if (!*yuv2packedX && !*yuv2anyX)
    268. goto YUV_PACKED;
    269. } else {
    270. YUV_PACKED:
    271. switch (dstFormat) {
    272. case AV_PIX_FMT_RGBA64LE:
    273. #if CONFIG_SWSCALE_ALPHA
    274. if (c->needAlpha) {
    275. *yuv2packed1 = yuv2rgba64le_1_c;
    276. *yuv2packed2 = yuv2rgba64le_2_c;
    277. *yuv2packedX = yuv2rgba64le_X_c;
    278. } else
    279. #endif /* CONFIG_SWSCALE_ALPHA */
    280. {
    281. *yuv2packed1 = yuv2rgbx64le_1_c;
    282. *yuv2packed2 = yuv2rgbx64le_2_c;
    283. *yuv2packedX = yuv2rgbx64le_X_c;
    284. }
    285. break;
    286. case AV_PIX_FMT_RGBA64BE:
    287. #if CONFIG_SWSCALE_ALPHA
    288. if (c->needAlpha) {
    289. *yuv2packed1 = yuv2rgba64be_1_c;
    290. *yuv2packed2 = yuv2rgba64be_2_c;
    291. *yuv2packedX = yuv2rgba64be_X_c;
    292. } else
    293. #endif /* CONFIG_SWSCALE_ALPHA */
    294. {
    295. *yuv2packed1 = yuv2rgbx64be_1_c;
    296. *yuv2packed2 = yuv2rgbx64be_2_c;
    297. *yuv2packedX = yuv2rgbx64be_X_c;
    298. }
    299. break;
    300. case AV_PIX_FMT_BGRA64LE:
    301. #if CONFIG_SWSCALE_ALPHA
    302. if (c->needAlpha) {
    303. *yuv2packed1 = yuv2bgra64le_1_c;
    304. *yuv2packed2 = yuv2bgra64le_2_c;
    305. *yuv2packedX = yuv2bgra64le_X_c;
    306. } else
    307. #endif /* CONFIG_SWSCALE_ALPHA */
    308. {
    309. *yuv2packed1 = yuv2bgrx64le_1_c;
    310. *yuv2packed2 = yuv2bgrx64le_2_c;
    311. *yuv2packedX = yuv2bgrx64le_X_c;
    312. }
    313. break;
    314. case AV_PIX_FMT_BGRA64BE:
    315. #if CONFIG_SWSCALE_ALPHA
    316. if (c->needAlpha) {
    317. *yuv2packed1 = yuv2bgra64be_1_c;
    318. *yuv2packed2 = yuv2bgra64be_2_c;
    319. *yuv2packedX = yuv2bgra64be_X_c;
    320. } else
    321. #endif /* CONFIG_SWSCALE_ALPHA */
    322. {
    323. *yuv2packed1 = yuv2bgrx64be_1_c;
    324. *yuv2packed2 = yuv2bgrx64be_2_c;
    325. *yuv2packedX = yuv2bgrx64be_X_c;
    326. }
    327. break;
    328. case AV_PIX_FMT_RGB48LE:
    329. *yuv2packed1 = yuv2rgb48le_1_c;
    330. *yuv2packed2 = yuv2rgb48le_2_c;
    331. *yuv2packedX = yuv2rgb48le_X_c;
    332. break;
    333. case AV_PIX_FMT_RGB48BE:
    334. *yuv2packed1 = yuv2rgb48be_1_c;
    335. *yuv2packed2 = yuv2rgb48be_2_c;
    336. *yuv2packedX = yuv2rgb48be_X_c;
    337. break;
    338. case AV_PIX_FMT_BGR48LE:
    339. *yuv2packed1 = yuv2bgr48le_1_c;
    340. *yuv2packed2 = yuv2bgr48le_2_c;
    341. *yuv2packedX = yuv2bgr48le_X_c;
    342. break;
    343. case AV_PIX_FMT_BGR48BE:
    344. *yuv2packed1 = yuv2bgr48be_1_c;
    345. *yuv2packed2 = yuv2bgr48be_2_c;
    346. *yuv2packedX = yuv2bgr48be_X_c;
    347. break;
    348. case AV_PIX_FMT_RGB32:
    349. case AV_PIX_FMT_BGR32:
    350. #if CONFIG_SMALL
    351. *yuv2packed1 = yuv2rgb32_1_c;
    352. *yuv2packed2 = yuv2rgb32_2_c;
    353. *yuv2packedX = yuv2rgb32_X_c;
    354. #else
    355. #if CONFIG_SWSCALE_ALPHA
    356. if (c->needAlpha) {
    357. *yuv2packed1 = yuv2rgba32_1_c;
    358. *yuv2packed2 = yuv2rgba32_2_c;
    359. *yuv2packedX = yuv2rgba32_X_c;
    360. } else
    361. #endif /* CONFIG_SWSCALE_ALPHA */
    362. {
    363. *yuv2packed1 = yuv2rgbx32_1_c;
    364. *yuv2packed2 = yuv2rgbx32_2_c;
    365. *yuv2packedX = yuv2rgbx32_X_c;
    366. }
    367. #endif /* !CONFIG_SMALL */
    368. break;
    369. case AV_PIX_FMT_RGB32_1:
    370. case AV_PIX_FMT_BGR32_1:
    371. #if CONFIG_SMALL
    372. *yuv2packed1 = yuv2rgb32_1_1_c;
    373. *yuv2packed2 = yuv2rgb32_1_2_c;
    374. *yuv2packedX = yuv2rgb32_1_X_c;
    375. #else
    376. #if CONFIG_SWSCALE_ALPHA
    377. if (c->needAlpha) {
    378. *yuv2packed1 = yuv2rgba32_1_1_c;
    379. *yuv2packed2 = yuv2rgba32_1_2_c;
    380. *yuv2packedX = yuv2rgba32_1_X_c;
    381. } else
    382. #endif /* CONFIG_SWSCALE_ALPHA */
    383. {
    384. *yuv2packed1 = yuv2rgbx32_1_1_c;
    385. *yuv2packed2 = yuv2rgbx32_1_2_c;
    386. *yuv2packedX = yuv2rgbx32_1_X_c;
    387. }
    388. #endif /* !CONFIG_SMALL */
    389. break;
    390. case AV_PIX_FMT_RGB24:
    391. *yuv2packed1 = yuv2rgb24_1_c;
    392. *yuv2packed2 = yuv2rgb24_2_c;
    393. *yuv2packedX = yuv2rgb24_X_c;
    394. break;
    395. case AV_PIX_FMT_BGR24:
    396. *yuv2packed1 = yuv2bgr24_1_c;
    397. *yuv2packed2 = yuv2bgr24_2_c;
    398. *yuv2packedX = yuv2bgr24_X_c;
    399. break;
    400. case AV_PIX_FMT_RGB565LE:
    401. case AV_PIX_FMT_RGB565BE:
    402. case AV_PIX_FMT_BGR565LE:
    403. case AV_PIX_FMT_BGR565BE:
    404. *yuv2packed1 = yuv2rgb16_1_c;
    405. *yuv2packed2 = yuv2rgb16_2_c;
    406. *yuv2packedX = yuv2rgb16_X_c;
    407. break;
    408. case AV_PIX_FMT_RGB555LE:
    409. case AV_PIX_FMT_RGB555BE:
    410. case AV_PIX_FMT_BGR555LE:
    411. case AV_PIX_FMT_BGR555BE:
    412. *yuv2packed1 = yuv2rgb15_1_c;
    413. *yuv2packed2 = yuv2rgb15_2_c;
    414. *yuv2packedX = yuv2rgb15_X_c;
    415. break;
    416. case AV_PIX_FMT_RGB444LE:
    417. case AV_PIX_FMT_RGB444BE:
    418. case AV_PIX_FMT_BGR444LE:
    419. case AV_PIX_FMT_BGR444BE:
    420. *yuv2packed1 = yuv2rgb12_1_c;
    421. *yuv2packed2 = yuv2rgb12_2_c;
    422. *yuv2packedX = yuv2rgb12_X_c;
    423. break;
    424. case AV_PIX_FMT_RGB8:
    425. case AV_PIX_FMT_BGR8:
    426. *yuv2packed1 = yuv2rgb8_1_c;
    427. *yuv2packed2 = yuv2rgb8_2_c;
    428. *yuv2packedX = yuv2rgb8_X_c;
    429. break;
    430. case AV_PIX_FMT_RGB4:
    431. case AV_PIX_FMT_BGR4:
    432. *yuv2packed1 = yuv2rgb4_1_c;
    433. *yuv2packed2 = yuv2rgb4_2_c;
    434. *yuv2packedX = yuv2rgb4_X_c;
    435. break;
    436. case AV_PIX_FMT_RGB4_BYTE:
    437. case AV_PIX_FMT_BGR4_BYTE:
    438. *yuv2packed1 = yuv2rgb4b_1_c;
    439. *yuv2packed2 = yuv2rgb4b_2_c;
    440. *yuv2packedX = yuv2rgb4b_X_c;
    441. break;
    442. case AV_PIX_FMT_X2RGB10LE:
    443. case AV_PIX_FMT_X2RGB10BE:
    444. *yuv2packed1 = yuv2x2rgb10_1_c;
    445. *yuv2packed2 = yuv2x2rgb10_2_c;
    446. *yuv2packedX = yuv2x2rgb10_X_c;
    447. break;
    448. case AV_PIX_FMT_X2BGR10LE:
    449. case AV_PIX_FMT_X2BGR10BE:
    450. *yuv2packed1 = yuv2x2bgr10_1_c;
    451. *yuv2packed2 = yuv2x2bgr10_2_c;
    452. *yuv2packedX = yuv2x2bgr10_X_c;
    453. break;
    454. }
    455. }
    456. switch (dstFormat) {
    457. case AV_PIX_FMT_MONOWHITE:
    458. *yuv2packed1 = yuv2monowhite_1_c;
    459. *yuv2packed2 = yuv2monowhite_2_c;
    460. *yuv2packedX = yuv2monowhite_X_c;
    461. break;
    462. case AV_PIX_FMT_MONOBLACK:
    463. *yuv2packed1 = yuv2monoblack_1_c;
    464. *yuv2packed2 = yuv2monoblack_2_c;
    465. *yuv2packedX = yuv2monoblack_X_c;
    466. break;
    467. case AV_PIX_FMT_YUYV422:
    468. *yuv2packed1 = yuv2yuyv422_1_c;
    469. *yuv2packed2 = yuv2yuyv422_2_c;
    470. *yuv2packedX = yuv2yuyv422_X_c;
    471. break;
    472. case AV_PIX_FMT_YVYU422:
    473. *yuv2packed1 = yuv2yvyu422_1_c;
    474. *yuv2packed2 = yuv2yvyu422_2_c;
    475. *yuv2packedX = yuv2yvyu422_X_c;
    476. break;
    477. case AV_PIX_FMT_UYVY422:
    478. *yuv2packed1 = yuv2uyvy422_1_c;
    479. *yuv2packed2 = yuv2uyvy422_2_c;
    480. *yuv2packedX = yuv2uyvy422_X_c;
    481. break;
    482. case AV_PIX_FMT_YA8:
    483. *yuv2packed1 = yuv2ya8_1_c;
    484. *yuv2packed2 = yuv2ya8_2_c;
    485. *yuv2packedX = yuv2ya8_X_c;
    486. break;
    487. case AV_PIX_FMT_YA16LE:
    488. *yuv2packed1 = yuv2ya16le_1_c;
    489. *yuv2packed2 = yuv2ya16le_2_c;
    490. *yuv2packedX = yuv2ya16le_X_c;
    491. break;
    492. case AV_PIX_FMT_YA16BE:
    493. *yuv2packed1 = yuv2ya16be_1_c;
    494. *yuv2packed2 = yuv2ya16be_2_c;
    495. *yuv2packedX = yuv2ya16be_X_c;
    496. break;
    497. case AV_PIX_FMT_AYUV64LE:
    498. *yuv2packedX = yuv2ayuv64le_X_c;
    499. break;
    500. }
    501. }
    1. void ff_sws_init_output_funcs(SwsContext *c,
    2. yuv2planar1_fn *yuv2plane1,
    3. yuv2planarX_fn *yuv2planeX,
    4. yuv2interleavedX_fn *yuv2nv12cX,
    5. yuv2packed1_fn *yuv2packed1,
    6. yuv2packed2_fn *yuv2packed2,
    7. yuv2packedX_fn *yuv2packedX,
    8. yuv2anyX_fn *yuv2anyX);
    • ff_sws_init_output_funcs()根据输出像素格式的不同,对以下几个函数指针进行赋值:
      • yuv2plane1:是yuv2planar1_fn类型的函数指针。该函数用于输出一行水平拉伸后的planar格式数据。数据没有使用垂直拉伸。
      • yuv2planeX:是yuv2planarX_fn类型的函数指针。该函数用于输出一行水平拉伸后的planar格式数据。数据使用垂直拉伸。
      • yuv2packed1:是yuv2packed1_fn类型的函数指针。该函数用于输出一行水平拉伸后的packed格式数据。数据没有使用垂直拉伸。
      • yuv2packed2:是yuv2packed2_fn类型的函数指针。该函数用于输出一行水平拉伸后的packed格式数据。数据使用两行数据进行垂直拉伸。
      • yuv2packedX:是yuv2packedX_fn类型的函数指针。该函数用于输出一行水平拉伸后的packed格式数据。数据使用垂直拉伸。
      • yuv2nv12cX:是yuv2interleavedX_fn类型的函数指针。还没有研究该函数。
      • yuv2anyX:是yuv2anyX_fn类型的函数指针。还没有研究该函数。

    ff_sws_init_input_funcs()

    • ff_sws_init_input_funcs()用于初始化“输入函数”。
    • “输入函数”在libswscale中的作用就是任意格式的像素转换为YUV格式以供后续的处理。
    • ff_sws_init_input_funcs()的定义位于libswscale\input.c,如下所示。
    1. av_cold void ff_sws_init_input_funcs(SwsContext *c)
    2. {
    3. enum AVPixelFormat srcFormat = c->srcFormat;
    4. c->chrToYV12 = NULL;
    5. switch (srcFormat) {
    6. case AV_PIX_FMT_YUYV422:
    7. c->chrToYV12 = yuy2ToUV_c;
    8. break;
    9. case AV_PIX_FMT_YVYU422:
    10. c->chrToYV12 = yvy2ToUV_c;
    11. break;
    12. case AV_PIX_FMT_UYVY422:
    13. c->chrToYV12 = uyvyToUV_c;
    14. break;
    15. case AV_PIX_FMT_NV12:
    16. case AV_PIX_FMT_NV24:
    17. c->chrToYV12 = nv12ToUV_c;
    18. break;
    19. case AV_PIX_FMT_NV21:
    20. case AV_PIX_FMT_NV42:
    21. c->chrToYV12 = nv21ToUV_c;
    22. break;
    23. case AV_PIX_FMT_RGB8:
    24. case AV_PIX_FMT_BGR8:
    25. case AV_PIX_FMT_PAL8:
    26. case AV_PIX_FMT_BGR4_BYTE:
    27. case AV_PIX_FMT_RGB4_BYTE:
    28. c->chrToYV12 = palToUV_c;
    29. break;
    30. case AV_PIX_FMT_GBRP9LE:
    31. c->readChrPlanar = planar_rgb9le_to_uv;
    32. break;
    33. case AV_PIX_FMT_GBRAP10LE:
    34. case AV_PIX_FMT_GBRP10LE:
    35. c->readChrPlanar = planar_rgb10le_to_uv;
    36. break;
    37. case AV_PIX_FMT_GBRAP12LE:
    38. case AV_PIX_FMT_GBRP12LE:
    39. c->readChrPlanar = planar_rgb12le_to_uv;
    40. break;
    41. case AV_PIX_FMT_GBRP14LE:
    42. c->readChrPlanar = planar_rgb14le_to_uv;
    43. break;
    44. case AV_PIX_FMT_GBRAP16LE:
    45. case AV_PIX_FMT_GBRP16LE:
    46. c->readChrPlanar = planar_rgb16le_to_uv;
    47. break;
    48. case AV_PIX_FMT_GBRAPF32LE:
    49. case AV_PIX_FMT_GBRPF32LE:
    50. c->readChrPlanar = planar_rgbf32le_to_uv;
    51. break;
    52. case AV_PIX_FMT_GBRP9BE:
    53. c->readChrPlanar = planar_rgb9be_to_uv;
    54. break;
    55. case AV_PIX_FMT_GBRAP10BE:
    56. case AV_PIX_FMT_GBRP10BE:
    57. c->readChrPlanar = planar_rgb10be_to_uv;
    58. break;
    59. case AV_PIX_FMT_GBRAP12BE:
    60. case AV_PIX_FMT_GBRP12BE:
    61. c->readChrPlanar = planar_rgb12be_to_uv;
    62. break;
    63. case AV_PIX_FMT_GBRP14BE:
    64. c->readChrPlanar = planar_rgb14be_to_uv;
    65. break;
    66. case AV_PIX_FMT_GBRAP16BE:
    67. case AV_PIX_FMT_GBRP16BE:
    68. c->readChrPlanar = planar_rgb16be_to_uv;
    69. break;
    70. case AV_PIX_FMT_GBRAPF32BE:
    71. case AV_PIX_FMT_GBRPF32BE:
    72. c->readChrPlanar = planar_rgbf32be_to_uv;
    73. break;
    74. case AV_PIX_FMT_GBRAP:
    75. case AV_PIX_FMT_GBRP:
    76. c->readChrPlanar = planar_rgb_to_uv;
    77. break;
    78. #if HAVE_BIGENDIAN
    79. case AV_PIX_FMT_YUV420P9LE:
    80. case AV_PIX_FMT_YUV422P9LE:
    81. case AV_PIX_FMT_YUV444P9LE:
    82. case AV_PIX_FMT_YUV420P10LE:
    83. case AV_PIX_FMT_YUV422P10LE:
    84. case AV_PIX_FMT_YUV440P10LE:
    85. case AV_PIX_FMT_YUV444P10LE:
    86. case AV_PIX_FMT_YUV420P12LE:
    87. case AV_PIX_FMT_YUV422P12LE:
    88. case AV_PIX_FMT_YUV440P12LE:
    89. case AV_PIX_FMT_YUV444P12LE:
    90. case AV_PIX_FMT_YUV420P14LE:
    91. case AV_PIX_FMT_YUV422P14LE:
    92. case AV_PIX_FMT_YUV444P14LE:
    93. case AV_PIX_FMT_YUV420P16LE:
    94. case AV_PIX_FMT_YUV422P16LE:
    95. case AV_PIX_FMT_YUV444P16LE:
    96. case AV_PIX_FMT_YUVA420P9LE:
    97. case AV_PIX_FMT_YUVA422P9LE:
    98. case AV_PIX_FMT_YUVA444P9LE:
    99. case AV_PIX_FMT_YUVA420P10LE:
    100. case AV_PIX_FMT_YUVA422P10LE:
    101. case AV_PIX_FMT_YUVA444P10LE:
    102. case AV_PIX_FMT_YUVA422P12LE:
    103. case AV_PIX_FMT_YUVA444P12LE:
    104. case AV_PIX_FMT_YUVA420P16LE:
    105. case AV_PIX_FMT_YUVA422P16LE:
    106. case AV_PIX_FMT_YUVA444P16LE:
    107. c->chrToYV12 = bswap16UV_c;
    108. break;
    109. #else
    110. case AV_PIX_FMT_YUV420P9BE:
    111. case AV_PIX_FMT_YUV422P9BE:
    112. case AV_PIX_FMT_YUV444P9BE:
    113. case AV_PIX_FMT_YUV420P10BE:
    114. case AV_PIX_FMT_YUV422P10BE:
    115. case AV_PIX_FMT_YUV440P10BE:
    116. case AV_PIX_FMT_YUV444P10BE:
    117. case AV_PIX_FMT_YUV420P12BE:
    118. case AV_PIX_FMT_YUV422P12BE:
    119. case AV_PIX_FMT_YUV440P12BE:
    120. case AV_PIX_FMT_YUV444P12BE:
    121. case AV_PIX_FMT_YUV420P14BE:
    122. case AV_PIX_FMT_YUV422P14BE:
    123. case AV_PIX_FMT_YUV444P14BE:
    124. case AV_PIX_FMT_YUV420P16BE:
    125. case AV_PIX_FMT_YUV422P16BE:
    126. case AV_PIX_FMT_YUV444P16BE:
    127. case AV_PIX_FMT_YUVA420P9BE:
    128. case AV_PIX_FMT_YUVA422P9BE:
    129. case AV_PIX_FMT_YUVA444P9BE:
    130. case AV_PIX_FMT_YUVA420P10BE:
    131. case AV_PIX_FMT_YUVA422P10BE:
    132. case AV_PIX_FMT_YUVA444P10BE:
    133. case AV_PIX_FMT_YUVA422P12BE:
    134. case AV_PIX_FMT_YUVA444P12BE:
    135. case AV_PIX_FMT_YUVA420P16BE:
    136. case AV_PIX_FMT_YUVA422P16BE:
    137. case AV_PIX_FMT_YUVA444P16BE:
    138. c->chrToYV12 = bswap16UV_c;
    139. break;
    140. #endif
    141. case AV_PIX_FMT_AYUV64LE:
    142. c->chrToYV12 = read_ayuv64le_UV_c;
    143. break;
    144. case AV_PIX_FMT_P010LE:
    145. case AV_PIX_FMT_P210LE:
    146. case AV_PIX_FMT_P410LE:
    147. c->chrToYV12 = p010LEToUV_c;
    148. break;
    149. case AV_PIX_FMT_P010BE:
    150. case AV_PIX_FMT_P210BE:
    151. case AV_PIX_FMT_P410BE:
    152. c->chrToYV12 = p010BEToUV_c;
    153. break;
    154. case AV_PIX_FMT_P016LE:
    155. case AV_PIX_FMT_P216LE:
    156. case AV_PIX_FMT_P416LE:
    157. c->chrToYV12 = p016LEToUV_c;
    158. break;
    159. case AV_PIX_FMT_P016BE:
    160. case AV_PIX_FMT_P216BE:
    161. case AV_PIX_FMT_P416BE:
    162. c->chrToYV12 = p016BEToUV_c;
    163. break;
    164. case AV_PIX_FMT_Y210LE:
    165. c->chrToYV12 = y210le_UV_c;
    166. break;
    167. }
    168. if (c->chrSrcHSubSample) {
    169. switch (srcFormat) {
    170. case AV_PIX_FMT_RGBA64BE:
    171. c->chrToYV12 = rgb64BEToUV_half_c;
    172. break;
    173. case AV_PIX_FMT_RGBA64LE:
    174. c->chrToYV12 = rgb64LEToUV_half_c;
    175. break;
    176. case AV_PIX_FMT_BGRA64BE:
    177. c->chrToYV12 = bgr64BEToUV_half_c;
    178. break;
    179. case AV_PIX_FMT_BGRA64LE:
    180. c->chrToYV12 = bgr64LEToUV_half_c;
    181. break;
    182. case AV_PIX_FMT_RGB48BE:
    183. c->chrToYV12 = rgb48BEToUV_half_c;
    184. break;
    185. case AV_PIX_FMT_RGB48LE:
    186. c->chrToYV12 = rgb48LEToUV_half_c;
    187. break;
    188. case AV_PIX_FMT_BGR48BE:
    189. c->chrToYV12 = bgr48BEToUV_half_c;
    190. break;
    191. case AV_PIX_FMT_BGR48LE:
    192. c->chrToYV12 = bgr48LEToUV_half_c;
    193. break;
    194. case AV_PIX_FMT_RGB32:
    195. c->chrToYV12 = bgr32ToUV_half_c;
    196. break;
    197. case AV_PIX_FMT_RGB32_1:
    198. c->chrToYV12 = bgr321ToUV_half_c;
    199. break;
    200. case AV_PIX_FMT_BGR24:
    201. c->chrToYV12 = bgr24ToUV_half_c;
    202. break;
    203. case AV_PIX_FMT_BGR565LE:
    204. c->chrToYV12 = bgr16leToUV_half_c;
    205. break;
    206. case AV_PIX_FMT_BGR565BE:
    207. c->chrToYV12 = bgr16beToUV_half_c;
    208. break;
    209. case AV_PIX_FMT_BGR555LE:
    210. c->chrToYV12 = bgr15leToUV_half_c;
    211. break;
    212. case AV_PIX_FMT_BGR555BE:
    213. c->chrToYV12 = bgr15beToUV_half_c;
    214. break;
    215. case AV_PIX_FMT_GBRAP:
    216. case AV_PIX_FMT_GBRP:
    217. c->chrToYV12 = gbr24pToUV_half_c;
    218. break;
    219. case AV_PIX_FMT_BGR444LE:
    220. c->chrToYV12 = bgr12leToUV_half_c;
    221. break;
    222. case AV_PIX_FMT_BGR444BE:
    223. c->chrToYV12 = bgr12beToUV_half_c;
    224. break;
    225. case AV_PIX_FMT_BGR32:
    226. c->chrToYV12 = rgb32ToUV_half_c;
    227. break;
    228. case AV_PIX_FMT_BGR32_1:
    229. c->chrToYV12 = rgb321ToUV_half_c;
    230. break;
    231. case AV_PIX_FMT_RGB24:
    232. c->chrToYV12 = rgb24ToUV_half_c;
    233. break;
    234. case AV_PIX_FMT_RGB565LE:
    235. c->chrToYV12 = rgb16leToUV_half_c;
    236. break;
    237. case AV_PIX_FMT_RGB565BE:
    238. c->chrToYV12 = rgb16beToUV_half_c;
    239. break;
    240. case AV_PIX_FMT_RGB555LE:
    241. c->chrToYV12 = rgb15leToUV_half_c;
    242. break;
    243. case AV_PIX_FMT_RGB555BE:
    244. c->chrToYV12 = rgb15beToUV_half_c;
    245. break;
    246. case AV_PIX_FMT_RGB444LE:
    247. c->chrToYV12 = rgb12leToUV_half_c;
    248. break;
    249. case AV_PIX_FMT_RGB444BE:
    250. c->chrToYV12 = rgb12beToUV_half_c;
    251. break;
    252. case AV_PIX_FMT_X2RGB10LE:
    253. c->chrToYV12 = rgb30leToUV_half_c;
    254. break;
    255. case AV_PIX_FMT_X2BGR10LE:
    256. c->chrToYV12 = bgr30leToUV_half_c;
    257. break;
    258. }
    259. } else {
    260. switch (srcFormat) {
    261. case AV_PIX_FMT_RGBA64BE:
    262. c->chrToYV12 = rgb64BEToUV_c;
    263. break;
    264. case AV_PIX_FMT_RGBA64LE:
    265. c->chrToYV12 = rgb64LEToUV_c;
    266. break;
    267. case AV_PIX_FMT_BGRA64BE:
    268. c->chrToYV12 = bgr64BEToUV_c;
    269. break;
    270. case AV_PIX_FMT_BGRA64LE:
    271. c->chrToYV12 = bgr64LEToUV_c;
    272. break;
    273. case AV_PIX_FMT_RGB48BE:
    274. c->chrToYV12 = rgb48BEToUV_c;
    275. break;
    276. case AV_PIX_FMT_RGB48LE:
    277. c->chrToYV12 = rgb48LEToUV_c;
    278. break;
    279. case AV_PIX_FMT_BGR48BE:
    280. c->chrToYV12 = bgr48BEToUV_c;
    281. break;
    282. case AV_PIX_FMT_BGR48LE:
    283. c->chrToYV12 = bgr48LEToUV_c;
    284. break;
    285. case AV_PIX_FMT_RGB32:
    286. c->chrToYV12 = bgr32ToUV_c;
    287. break;
    288. case AV_PIX_FMT_RGB32_1:
    289. c->chrToYV12 = bgr321ToUV_c;
    290. break;
    291. case AV_PIX_FMT_BGR24:
    292. c->chrToYV12 = bgr24ToUV_c;
    293. break;
    294. case AV_PIX_FMT_BGR565LE:
    295. c->chrToYV12 = bgr16leToUV_c;
    296. break;
    297. case AV_PIX_FMT_BGR565BE:
    298. c->chrToYV12 = bgr16beToUV_c;
    299. break;
    300. case AV_PIX_FMT_BGR555LE:
    301. c->chrToYV12 = bgr15leToUV_c;
    302. break;
    303. case AV_PIX_FMT_BGR555BE:
    304. c->chrToYV12 = bgr15beToUV_c;
    305. break;
    306. case AV_PIX_FMT_BGR444LE:
    307. c->chrToYV12 = bgr12leToUV_c;
    308. break;
    309. case AV_PIX_FMT_BGR444BE:
    310. c->chrToYV12 = bgr12beToUV_c;
    311. break;
    312. case AV_PIX_FMT_BGR32:
    313. c->chrToYV12 = rgb32ToUV_c;
    314. break;
    315. case AV_PIX_FMT_BGR32_1:
    316. c->chrToYV12 = rgb321ToUV_c;
    317. break;
    318. case AV_PIX_FMT_RGB24:
    319. c->chrToYV12 = rgb24ToUV_c;
    320. break;
    321. case AV_PIX_FMT_RGB565LE:
    322. c->chrToYV12 = rgb16leToUV_c;
    323. break;
    324. case AV_PIX_FMT_RGB565BE:
    325. c->chrToYV12 = rgb16beToUV_c;
    326. break;
    327. case AV_PIX_FMT_RGB555LE:
    328. c->chrToYV12 = rgb15leToUV_c;
    329. break;
    330. case AV_PIX_FMT_RGB555BE:
    331. c->chrToYV12 = rgb15beToUV_c;
    332. break;
    333. case AV_PIX_FMT_RGB444LE:
    334. c->chrToYV12 = rgb12leToUV_c;
    335. break;
    336. case AV_PIX_FMT_RGB444BE:
    337. c->chrToYV12 = rgb12beToUV_c;
    338. break;
    339. case AV_PIX_FMT_X2RGB10LE:
    340. c->chrToYV12 = rgb30leToUV_c;
    341. break;
    342. case AV_PIX_FMT_X2BGR10LE:
    343. c->chrToYV12 = bgr30leToUV_c;
    344. break;
    345. }
    346. }
    347. c->lumToYV12 = NULL;
    348. c->alpToYV12 = NULL;
    349. switch (srcFormat) {
    350. case AV_PIX_FMT_GBRP9LE:
    351. c->readLumPlanar = planar_rgb9le_to_y;
    352. break;
    353. case AV_PIX_FMT_GBRAP10LE:
    354. c->readAlpPlanar = planar_rgb10le_to_a;
    355. case AV_PIX_FMT_GBRP10LE:
    356. c->readLumPlanar = planar_rgb10le_to_y;
    357. break;
    358. case AV_PIX_FMT_GBRAP12LE:
    359. c->readAlpPlanar = planar_rgb12le_to_a;
    360. case AV_PIX_FMT_GBRP12LE:
    361. c->readLumPlanar = planar_rgb12le_to_y;
    362. break;
    363. case AV_PIX_FMT_GBRP14LE:
    364. c->readLumPlanar = planar_rgb14le_to_y;
    365. break;
    366. case AV_PIX_FMT_GBRAP16LE:
    367. c->readAlpPlanar = planar_rgb16le_to_a;
    368. case AV_PIX_FMT_GBRP16LE:
    369. c->readLumPlanar = planar_rgb16le_to_y;
    370. break;
    371. case AV_PIX_FMT_GBRAPF32LE:
    372. c->readAlpPlanar = planar_rgbf32le_to_a;
    373. case AV_PIX_FMT_GBRPF32LE:
    374. c->readLumPlanar = planar_rgbf32le_to_y;
    375. break;
    376. case AV_PIX_FMT_GBRP9BE:
    377. c->readLumPlanar = planar_rgb9be_to_y;
    378. break;
    379. case AV_PIX_FMT_GBRAP10BE:
    380. c->readAlpPlanar = planar_rgb10be_to_a;
    381. case AV_PIX_FMT_GBRP10BE:
    382. c->readLumPlanar = planar_rgb10be_to_y;
    383. break;
    384. case AV_PIX_FMT_GBRAP12BE:
    385. c->readAlpPlanar = planar_rgb12be_to_a;
    386. case AV_PIX_FMT_GBRP12BE:
    387. c->readLumPlanar = planar_rgb12be_to_y;
    388. break;
    389. case AV_PIX_FMT_GBRP14BE:
    390. c->readLumPlanar = planar_rgb14be_to_y;
    391. break;
    392. case AV_PIX_FMT_GBRAP16BE:
    393. c->readAlpPlanar = planar_rgb16be_to_a;
    394. case AV_PIX_FMT_GBRP16BE:
    395. c->readLumPlanar = planar_rgb16be_to_y;
    396. break;
    397. case AV_PIX_FMT_GBRAPF32BE:
    398. c->readAlpPlanar = planar_rgbf32be_to_a;
    399. case AV_PIX_FMT_GBRPF32BE:
    400. c->readLumPlanar = planar_rgbf32be_to_y;
    401. break;
    402. case AV_PIX_FMT_GBRAP:
    403. c->readAlpPlanar = planar_rgb_to_a;
    404. case AV_PIX_FMT_GBRP:
    405. c->readLumPlanar = planar_rgb_to_y;
    406. break;
    407. #if HAVE_BIGENDIAN
    408. case AV_PIX_FMT_YUV420P9LE:
    409. case AV_PIX_FMT_YUV422P9LE:
    410. case AV_PIX_FMT_YUV444P9LE:
    411. case AV_PIX_FMT_YUV420P10LE:
    412. case AV_PIX_FMT_YUV422P10LE:
    413. case AV_PIX_FMT_YUV440P10LE:
    414. case AV_PIX_FMT_YUV444P10LE:
    415. case AV_PIX_FMT_YUV420P12LE:
    416. case AV_PIX_FMT_YUV422P12LE:
    417. case AV_PIX_FMT_YUV440P12LE:
    418. case AV_PIX_FMT_YUV444P12LE:
    419. case AV_PIX_FMT_YUV420P14LE:
    420. case AV_PIX_FMT_YUV422P14LE:
    421. case AV_PIX_FMT_YUV444P14LE:
    422. case AV_PIX_FMT_YUV420P16LE:
    423. case AV_PIX_FMT_YUV422P16LE:
    424. case AV_PIX_FMT_YUV444P16LE:
    425. case AV_PIX_FMT_GRAY9LE:
    426. case AV_PIX_FMT_GRAY10LE:
    427. case AV_PIX_FMT_GRAY12LE:
    428. case AV_PIX_FMT_GRAY14LE:
    429. case AV_PIX_FMT_GRAY16LE:
    430. case AV_PIX_FMT_P016LE:
    431. case AV_PIX_FMT_P216LE:
    432. case AV_PIX_FMT_P416LE:
    433. c->lumToYV12 = bswap16Y_c;
    434. break;
    435. case AV_PIX_FMT_YUVA420P9LE:
    436. case AV_PIX_FMT_YUVA422P9LE:
    437. case AV_PIX_FMT_YUVA444P9LE:
    438. case AV_PIX_FMT_YUVA420P10LE:
    439. case AV_PIX_FMT_YUVA422P10LE:
    440. case AV_PIX_FMT_YUVA444P10LE:
    441. case AV_PIX_FMT_YUVA422P12LE:
    442. case AV_PIX_FMT_YUVA444P12LE:
    443. case AV_PIX_FMT_YUVA420P16LE:
    444. case AV_PIX_FMT_YUVA422P16LE:
    445. case AV_PIX_FMT_YUVA444P16LE:
    446. c->lumToYV12 = bswap16Y_c;
    447. c->alpToYV12 = bswap16Y_c;
    448. break;
    449. #else
    450. case AV_PIX_FMT_YUV420P9BE:
    451. case AV_PIX_FMT_YUV422P9BE:
    452. case AV_PIX_FMT_YUV444P9BE:
    453. case AV_PIX_FMT_YUV420P10BE:
    454. case AV_PIX_FMT_YUV422P10BE:
    455. case AV_PIX_FMT_YUV440P10BE:
    456. case AV_PIX_FMT_YUV444P10BE:
    457. case AV_PIX_FMT_YUV420P12BE:
    458. case AV_PIX_FMT_YUV422P12BE:
    459. case AV_PIX_FMT_YUV440P12BE:
    460. case AV_PIX_FMT_YUV444P12BE:
    461. case AV_PIX_FMT_YUV420P14BE:
    462. case AV_PIX_FMT_YUV422P14BE:
    463. case AV_PIX_FMT_YUV444P14BE:
    464. case AV_PIX_FMT_YUV420P16BE:
    465. case AV_PIX_FMT_YUV422P16BE:
    466. case AV_PIX_FMT_YUV444P16BE:
    467. case AV_PIX_FMT_GRAY9BE:
    468. case AV_PIX_FMT_GRAY10BE:
    469. case AV_PIX_FMT_GRAY12BE:
    470. case AV_PIX_FMT_GRAY14BE:
    471. case AV_PIX_FMT_GRAY16BE:
    472. case AV_PIX_FMT_P016BE:
    473. case AV_PIX_FMT_P216BE:
    474. case AV_PIX_FMT_P416BE:
    475. c->lumToYV12 = bswap16Y_c;
    476. break;
    477. case AV_PIX_FMT_YUVA420P9BE:
    478. case AV_PIX_FMT_YUVA422P9BE:
    479. case AV_PIX_FMT_YUVA444P9BE:
    480. case AV_PIX_FMT_YUVA420P10BE:
    481. case AV_PIX_FMT_YUVA422P10BE:
    482. case AV_PIX_FMT_YUVA444P10BE:
    483. case AV_PIX_FMT_YUVA422P12BE:
    484. case AV_PIX_FMT_YUVA444P12BE:
    485. case AV_PIX_FMT_YUVA420P16BE:
    486. case AV_PIX_FMT_YUVA422P16BE:
    487. case AV_PIX_FMT_YUVA444P16BE:
    488. c->lumToYV12 = bswap16Y_c;
    489. c->alpToYV12 = bswap16Y_c;
    490. break;
    491. #endif
    492. case AV_PIX_FMT_YA16LE:
    493. c->lumToYV12 = read_ya16le_gray_c;
    494. break;
    495. case AV_PIX_FMT_YA16BE:
    496. c->lumToYV12 = read_ya16be_gray_c;
    497. break;
    498. case AV_PIX_FMT_AYUV64LE:
    499. c->lumToYV12 = read_ayuv64le_Y_c;
    500. break;
    501. case AV_PIX_FMT_YUYV422:
    502. case AV_PIX_FMT_YVYU422:
    503. case AV_PIX_FMT_YA8:
    504. c->lumToYV12 = yuy2ToY_c;
    505. break;
    506. case AV_PIX_FMT_UYVY422:
    507. c->lumToYV12 = uyvyToY_c;
    508. break;
    509. case AV_PIX_FMT_BGR24:
    510. c->lumToYV12 = bgr24ToY_c;
    511. break;
    512. case AV_PIX_FMT_BGR565LE:
    513. c->lumToYV12 = bgr16leToY_c;
    514. break;
    515. case AV_PIX_FMT_BGR565BE:
    516. c->lumToYV12 = bgr16beToY_c;
    517. break;
    518. case AV_PIX_FMT_BGR555LE:
    519. c->lumToYV12 = bgr15leToY_c;
    520. break;
    521. case AV_PIX_FMT_BGR555BE:
    522. c->lumToYV12 = bgr15beToY_c;
    523. break;
    524. case AV_PIX_FMT_BGR444LE:
    525. c->lumToYV12 = bgr12leToY_c;
    526. break;
    527. case AV_PIX_FMT_BGR444BE:
    528. c->lumToYV12 = bgr12beToY_c;
    529. break;
    530. case AV_PIX_FMT_RGB24:
    531. c->lumToYV12 = rgb24ToY_c;
    532. break;
    533. case AV_PIX_FMT_RGB565LE:
    534. c->lumToYV12 = rgb16leToY_c;
    535. break;
    536. case AV_PIX_FMT_RGB565BE:
    537. c->lumToYV12 = rgb16beToY_c;
    538. break;
    539. case AV_PIX_FMT_RGB555LE:
    540. c->lumToYV12 = rgb15leToY_c;
    541. break;
    542. case AV_PIX_FMT_RGB555BE:
    543. c->lumToYV12 = rgb15beToY_c;
    544. break;
    545. case AV_PIX_FMT_RGB444LE:
    546. c->lumToYV12 = rgb12leToY_c;
    547. break;
    548. case AV_PIX_FMT_RGB444BE:
    549. c->lumToYV12 = rgb12beToY_c;
    550. break;
    551. case AV_PIX_FMT_RGB8:
    552. case AV_PIX_FMT_BGR8:
    553. case AV_PIX_FMT_PAL8:
    554. case AV_PIX_FMT_BGR4_BYTE:
    555. case AV_PIX_FMT_RGB4_BYTE:
    556. c->lumToYV12 = palToY_c;
    557. break;
    558. case AV_PIX_FMT_MONOBLACK:
    559. c->lumToYV12 = monoblack2Y_c;
    560. break;
    561. case AV_PIX_FMT_MONOWHITE:
    562. c->lumToYV12 = monowhite2Y_c;
    563. break;
    564. case AV_PIX_FMT_RGB32:
    565. c->lumToYV12 = bgr32ToY_c;
    566. break;
    567. case AV_PIX_FMT_RGB32_1:
    568. c->lumToYV12 = bgr321ToY_c;
    569. break;
    570. case AV_PIX_FMT_BGR32:
    571. c->lumToYV12 = rgb32ToY_c;
    572. break;
    573. case AV_PIX_FMT_BGR32_1:
    574. c->lumToYV12 = rgb321ToY_c;
    575. break;
    576. case AV_PIX_FMT_RGB48BE:
    577. c->lumToYV12 = rgb48BEToY_c;
    578. break;
    579. case AV_PIX_FMT_RGB48LE:
    580. c->lumToYV12 = rgb48LEToY_c;
    581. break;
    582. case AV_PIX_FMT_BGR48BE:
    583. c->lumToYV12 = bgr48BEToY_c;
    584. break;
    585. case AV_PIX_FMT_BGR48LE:
    586. c->lumToYV12 = bgr48LEToY_c;
    587. break;
    588. case AV_PIX_FMT_RGBA64BE:
    589. c->lumToYV12 = rgb64BEToY_c;
    590. break;
    591. case AV_PIX_FMT_RGBA64LE:
    592. c->lumToYV12 = rgb64LEToY_c;
    593. break;
    594. case AV_PIX_FMT_BGRA64BE:
    595. c->lumToYV12 = bgr64BEToY_c;
    596. break;
    597. case AV_PIX_FMT_BGRA64LE:
    598. c->lumToYV12 = bgr64LEToY_c;
    599. break;
    600. case AV_PIX_FMT_P010LE:
    601. case AV_PIX_FMT_P210LE:
    602. case AV_PIX_FMT_P410LE:
    603. c->lumToYV12 = p010LEToY_c;
    604. break;
    605. case AV_PIX_FMT_P010BE:
    606. case AV_PIX_FMT_P210BE:
    607. case AV_PIX_FMT_P410BE:
    608. c->lumToYV12 = p010BEToY_c;
    609. break;
    610. case AV_PIX_FMT_GRAYF32LE:
    611. c->lumToYV12 = grayf32leToY16_c;
    612. break;
    613. case AV_PIX_FMT_GRAYF32BE:
    614. c->lumToYV12 = grayf32beToY16_c;
    615. break;
    616. case AV_PIX_FMT_Y210LE:
    617. c->lumToYV12 = y210le_Y_c;
    618. break;
    619. case AV_PIX_FMT_X2RGB10LE:
    620. c->lumToYV12 = rgb30leToY_c;
    621. break;
    622. case AV_PIX_FMT_X2BGR10LE:
    623. c->lumToYV12 = bgr30leToY_c;
    624. break;
    625. }
    626. if (c->needAlpha) {
    627. if (is16BPS(srcFormat) || isNBPS(srcFormat)) {
    628. if (HAVE_BIGENDIAN == !isBE(srcFormat) && !c->readAlpPlanar)
    629. c->alpToYV12 = bswap16Y_c;
    630. }
    631. switch (srcFormat) {
    632. case AV_PIX_FMT_BGRA64LE:
    633. case AV_PIX_FMT_RGBA64LE: c->alpToYV12 = rgba64leToA_c; break;
    634. case AV_PIX_FMT_BGRA64BE:
    635. case AV_PIX_FMT_RGBA64BE: c->alpToYV12 = rgba64beToA_c; break;
    636. case AV_PIX_FMT_BGRA:
    637. case AV_PIX_FMT_RGBA:
    638. c->alpToYV12 = rgbaToA_c;
    639. break;
    640. case AV_PIX_FMT_ABGR:
    641. case AV_PIX_FMT_ARGB:
    642. c->alpToYV12 = abgrToA_c;
    643. break;
    644. case AV_PIX_FMT_YA8:
    645. c->alpToYV12 = uyvyToY_c;
    646. break;
    647. case AV_PIX_FMT_YA16LE:
    648. c->alpToYV12 = read_ya16le_alpha_c;
    649. break;
    650. case AV_PIX_FMT_YA16BE:
    651. c->alpToYV12 = read_ya16be_alpha_c;
    652. break;
    653. case AV_PIX_FMT_AYUV64LE:
    654. c->alpToYV12 = read_ayuv64le_A_c;
    655. break;
    656. case AV_PIX_FMT_PAL8 :
    657. c->alpToYV12 = palToA_c;
    658. break;
    659. }
    660. }
    661. }
    • 函数声明如下
    void ff_sws_init_input_funcs(SwsContext *c);
    
    •  ff_sws_init_input_funcs()根据输入像素格式的不同,对以下几个函数指针进行赋值:
    • lumToYV12:转换得到Y分量。
    • chrToYV12:转换得到UV分量。
    • alpToYV12:转换得到Alpha分量。
    • readLumPlanar:读取planar格式的数据转换为Y。
    • readChrPlanar:读取planar格式的数据转换为UV。

    下面看几个例子。

    • 当输入像素格式为AV_PIX_FMT_RGB24的时候,lumToYV12()指针指向的函数是rgb24ToY_c(),如下所示。
    1. case AV_PIX_FMT_RGB24:
    2. c->lumToYV12 = rgb24ToY_c;
    3. break;

    rgb24ToY_c()

    • rgb24ToY_c()的定义如下。
    1. static void rgb24ToY_c(uint8_t *_dst, const uint8_t *src, const uint8_t *unused1, const uint8_t *unused2, int width,
    2. uint32_t *rgb2yuv)
    3. {
    4. int16_t *dst = (int16_t *)_dst;
    5. int32_t ry = rgb2yuv[RY_IDX], gy = rgb2yuv[GY_IDX], by = rgb2yuv[BY_IDX];
    6. int i;
    7. for (i = 0; i < width; i++) {
    8. int r = src[i * 3 + 0];
    9. int g = src[i * 3 + 1];
    10. int b = src[i * 3 + 2];
    11. dst[i] = ((ry*r + gy*g + by*b + (32<<(RGB2YUV_SHIFT-1)) + (1<<(RGB2YUV_SHIFT-7)))>>(RGB2YUV_SHIFT-6));
    12. }
    13. }
    •  从源代码中可以看出,该函数主要完成了以下三步:
      • 1.  取系数。通过读取rgb2yuv数组中存储的参数获得R,G,B每个分量的系数。
      • 2.  取像素值。分别读取R,G,B每个分量的像素值。
      • 3.  计算得到亮度值。
    • 根据R,G,B的系数和值,计算得到亮度值Y。
    • 当输入像素格式为AV_PIX_FMT_RGB24的时候,chrToYV12 ()指针指向的函数是rgb24ToUV_half_c(),如下所示。
    1. case AV_PIX_FMT_RGB24:
    2. c->chrToYV12 = rgb24ToUV_half_c;
    3. break;

    rgb24ToUV_half_c()

    • rgb24ToUV_half_c()定义如下。 
    1. static void rgb24ToUV_half_c(uint8_t *_dstU, uint8_t *_dstV, const uint8_t *unused0, const uint8_t *src1,
    2. const uint8_t *src2, int width, uint32_t *rgb2yuv)
    3. {
    4. int16_t *dstU = (int16_t *)_dstU;
    5. int16_t *dstV = (int16_t *)_dstV;
    6. int i;
    7. int32_t ru = rgb2yuv[RU_IDX], gu = rgb2yuv[GU_IDX], bu = rgb2yuv[BU_IDX];
    8. int32_t rv = rgb2yuv[RV_IDX], gv = rgb2yuv[GV_IDX], bv = rgb2yuv[BV_IDX];
    9. av_assert1(src1 == src2);
    10. for (i = 0; i < width; i++) {
    11. int r = src1[6 * i + 0] + src1[6 * i + 3];
    12. int g = src1[6 * i + 1] + src1[6 * i + 4];
    13. int b = src1[6 * i + 2] + src1[6 * i + 5];
    14. dstU[i] = (ru*r + gu*g + bu*b + (256<<RGB2YUV_SHIFT) + (1<<(RGB2YUV_SHIFT-6)))>>(RGB2YUV_SHIFT-5);
    15. dstV[i] = (rv*r + gv*g + bv*b + (256<<RGB2YUV_SHIFT) + (1<<(RGB2YUV_SHIFT-6)))>>(RGB2YUV_SHIFT-5);
    16. }
    17. }
    •  rgb24ToUV_half_c()的过程相比rgb24ToY_c()要稍微复杂些。这主要是因为U,V取值的数量只有Y的一半。因此需要首先求出每2个像素点的平均值之后,再进行计算。
    • 当输入像素格式为AV_PIX_FMT_GBRP(注意这个是planar格式,三个分量分别为G,B,R)的时候,readLumPlanar指向的函数是planar_rgb_to_y(),如下所示。
    1. case AV_PIX_FMT_GBRP:
    2. c->readLumPlanar = planar_rgb_to_y;
    3. break;

    planar_rgb_to_y()

    • planar_rgb_to_y()定义如下。
    1. static void planar_rgb_to_y(uint8_t *_dst, const uint8_t *src[4], int width, int32_t *rgb2yuv)
    2. {
    3. uint16_t *dst = (uint16_t *)_dst;
    4. int32_t ry = rgb2yuv[RY_IDX], gy = rgb2yuv[GY_IDX], by = rgb2yuv[BY_IDX];
    5. int i;
    6. for (i = 0; i < width; i++) {
    7. int g = src[0][i];
    8. int b = src[1][i];
    9. int r = src[2][i];
    10. dst[i] = (ry*r + gy*g + by*b + (0x801<<(RGB2YUV_SHIFT-7))) >> (RGB2YUV_SHIFT-6);
    11. }
    12. }

     ff_sws_init_range_convert()

    • ff_sws_init_range_convert()用于初始化像素值范围转换的函数,它的定义位于libswscale\swscale.c,如下所示。
    1. av_cold void ff_sws_init_range_convert(SwsContext *c)
    2. {
    3. c->lumConvertRange = NULL;
    4. c->chrConvertRange = NULL;
    5. if (c->srcRange != c->dstRange && !isAnyRGB(c->dstFormat)) {
    6. if (c->dstBpc <= 14) {
    7. if (c->srcRange) {
    8. c->lumConvertRange = lumRangeFromJpeg_c;
    9. c->chrConvertRange = chrRangeFromJpeg_c;
    10. } else {
    11. c->lumConvertRange = lumRangeToJpeg_c;
    12. c->chrConvertRange = chrRangeToJpeg_c;
    13. }
    14. } else {
    15. if (c->srcRange) {
    16. c->lumConvertRange = lumRangeFromJpeg16_c;
    17. c->chrConvertRange = chrRangeFromJpeg16_c;
    18. } else {
    19. c->lumConvertRange = lumRangeToJpeg16_c;
    20. c->chrConvertRange = chrRangeToJpeg16_c;
    21. }
    22. }
    23. }
    24. }
    • ff_sws_init_range_convert()包含了两种像素取值范围的转换: 
      lumConvertRange:亮度分量取值范围的转换。 
      chrConvertRange:色度分量取值范围的转换。 
      从JPEG标准转换为MPEG标准的函数有:lumRangeFromJpeg_c()和chrRangeFromJpeg_c()。
      

    lumRangeFromJpeg_c()

    • 亮度转换(0-255转换为16-235)函数lumRangeFromJpeg_c()如下所示。
    1. static void lumRangeFromJpeg_c(int16_t *dst, int width)
    2. {
    3. int i;
    4. for (i = 0; i < width; i++)
    5. dst[i] = (dst[i] * 14071 + 33561947) >> 14;
    6. }
    • 可以简单代入一个数字验证一下上述函数的正确性。该函数将亮度值“0”映射成“16”,“255”映射成“235”,因此我们可以代入一个“255”看看转换后的数值是否为“235”。在这里需要注意,dst中存储的像素数值是15bit的亮度值。因此我们需要将8bit的数值“255”左移7位后带入。经过计算,255左移7位后取值为32640,计算后得到的数值为30080,右移7位后得到的8bit亮度值即为235。
    • 后续几个函数都可以用上面描述的方法进行验证,就不再重复了。 

    chrRangeFromJpeg_c()

    • 色度转换(0-255转换为16-240)函数chrRangeFromJpeg_c()如下所示。
    1. static void chrRangeFromJpeg_c(int16_t *dstU, int16_t *dstV, int width)
    2. {
    3. int i;
    4. for (i = 0; i < width; i++) {
    5. dstU[i] = (dstU[i] * 1799 + 4081085) >> 11; // 1469
    6. dstV[i] = (dstV[i] * 1799 + 4081085) >> 11; // 1469
    7. }
    8. }
    • 从MPEG标准转换为JPEG标准的函数有:lumRangeToJpeg_c()和chrRangeToJpeg_c()。

    lumRangeToJpeg_c()

    • 亮度转换(16-235转换为0-255)函数lumRangeToJpeg_c()定义如下所示。
    1. static void lumRangeToJpeg_c(int16_t *dst, int width)
    2. {
    3. int i;
    4. for (i = 0; i < width; i++)
    5. dst[i] = (FFMIN(dst[i], 30189) * 19077 - 39057361) >> 14;
    6. }

    chrRangeToJpeg_c()

    • 色度转换(16-240转换为0-255)函数chrRangeToJpeg_c()定义如下所示。 
    1. // FIXME all pal and rgb srcFormats could do this conversion as well
    2. // FIXME all scalers more complex than bilinear could do half of this transform
    3. static void chrRangeToJpeg_c(int16_t *dstU, int16_t *dstV, int width)
    4. {
    5. int i;
    6. for (i = 0; i < width; i++) {
    7. dstU[i] = (FFMIN(dstU[i], 30775) * 4663 - 9289992) >> 12; // -264
    8. dstV[i] = (FFMIN(dstV[i], 30775) * 4663 - 9289992) >> 12; // -264
    9. }
    10. }

    函数调用结构图

    • 分析得到的libswscale的函数调用关系如下图所示。

    Libswscale处理数据流程

    • Libswscale处理像素数据的流程可以概括为下图。

     

    • 从图中可以看出,libswscale处理数据有两条最主要的方式:unscaled和scaled。
    • unscaled用于处理不需要拉伸的像素数据(属于比较特殊的情况),scaled用于处理需要拉伸的像素数据。
    • Unscaled只需要对图像像素格式进行转换;而Scaled则除了对像素格式进行转换之外,还需要对图像进行缩放。
    • Scaled方式可以分成以下几个步骤:
      • XXX to YUV Converter:首先将数据像素数据转换为8bitYUV格式;
      • Horizontal scaler:水平拉伸图像,并且转换为15bitYUV;
      • Vertical scaler:垂直拉伸图像;
      • Output converter:转换为输出像素格式。

    SwsContext

    • SwsContext是使用libswscale时候一个贯穿始终的结构体。
    • 但是我们在使用FFmpeg的类库进行开发的时候,是无法看到它的内部结构的。
    • 在libswscale\swscale.h中只能看到一行定义:struct SwsContext;
    • 一般人看到这个只有一行定义的结构体,会猜测它的内部一定十分简单。但是假使我们看一下FFmpeg的源代码,会发现这个猜测是完全错误的SwsContext的定义是十分复杂的。
    • 它的定义位于libswscale\swscale_internal.h中,如下所示。

    1. /* This struct should be aligned on at least a 32-byte boundary. */
    2. typedef struct SwsContext {
    3. /**
    4. * info on struct for av_log
    5. */
    6. const AVClass *av_class;
    7. struct SwsContext *parent;
    8. AVSliceThread *slicethread;
    9. struct SwsContext **slice_ctx;
    10. int *slice_err;
    11. int nb_slice_ctx;
    12. // values passed to current sws_receive_slice() call
    13. int dst_slice_start;
    14. int dst_slice_height;
    15. /**
    16. * Note that src, dst, srcStride, dstStride will be copied in the
    17. * sws_scale() wrapper so they can be freely modified here.
    18. */
    19. SwsFunc convert_unscaled;
    20. int srcW; ///< Width of source luma/alpha planes.
    21. int srcH; ///< Height of source luma/alpha planes.
    22. int dstH; ///< Height of destination luma/alpha planes.
    23. int chrSrcW; ///< Width of source chroma planes.
    24. int chrSrcH; ///< Height of source chroma planes.
    25. int chrDstW; ///< Width of destination chroma planes.
    26. int chrDstH; ///< Height of destination chroma planes.
    27. int lumXInc, chrXInc;
    28. int lumYInc, chrYInc;
    29. enum AVPixelFormat dstFormat; ///< Destination pixel format.
    30. enum AVPixelFormat srcFormat; ///< Source pixel format.
    31. int dstFormatBpp; ///< Number of bits per pixel of the destination pixel format.
    32. int srcFormatBpp; ///< Number of bits per pixel of the source pixel format.
    33. int dstBpc, srcBpc;
    34. int chrSrcHSubSample; ///< Binary logarithm of horizontal subsampling factor between luma/alpha and chroma planes in source image.
    35. int chrSrcVSubSample; ///< Binary logarithm of vertical subsampling factor between luma/alpha and chroma planes in source image.
    36. int chrDstHSubSample; ///< Binary logarithm of horizontal subsampling factor between luma/alpha and chroma planes in destination image.
    37. int chrDstVSubSample; ///< Binary logarithm of vertical subsampling factor between luma/alpha and chroma planes in destination image.
    38. int vChrDrop; ///< Binary logarithm of extra vertical subsampling factor in source image chroma planes specified by user.
    39. int sliceDir; ///< Direction that slices are fed to the scaler (1 = top-to-bottom, -1 = bottom-to-top).
    40. int nb_threads; ///< Number of threads used for scaling
    41. double param[2]; ///< Input parameters for scaling algorithms that need them.
    42. AVFrame *frame_src;
    43. AVFrame *frame_dst;
    44. RangeList src_ranges;
    45. /* The cascaded_* fields allow spliting a scaler task into multiple
    46. * sequential steps, this is for example used to limit the maximum
    47. * downscaling factor that needs to be supported in one scaler.
    48. */
    49. struct SwsContext *cascaded_context[3];
    50. int cascaded_tmpStride[4];
    51. uint8_t *cascaded_tmp[4];
    52. int cascaded1_tmpStride[4];
    53. uint8_t *cascaded1_tmp[4];
    54. int cascaded_mainindex;
    55. double gamma_value;
    56. int gamma_flag;
    57. int is_internal_gamma;
    58. uint16_t *gamma;
    59. uint16_t *inv_gamma;
    60. int numDesc;
    61. int descIndex[2];
    62. int numSlice;
    63. struct SwsSlice *slice;
    64. struct SwsFilterDescriptor *desc;
    65. uint32_t pal_yuv[256];
    66. uint32_t pal_rgb[256];
    67. float uint2float_lut[256];
    68. /**
    69. * @name Scaled horizontal lines ring buffer.
    70. * The horizontal scaler keeps just enough scaled lines in a ring buffer
    71. * so they may be passed to the vertical scaler. The pointers to the
    72. * allocated buffers for each line are duplicated in sequence in the ring
    73. * buffer to simplify indexing and avoid wrapping around between lines
    74. * inside the vertical scaler code. The wrapping is done before the
    75. * vertical scaler is called.
    76. */
    77. //@{
    78. int lastInLumBuf; ///< Last scaled horizontal luma/alpha line from source in the ring buffer.
    79. int lastInChrBuf; ///< Last scaled horizontal chroma line from source in the ring buffer.
    80. //@}
    81. uint8_t *formatConvBuffer;
    82. int needAlpha;
    83. /**
    84. * @name Horizontal and vertical filters.
    85. * To better understand the following fields, here is a pseudo-code of
    86. * their usage in filtering a horizontal line:
    87. * @code
    88. * for (i = 0; i < width; i++) {
    89. * dst[i] = 0;
    90. * for (j = 0; j < filterSize; j++)
    91. * dst[i] += src[ filterPos[i] + j ] * filter[ filterSize * i + j ];
    92. * dst[i] >>= FRAC_BITS; // The actual implementation is fixed-point.
    93. * }
    94. * @endcode
    95. */
    96. //@{
    97. int16_t *hLumFilter; ///< Array of horizontal filter coefficients for luma/alpha planes.
    98. int16_t *hChrFilter; ///< Array of horizontal filter coefficients for chroma planes.
    99. int16_t *vLumFilter; ///< Array of vertical filter coefficients for luma/alpha planes.
    100. int16_t *vChrFilter; ///< Array of vertical filter coefficients for chroma planes.
    101. int32_t *hLumFilterPos; ///< Array of horizontal filter starting positions for each dst[i] for luma/alpha planes.
    102. int32_t *hChrFilterPos; ///< Array of horizontal filter starting positions for each dst[i] for chroma planes.
    103. int32_t *vLumFilterPos; ///< Array of vertical filter starting positions for each dst[i] for luma/alpha planes.
    104. int32_t *vChrFilterPos; ///< Array of vertical filter starting positions for each dst[i] for chroma planes.
    105. int hLumFilterSize; ///< Horizontal filter size for luma/alpha pixels.
    106. int hChrFilterSize; ///< Horizontal filter size for chroma pixels.
    107. int vLumFilterSize; ///< Vertical filter size for luma/alpha pixels.
    108. int vChrFilterSize; ///< Vertical filter size for chroma pixels.
    109. //@}
    110. int lumMmxextFilterCodeSize; ///< Runtime-generated MMXEXT horizontal fast bilinear scaler code size for luma/alpha planes.
    111. int chrMmxextFilterCodeSize; ///< Runtime-generated MMXEXT horizontal fast bilinear scaler code size for chroma planes.
    112. uint8_t *lumMmxextFilterCode; ///< Runtime-generated MMXEXT horizontal fast bilinear scaler code for luma/alpha planes.
    113. uint8_t *chrMmxextFilterCode; ///< Runtime-generated MMXEXT horizontal fast bilinear scaler code for chroma planes.
    114. int canMMXEXTBeUsed;
    115. int warned_unuseable_bilinear;
    116. int dstY; ///< Last destination vertical line output from last slice.
    117. int flags; ///< Flags passed by the user to select scaler algorithm, optimizations, subsampling, etc...
    118. void *yuvTable; // pointer to the yuv->rgb table start so it can be freed()
    119. // alignment ensures the offset can be added in a single
    120. // instruction on e.g. ARM
    121. DECLARE_ALIGNED(16, int, table_gV)[256 + 2*YUVRGB_TABLE_HEADROOM];
    122. uint8_t *table_rV[256 + 2*YUVRGB_TABLE_HEADROOM];
    123. uint8_t *table_gU[256 + 2*YUVRGB_TABLE_HEADROOM];
    124. uint8_t *table_bU[256 + 2*YUVRGB_TABLE_HEADROOM];
    125. DECLARE_ALIGNED(16, int32_t, input_rgb2yuv_table)[16+40*4]; // This table can contain both C and SIMD formatted values, the C vales are always at the XY_IDX points
    126. #define RY_IDX 0
    127. #define GY_IDX 1
    128. #define BY_IDX 2
    129. #define RU_IDX 3
    130. #define GU_IDX 4
    131. #define BU_IDX 5
    132. #define RV_IDX 6
    133. #define GV_IDX 7
    134. #define BV_IDX 8
    135. #define RGB2YUV_SHIFT 15
    136. int *dither_error[4];
    137. //Colorspace stuff
    138. int contrast, brightness, saturation; // for sws_getColorspaceDetails
    139. int srcColorspaceTable[4];
    140. int dstColorspaceTable[4];
    141. int srcRange; ///< 0 = MPG YUV range, 1 = JPG YUV range (source image).
    142. int dstRange; ///< 0 = MPG YUV range, 1 = JPG YUV range (destination image).
    143. int src0Alpha;
    144. int dst0Alpha;
    145. int srcXYZ;
    146. int dstXYZ;
    147. int src_h_chr_pos;
    148. int dst_h_chr_pos;
    149. int src_v_chr_pos;
    150. int dst_v_chr_pos;
    151. int yuv2rgb_y_offset;
    152. int yuv2rgb_y_coeff;
    153. int yuv2rgb_v2r_coeff;
    154. int yuv2rgb_v2g_coeff;
    155. int yuv2rgb_u2g_coeff;
    156. int yuv2rgb_u2b_coeff;
    157. #define RED_DITHER "0*8"
    158. #define GREEN_DITHER "1*8"
    159. #define BLUE_DITHER "2*8"
    160. #define Y_COEFF "3*8"
    161. #define VR_COEFF "4*8"
    162. #define UB_COEFF "5*8"
    163. #define VG_COEFF "6*8"
    164. #define UG_COEFF "7*8"
    165. #define Y_OFFSET "8*8"
    166. #define U_OFFSET "9*8"
    167. #define V_OFFSET "10*8"
    168. #define LUM_MMX_FILTER_OFFSET "11*8"
    169. #define CHR_MMX_FILTER_OFFSET "11*8+4*4*"AV_STRINGIFY(MAX_FILTER_SIZE)
    170. #define DSTW_OFFSET "11*8+4*4*"AV_STRINGIFY(MAX_FILTER_SIZE)"*2"
    171. #define ESP_OFFSET "11*8+4*4*"AV_STRINGIFY(MAX_FILTER_SIZE)"*2+8"
    172. #define VROUNDER_OFFSET "11*8+4*4*"AV_STRINGIFY(MAX_FILTER_SIZE)"*2+16"
    173. #define U_TEMP "11*8+4*4*"AV_STRINGIFY(MAX_FILTER_SIZE)"*2+24"
    174. #define V_TEMP "11*8+4*4*"AV_STRINGIFY(MAX_FILTER_SIZE)"*2+32"
    175. #define Y_TEMP "11*8+4*4*"AV_STRINGIFY(MAX_FILTER_SIZE)"*2+40"
    176. #define ALP_MMX_FILTER_OFFSET "11*8+4*4*"AV_STRINGIFY(MAX_FILTER_SIZE)"*2+48"
    177. #define UV_OFF_PX "11*8+4*4*"AV_STRINGIFY(MAX_FILTER_SIZE)"*3+48"
    178. #define UV_OFF_BYTE "11*8+4*4*"AV_STRINGIFY(MAX_FILTER_SIZE)"*3+56"
    179. #define DITHER16 "11*8+4*4*"AV_STRINGIFY(MAX_FILTER_SIZE)"*3+64"
    180. #define DITHER32 "11*8+4*4*"AV_STRINGIFY(MAX_FILTER_SIZE)"*3+80"
    181. #define DITHER32_INT (11*8+4*4*MAX_FILTER_SIZE*3+80) // value equal to above, used for checking that the struct hasn't been changed by mistake
    182. DECLARE_ALIGNED(8, uint64_t, redDither);
    183. DECLARE_ALIGNED(8, uint64_t, greenDither);
    184. DECLARE_ALIGNED(8, uint64_t, blueDither);
    185. DECLARE_ALIGNED(8, uint64_t, yCoeff);
    186. DECLARE_ALIGNED(8, uint64_t, vrCoeff);
    187. DECLARE_ALIGNED(8, uint64_t, ubCoeff);
    188. DECLARE_ALIGNED(8, uint64_t, vgCoeff);
    189. DECLARE_ALIGNED(8, uint64_t, ugCoeff);
    190. DECLARE_ALIGNED(8, uint64_t, yOffset);
    191. DECLARE_ALIGNED(8, uint64_t, uOffset);
    192. DECLARE_ALIGNED(8, uint64_t, vOffset);
    193. int32_t lumMmxFilter[4 * MAX_FILTER_SIZE];
    194. int32_t chrMmxFilter[4 * MAX_FILTER_SIZE];
    195. int dstW; ///< Width of destination luma/alpha planes.
    196. DECLARE_ALIGNED(8, uint64_t, esp);
    197. DECLARE_ALIGNED(8, uint64_t, vRounder);
    198. DECLARE_ALIGNED(8, uint64_t, u_temp);
    199. DECLARE_ALIGNED(8, uint64_t, v_temp);
    200. DECLARE_ALIGNED(8, uint64_t, y_temp);
    201. int32_t alpMmxFilter[4 * MAX_FILTER_SIZE];
    202. // alignment of these values is not necessary, but merely here
    203. // to maintain the same offset across x8632 and x86-64. Once we
    204. // use proper offset macros in the asm, they can be removed.
    205. DECLARE_ALIGNED(8, ptrdiff_t, uv_off); ///< offset (in pixels) between u and v planes
    206. DECLARE_ALIGNED(8, ptrdiff_t, uv_offx2); ///< offset (in bytes) between u and v planes
    207. DECLARE_ALIGNED(8, uint16_t, dither16)[8];
    208. DECLARE_ALIGNED(8, uint32_t, dither32)[8];
    209. const uint8_t *chrDither8, *lumDither8;
    210. #if HAVE_ALTIVEC
    211. vector signed short CY;
    212. vector signed short CRV;
    213. vector signed short CBU;
    214. vector signed short CGU;
    215. vector signed short CGV;
    216. vector signed short OY;
    217. vector unsigned short CSHIFT;
    218. vector signed short *vYCoeffsBank, *vCCoeffsBank;
    219. #endif
    220. int use_mmx_vfilter;
    221. /* pre defined color-spaces gamma */
    222. #define XYZ_GAMMA (2.6f)
    223. #define RGB_GAMMA (2.2f)
    224. int16_t *xyzgamma;
    225. int16_t *rgbgamma;
    226. int16_t *xyzgammainv;
    227. int16_t *rgbgammainv;
    228. int16_t xyz2rgb_matrix[3][4];
    229. int16_t rgb2xyz_matrix[3][4];
    230. /* function pointers for swscale() */
    231. yuv2planar1_fn yuv2plane1;
    232. yuv2planarX_fn yuv2planeX;
    233. yuv2interleavedX_fn yuv2nv12cX;
    234. yuv2packed1_fn yuv2packed1;
    235. yuv2packed2_fn yuv2packed2;
    236. yuv2packedX_fn yuv2packedX;
    237. yuv2anyX_fn yuv2anyX;
    238. /// Unscaled conversion of luma plane to YV12 for horizontal scaler.
    239. void (*lumToYV12)(uint8_t *dst, const uint8_t *src, const uint8_t *src2, const uint8_t *src3,
    240. int width, uint32_t *pal);
    241. /// Unscaled conversion of alpha plane to YV12 for horizontal scaler.
    242. void (*alpToYV12)(uint8_t *dst, const uint8_t *src, const uint8_t *src2, const uint8_t *src3,
    243. int width, uint32_t *pal);
    244. /// Unscaled conversion of chroma planes to YV12 for horizontal scaler.
    245. void (*chrToYV12)(uint8_t *dstU, uint8_t *dstV,
    246. const uint8_t *src1, const uint8_t *src2, const uint8_t *src3,
    247. int width, uint32_t *pal);
    248. /**
    249. * Functions to read planar input, such as planar RGB, and convert
    250. * internally to Y/UV/A.
    251. */
    252. /** @{ */
    253. void (*readLumPlanar)(uint8_t *dst, const uint8_t *src[4], int width, int32_t *rgb2yuv);
    254. void (*readChrPlanar)(uint8_t *dstU, uint8_t *dstV, const uint8_t *src[4],
    255. int width, int32_t *rgb2yuv);
    256. void (*readAlpPlanar)(uint8_t *dst, const uint8_t *src[4], int width, int32_t *rgb2yuv);
    257. /** @} */
    258. /**
    259. * Scale one horizontal line of input data using a bilinear filter
    260. * to produce one line of output data. Compared to SwsContext->hScale(),
    261. * please take note of the following caveats when using these:
    262. * - Scaling is done using only 7 bits instead of 14-bit coefficients.
    263. * - You can use no more than 5 input pixels to produce 4 output
    264. * pixels. Therefore, this filter should not be used for downscaling
    265. * by more than ~20% in width (because that equals more than 5/4th
    266. * downscaling and thus more than 5 pixels input per 4 pixels output).
    267. * - In general, bilinear filters create artifacts during downscaling
    268. * (even when <20%), because one output pixel will span more than one
    269. * input pixel, and thus some pixels will need edges of both neighbor
    270. * pixels to interpolate the output pixel. Since you can use at most
    271. * two input pixels per output pixel in bilinear scaling, this is
    272. * impossible and thus downscaling by any size will create artifacts.
    273. * To enable this type of scaling, set SWS_FLAG_FAST_BILINEAR
    274. * in SwsContext->flags.
    275. */
    276. /** @{ */
    277. void (*hyscale_fast)(struct SwsContext *c,
    278. int16_t *dst, int dstWidth,
    279. const uint8_t *src, int srcW, int xInc);
    280. void (*hcscale_fast)(struct SwsContext *c,
    281. int16_t *dst1, int16_t *dst2, int dstWidth,
    282. const uint8_t *src1, const uint8_t *src2,
    283. int srcW, int xInc);
    284. /** @} */
    285. /**
    286. * Scale one horizontal line of input data using a filter over the input
    287. * lines, to produce one (differently sized) line of output data.
    288. *
    289. * @param dst pointer to destination buffer for horizontally scaled
    290. * data. If the number of bits per component of one
    291. * destination pixel (SwsContext->dstBpc) is <= 10, data
    292. * will be 15 bpc in 16 bits (int16_t) width. Else (i.e.
    293. * SwsContext->dstBpc == 16), data will be 19bpc in
    294. * 32 bits (int32_t) width.
    295. * @param dstW width of destination image
    296. * @param src pointer to source data to be scaled. If the number of
    297. * bits per component of a source pixel (SwsContext->srcBpc)
    298. * is 8, this is 8bpc in 8 bits (uint8_t) width. Else
    299. * (i.e. SwsContext->dstBpc > 8), this is native depth
    300. * in 16 bits (uint16_t) width. In other words, for 9-bit
    301. * YUV input, this is 9bpc, for 10-bit YUV input, this is
    302. * 10bpc, and for 16-bit RGB or YUV, this is 16bpc.
    303. * @param filter filter coefficients to be used per output pixel for
    304. * scaling. This contains 14bpp filtering coefficients.
    305. * Guaranteed to contain dstW * filterSize entries.
    306. * @param filterPos position of the first input pixel to be used for
    307. * each output pixel during scaling. Guaranteed to
    308. * contain dstW entries.
    309. * @param filterSize the number of input coefficients to be used (and
    310. * thus the number of input pixels to be used) for
    311. * creating a single output pixel. Is aligned to 4
    312. * (and input coefficients thus padded with zeroes)
    313. * to simplify creating SIMD code.
    314. */
    315. /** @{ */
    316. void (*hyScale)(struct SwsContext *c, int16_t *dst, int dstW,
    317. const uint8_t *src, const int16_t *filter,
    318. const int32_t *filterPos, int filterSize);
    319. void (*hcScale)(struct SwsContext *c, int16_t *dst, int dstW,
    320. const uint8_t *src, const int16_t *filter,
    321. const int32_t *filterPos, int filterSize);
    322. /** @} */
    323. /// Color range conversion function for luma plane if needed.
    324. void (*lumConvertRange)(int16_t *dst, int width);
    325. /// Color range conversion function for chroma planes if needed.
    326. void (*chrConvertRange)(int16_t *dst1, int16_t *dst2, int width);
    327. int needs_hcscale; ///< Set if there are chroma planes to be converted.
    328. SwsDither dither;
    329. SwsAlphaBlend alphablend;
    330. // scratch buffer for converting packed rgb0 sources
    331. // filled with a copy of the input frame + fully opaque alpha,
    332. // then passed as input to further conversion
    333. uint8_t *rgb0_scratch;
    334. unsigned int rgb0_scratch_allocated;
    335. // scratch buffer for converting XYZ sources
    336. // filled with the input converted to rgb48
    337. // then passed as input to further conversion
    338. uint8_t *xyz_scratch;
    339. unsigned int xyz_scratch_allocated;
    340. unsigned int dst_slice_align;
    341. atomic_int stride_unaligned_warned;
    342. atomic_int data_unaligned_warned;
    343. } SwsContext;
    344. //FIXME check init (where 0)
    • 这个结构体的定义确实比较复杂,里面包含了libswscale所需要的全部变量。一一分析这些变量是不太现实的,在后文中会简单分析其中的几个变量。  缅怀大佬
    • 至此sws_getContext()的源代码就基本上分析完毕了。

  • 相关阅读:
    tomcat基础
    【吴恩达机器学习笔记】八、应用机器学习的建议
    【附源码】Python计算机毕业设计宿舍管理系统设计
    软考网络工程师每日一练10.17
    【JavaFX】给TextArea设置自定义图片光标
    QT 样式插件示例
    Mysql的执行日志
    了解CSS Module作用域隔离原理
    【miniconda+jupyter环境安装】
    AI实战营第二期 第八节 《MMSegmentation代码课》——笔记9
  • 原文地址:https://blog.csdn.net/CHYabc123456hh/article/details/125427987