media: venus: helpers: Fix ALIGN() of non power of two
[ Upstream commit927e78ac8b
] ALIGN() expects its second argument to be a power of 2, otherwise incorrect results are produced for some inputs. The output can be both larger or smaller than what is expected. For example, ALIGN(304, 192) equals 320 instead of 384, and ALIGN(65, 192) equals 256 instead of 192. However, nestling two ALIGN() as is done in this case seem to only produce results equal to or bigger than the expected result if ALIGN() had handled non powers of two, and that in turn results in framesizes that are either the correct size or too large. Fortunately, since 192 * 4 / 3 equals 256, it turns out that one ALIGN() is sufficient. Fixes:ab1eda449c
("media: venus: vdec: handle 10bit bitstreams") Signed-off-by: Rikard Falkeborn <rikard.falkeborn@gmail.com> Signed-off-by: Stanimir Varbanov <stanimir.k.varbanov@gmail.com> Signed-off-by: Mauro Carvalho Chehab <mchehab@kernel.org> Signed-off-by: Sasha Levin <sashal@kernel.org>
This commit is contained in:
parent
8339bd9181
commit
c8470b7de8
|
@ -1036,8 +1036,8 @@ static u32 get_framesize_raw_yuv420_tp10_ubwc(u32 width, u32 height)
|
|||
u32 extradata = SZ_16K;
|
||||
u32 size;
|
||||
|
||||
y_stride = ALIGN(ALIGN(width, 192) * 4 / 3, 256);
|
||||
uv_stride = ALIGN(ALIGN(width, 192) * 4 / 3, 256);
|
||||
y_stride = ALIGN(width * 4 / 3, 256);
|
||||
uv_stride = ALIGN(width * 4 / 3, 256);
|
||||
y_sclines = ALIGN(height, 16);
|
||||
uv_sclines = ALIGN((height + 1) >> 1, 16);
|
||||
|
||||
|
|
Loading…
Reference in New Issue