qtrle: check for out of bound writes.

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

xxan: check for out of bound accesses

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

txd: check for out of bound reads.

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

qtrle: check for invalid line offset

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

vqavideo: check for out of bound reads.

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

vqa: fix double free on corrupted streams

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

vqavideo: check for invalid/unsupported version

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

eamad: release the reference frame on video size changes

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

eamad: check for out of bound reads when doing MC

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

eamad: avoid NULL derefence when missing the reference frame.

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

eatgv: fix pointer arithmetic overflows.

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

eatgv: fix out of bound reads on corrupted motions vectors.

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

eamad: clear FF_INPUT_BUFFER_PADDING_SIZE bytes at the end of the temporary buffer

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

atrac1: give a valid context pointer to av_log().

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

pixdesc: fix gbr24p

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

ffmpeg: fix y/N regression so that \n is always needed

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

sws: gbr24p input support

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

eval: fix () bug in not.

Found-by: Oded Shimon
Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

swscale: Fix prototypes of *toyv12 so they can be used with planar rgb input.

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

Start adding pixel definitions for planar rgb.

ffmpeg: put space back that was lost during someone reformating it.

Found-by: Ramiro
Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

dct-test: document the number of bits we use for testing.

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

dct-test: better term for meximum error.

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

ffmpeg: fix read_yn() if HAVE_TERMIOS_H || HAVE_KBHIT == 0

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

ffmpeg: fix setting codecs for demuxers.

Bug introduced by:
commit e3bf4e292cf999c9b8442a4e23677cab0b4781a9
Author: Anton Khirnov <anton@khirnov.net>
Date:   Tue Aug 30 04:10:54 2011 +0200

    ffmpeg: replace -vcodec/-acodec/-scodec with a better system.

    The new option doesn't depend on its placement wrt -new* options (which
    don't exist anymore) and works in a similar way as per-stream AVOptions.

    -[vas]codec remain as aliases to -codec:[vas]

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

ffmpeg: limit read_key() calls to get a tiny speed boost.

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

ffmpeg: avoid multiple redundant av_gettime() calls, rather reuse the value in a iteration of the main loop.

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

ffmpeg: fix run_as_daemon when HAVE_TERMIOS_H is false

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

ffmpeg: cosmetic renamings to reduce difference to qatar.

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

ffmpeg: call term_init() earlier

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

ffmpeg: make q_pressed volatile, it can be changed from signal handlers.

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

ffmpeg: dont call read_key() in decode_interrupt_cb() this can cause keys to be lost
also its slow when read_key() is slow and there are a very large number of calls

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

eval: add gcd()

example: -vf 'scale=256:256,mp=geq=gcd(X\,Y)-2:128:128'

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

eval:add hypot()

useage example: -vf 'scale=256:256,mp=geq=random(1)/hypot(X-cos(N*0.07)*W/2-W/2\,Y-sin(N*0.09)*H/2-H/2)^2*1000000*sin(N*0.02):128:128'

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

Merge remote-tracking branch 'qatar/master'

* qatar/master: (24 commits)
  mpegps: Use av_get_packet() instead of poorly emulating it.
  motionpixels: decode only the 111 complete frames for fate
  mpc8: Check out of bound bands limit
  xan: Prevent NULL dereference with missing palette
  xan: Check for out of bound reads in xan_huffman_decode()
  xan: Fixed out of bound accesses in xan_unpack()
  motionpixels: Prevent calling init_vlc() with invalid parameters
  shorten: Fix out of bound writes in fix_bitshift()
  dsicinav: Check for out of bounds writes
  tiertexseqv: Check for out of bound reads
  quickdraw: Check for out of bound reads
  dsicinav: Check for out of bounds reads
  motionpixels: Fix the size of workspace buffers
  motionpixels: Clear FF_INPUT_BUFFER_PADDING_SIZE bytes at the end of the temporary buffer
  wmavoice: Check for corrupted extra data
  wmavoice: Check for out of bound writes
  xan: Prevent NULL dereferences with missing reference frame
  bink: Prevent NULL dereferences with missing reference frame
  wavpack: Reset internal state on corrupted blocks
  wmapro: Validate the number of audio channels before using it
  ...

Conflicts:
libavcodec/h264.c
libavcodec/xan.c
tests/ref/fate/motionpixels

Merged-by: Michael Niedermayer <michaelni@gmx.at>

eval: add random()

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

eval: make variables persistent so they can be used between evaluations.

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

H264: set colorspace and full range to values indicating unspecified by default
Code based on ffdshow
Author unknown

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

mpegps: Use av_get_packet() instead of poorly emulating it.

bintext: reset x and y pos after each frame decode.

This makes successive frames decode possible.

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

return error code if error happens

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

motionpixels: decode only the 111 complete frames for fate

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

mpc8: Check out of bound bands limit

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

xan: Prevent NULL dereference with missing palette

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

xan: Check for out of bound reads in xan_huffman_decode()

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

xan: Fixed out of bound accesses in xan_unpack()

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

motionpixels: Prevent calling init_vlc() with invalid parameters

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

shorten: Fix out of bound writes in fix_bitshift()

The data pointers s->decoded[*] already take into account s->nwrap.

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

dsicinav: Check for out of bounds writes

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

tiertexseqv: Check for out of bound reads

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

quickdraw: Check for out of bound reads

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

dsicinav: Check for out of bounds reads

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

motionpixels: Fix the size of workspace buffers

Some buffers must be mod 4 in width and/or height.

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

motionpixels: Clear FF_INPUT_BUFFER_PADDING_SIZE bytes at the end of the temporary buffer

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

wmavoice: Check for corrupted extra data

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

wmavoice: Check for out of bound writes

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

xan: Prevent NULL dereferences with missing reference frame

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

bink: Prevent NULL dereferences with missing reference frame

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

wavpack: Reset internal state on corrupted blocks

wavpack_decode_block() supposes that it is called back with the exact
same buffer unless it has returned with an error. With multi-channels
files, wavpack_decode_frame() was breaking this assumption.

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

wmapro: Validate the number of audio channels before using it

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

mpc8: Fix return value on EOF

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

shorten: Prevent block size from increasing

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

xan: Prevent out of bound accesses

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

Merge remote-tracking branch 'hexene/stagefright'

* hexene/stagefright:
  libstagefright: start decode_thread() only after decode_frame() is called at least once.
  libstagefright: mark the dummy frame as keyframe.
  libstagefright: limit the output queue size
  libstagefright: return EOS if CustomSource::read() is called after decode_thread() returns
  libstagefright: set the correct frame size

Merged-by: Michael Niedermayer <michaelni@gmx.at>

libstagefright: start decode_thread() only after decode_frame() is called at least once.

This prevents the situation where EOS is passed as the first frame to the
h/w decoder and thus avoids a potential crash.

libstagefright: mark the dummy frame as keyframe.

This makes sure decoder->read() returns if it is the first frame fed.

libstagefright: limit the output queue size

libstagefright: return EOS if CustomSource::read() is called after decode_thread() returns

libstagefright: set the correct frame size

H264: Only wait before triggering ff_thread_setup_complete() until the next slice that contains a start-of-field/frame macroblock

This allows concurrent decoding of the last field/frame, rather than
only the last slice, of data packets with multiple NAL units packed
together.

This will fix the slowdown reported in e.g. bug 52.

Signed-off-by: Anton Khirnov <anton@khirnov.net>

swresample/rematrix: show matrix with debug log level

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

Merge remote-tracking branch 'qatar/master'

* qatar/master:
  vp6: Reset the internal state when aborting key frames header parsing
  vp56: Release old pictures after a resolution changes
  vp6: Check for huffman tree build errors
  vp56: Check for missing reference frame data
  cinepak: Fix invalid read access on extra data
  vmd: fix segfaults on corruped streams
  cook: Fix js_vlc_bits value validation for joint stereo
  segafilm: Check for memory allocation failures in segafilm demuxer.
  segafilm: Fix potential division by 0 on corrupted streams in the demuxer
  Fixed segfault on corrupted sega streams in the demuxer.
  Fixed deference of NULL pointer in motionpixels decoder.
  libx264: support 9- and 10-bit output.
  h264: correct implicit_weight for field-interlaced pictures.
  mpegvideo: set correct offset for edge emulation buffer.
  mpegvideo: fix position of bottom edge.

Conflicts:
libavcodec/motionpixels.c
libavcodec/mpegvideo.c
libavcodec/version.h
libavcodec/vmdav.c

Merged-by: Michael Niedermayer <michaelni@gmx.at>

swresample: use av_get_default_channel_layout instead of guess_layout

Signed-off-by: Marton Balint <cus@passwd.hu>
Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

avutil: bump minor version because of av_get_default_channel_layout type fix

Well, probably an ABI breakage at least for 32bit, but hopefully it will go
unnoticed because the fix happened realtively soon.

Signed-off-by: Marton Balint <cus@passwd.hu>
Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

audioconvert: fix type of av_get_default_channel_layout

Signed-off-by: Marton Balint <cus@passwd.hu>
Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

lavc: add ff_init_buffer_info()
Fixes seeking per fileposition in ffplay.

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

h264: reject unsupported 422 9 bit streams

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

audioconvert: make 7POINT1 channel layout the default for 8 channels

Signed-off-by: Marton Balint <cus@passwd.hu>
Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

h264: fix the size of PPS::chroma_qp_table

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

vp6: Reset the internal state when aborting key frames header parsing

It prevents leaving the state only half initialized.

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

vp56: Release old pictures after a resolution changes

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

vp6: Check for huffman tree build errors

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

vp56: Check for missing reference frame data

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

cinepak: Fix invalid read access on extra data

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

vmd: fix segfaults on corruped streams

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

cook: Fix js_vlc_bits value validation for joint stereo

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

segafilm: Check for memory allocation failures in segafilm demuxer.

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

segafilm: Fix potential division by 0 on corrupted streams in the demuxer

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

h264: fix fill_colmap() to not store entries mbaff style when the reference is not mbaff at all

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

Fixed segfault on corrupted sega streams in the demuxer.

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

Fixed deference of NULL pointer in motionpixels decoder.

Some of the arguments given to init_vlc() come from the stream
and can be corrupted.

Signed-off-by: Janne Grunau <janne-libav@jannau.net>

ffmpeg: make -a/v/sn work with -map

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

lavf/utils: document AVIndexEntry.timestamp

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

swresample: Try to handle cases with input channel count and layout mismatching.

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

bintext: fix warning message wording.

vaapi: fix VC-1 decoding (reconstruct bitstream TTFRM correctly).

mpegps: drop incorrect line of sofdec detection

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

mpeg1dec: More complete sofdec support

Fixes Ticket517

Signed-off-by: Michael Niedermayer <michaelni@gmx.at>

libx264: support 9- and 10-bit output.

libmodplug: free file content buffer in read_close() callback.