We’re looking for someone with FFmpeg development expertise who can help us solve 2 problems.
Our company has created an RTMP encoder/streamer application using FFmpeg. The application muxes audio and video from multiple sources, and produces output that it then streams via RTMP, using FFmpeg. The application runs on macOS, currently on Sierra (10.12.6).
The problems are as follows:
Issue 1. Our FFmpeg based RTMP encoder produces VERY large frames after changing from a static image input.
The problem evolves as follows:
a. The encoder encodes and streams a still image for 30 or more seconds. During this time, output frames are of a normal size, and the output bitrate is at or under the specified target bit rate.
b. The content changes to a different, and moving picture.. At this time, the encoder’s output frames are VERY large, and the output bitrate is far above the specified target bit rate.
c. After approximately 30 seconds, the frames sizes return to normal, and the output bitrate of the motion video is roughly equal to the specified target bit rate.
There is a proportional relationship between the duration the static image is encoded in step (a) and the frame size and duration of impact.
Our encoder settings:
- Codec: [url removed, login to view]
- AVC Level: 4.1
- Data Rate: 1000kbps
- Resolution: 1280x720p
- Keyframe Interval: 2 seconds
- Frames per Second: 30
- Profile: High
- Codec: AAC
- Sample Rate: 48kHz
- Channels: 2
- Data Rate 96kbps
FFmpeg command line does not exhibit the same problem. FFmpeg produces consistent frame sizes & the output bitrate remains consistent for the duration of the encode. The following command line is used to in our testing:
ffmpeg -re -i [url removed, login to view] -b:v 1000k -vcodec h264_videotoolbox -ar 48000 -ab 96k -acodec aac -profile:v high -level:v 4.1 -f flv rtmp://hostname/appname/live/ffmpeg-test1
We have also examined the recordings of both the FFmpeg output and of our encoder’s output with FFprobe. We have converted the FFprobe output to CSV format, so it is easier to read. Our encoder's recorded video output ([url removed, login to view]), and the FFprobe output ([url removed, login to view]) are attached to this posting.
You will notice that our command line uses h264_videotoolbox rather than libx264. Our encoder users h264_videotoolbox also. We have also tested our encoder when using libx264 and it shows exactly the same problem.
We would like to resolve this issue with our encoder, so that it will not inflate the frame size, forcing the bit rate over the target bit rate. Our encoder should perform as well as FFmpeg command line does.
Issue 2. The RTMP @setDataFrame’s onMetaData payload for our implementation differs from what FFmpeg produces from the command line. The primary concern is that the framerate is not specified. We would like to make sure the framerate is included. Secondarily, We would like to understand why our implementation specifies 'duration' and 'filesize'. This is a live stream so those values seem invalid.
Our implementation sends the following values in the onMetaData message:
encoder: [url removed, login to view]
Our FFmpeg command line is set as follows, to match the values configured in my implementation as closely as possible.
ffmpeg -re -i [url removed, login to view] -b:v 1000k -vcodec h264_videotoolbox -ar 48000 -ab 96k -acodec aac -profile:v high -level:v 4.1 -f flv rtmp://[url removed, login to view]
FFmpeg sends the following values in the onMetaData message.
encoder: [url removed, login to view]
3 freelancers are bidding on average $2167 for this job
Dear sir I'm familiar with FFMPEG Library and I can fix your issues in a day absolutely. If you award me, I can start your job immediately. Let's achieve success together. Thanks.