考虑到Flutter使用自己的图形引擎,有没有一种方法可以直接将Flutter动画渲染到视频中,或者以逐帧方式创建屏幕截图?
一种用例是,这使得观众可以更容易地进行演示。
例如,一位作者想要创建一个Flutter动画教程,在该教程中,他们使用Flutter直接渲染的动画GIF/视频构建了一个演示应用程序,并编写了一篇配套的博客文章。
另一个例子是UI团队之外的一个开发人员发现一个复杂的动画中有一个微小的错误。在不实际学习动画代码的情况下,他们可以将动画渲染为视频,并编辑带有注释的短片,然后将其发送给UI团队进行诊断。
发布于 2020-12-19 18:14:48
它不是很漂亮,但我已经设法让原型工作了。首先,所有动画都需要由一个主动画控制器驱动,这样我们就可以单步执行到动画的任何部分。其次,我们要记录的小部件树必须包装在一个带有全局键的RepaintBoundary
中。RepaintBoundary及其键可以生成小部件树的快照,如下所示:
Future<Uint8List> _capturePngToUint8List() async {
// renderBoxKey is the global key of my RepaintBoundary
RenderRepaintBoundary boundary = renderBoxKey.currentContext.findRenderObject();
// pixelratio allows you to render it at a higher resolution than the actual widget in the application.
ui.Image image = await boundary.toImage(pixelRatio: 2.0);
ByteData byteData = await image.toByteData(format: ui.ImageByteFormat.png);
Uint8List pngBytes = byteData.buffer.asUint8List();
return pngBytes;
}
然后,可以在一个循环中使用上面的方法,该循环将小部件树捕获到pngBytes中,并按您想要的帧率指定的deltaT将animationController单步前进:
double t = 0;
int i = 1;
setState(() {
animationController.value = 0.0;
});
Map<int, Uint8List> frames = {};
double dt = (1 / 60) / animationController.duration.inSeconds.toDouble();
while (t <= 1.0) {
print("Rendering... ${t * 100}%");
var bytes = await _capturePngToUint8List();
frames[i] = bytes;
t += dt;
setState(() {
animationController.value = t;
});
i++;
}
最后,所有这些png帧都可以通过管道传输到ffmpeg子进程中,以写入视频。我还没有设法让这部分很好地工作,所以我所做的是将所有的png -frame写出到实际的png文件中,然后在写入它们的文件夹中手动运行ffmpeg。(注意:我使用flutter桌面来访问我安装的ffmpeg,但有a package on pub.dev to get ffmpeg on mobile too)
List<Future<File>> fileWriterFutures = [];
frames.forEach((key, value) {
fileWriterFutures.add(_writeFile(bytes: value, location: r"D:\path\to\my\images\folder\" + "frame_$key.png"));
});
await Future.wait(fileWriterFutures);
_runFFmpeg();
下面是我的文件写入器帮助函数:
Future<File> _writeFile({@required String location, @required Uint8List bytes}) async {
File file = File(location);
return file.writeAsBytes(bytes);
}
下面是我的FFmpeg运行器函数:
void _runFFmpeg() async {
// ffmpeg -y -r 60 -start_number 1 -i frame_%d.png -c:v libx264 -preset medium -tune animation -pix_fmt yuv420p test.mp4
var process = await Process.start(
"ffmpeg",
[
"-y", // replace output file if it already exists
"-r", "60", // framrate
"-start_number", "1",
"-i", r"./test/frame_%d.png", // <- Change to location of images
"-an", // don't expect audio
"-c:v", "libx264rgb", // H.264 encoding
"-preset", "medium",
"-crf",
"10", // Ranges 0-51 indicates lossless compression to worst compression. Sane options are 0-30
"-tune", "animation",
"-preset", "medium",
"-pix_fmt", "yuv420p",
r"./test/test.mp4" // <- Change to location of output
],
mode: ProcessStartMode.inheritStdio // This mode causes some issues at times, so just remove it if it doesn't work. I use it mostly to debug the ffmpeg process' output
);
print("Done Rendering");
}
发布于 2021-07-25 00:01:51
我使用了Erik的答案作为我自己实现的起点,并希望对他最初的答案进行补充。
在将所有png图像保存到目标位置后,我使用Flutter的ffmpeg包创建了所有图像的视频。由于创建也可以由QuickTime Player播放的视频需要一段时间才能找到正确的设置,因此我想与您分享这些设置:
final FlutterFFmpeg _flutterFFmpeg =
new FlutterFFmpeg(); // Create new ffmpeg instance somewhere in your code
// Function to create the video. All png files must be available in your target location prior to calling this function.
Future<String> _createVideoFromPngFiles(String location, int framerate) async {
final dateAsString = DateFormat('ddMMyyyy_hhmmss').format(DateTime.now());
final filePath =
"$location/video_$dateAsString.mov"; // had to use mov to be able to play the video on QuickTime
var arguments = [
"-y", // Replace output file if it already exists
"-r", "$framerate", // Your target framerate
"-start_number", "1",
"-i",
"$location/frame_%d.png", // The location where you saved all your png files
"-an", // Don't expect audio
"-c:v",
"libx264", // H.264 encoding, make sure to use the full-gpl ffmpeg package version
"-preset", "medium",
"-crf",
"10", // Ranges 0-51 indicates lossless compression to worst compression. Sane options are 0-30
"-tune", "animation",
"-preset", "medium",
"-pix_fmt",
"yuv420p", // Set the pixel format to make it compatible for QuickTime
"-vf",
"pad=ceil(iw/2)*2:ceil(ih/2)*2", // Make sure that height and width are divisible by 2
filePath
];
final result = await _flutterFFmpeg.executeWithArguments(arguments);
return result == 0
? filePath
: ''; // Result == 0 indicates that video creation was successful
}
如果您使用的是libx264
,请确保遵循flutter_ffmpeg包的说明:您必须使用full-gpl
版本,其中包含x264库。
根据动画的长度、所需的帧率、像素比率和设备内存,在写入文件之前保存所有帧可能会导致内存问题。因此,根据您的使用情况,您可能希望暂停/恢复动画,并以多个批的方式写入文件,这样就不会有超出可用内存的风险。
https://stackoverflow.com/questions/52274511
复制相似问题