tensorflow.python.framework.errors_impl.InternalError: GPU同步失败
tensorflow.python.framework.errors_impl.InternalError: GPU同步失败
提问于 2020-09-03 22:18:43
我安装了以下设备：
451.48
- Memory：
- 窗口10
- Python 2.3
- CudNN 7.6.5
H 111Nvidia gtx 1080H 212<代码>H 113驱动程序版本:451.48
- Memory:8192 2.3
H 216F 217
在培训期间，它会产生以下错误：
Traceback (most recent call last):
File "training.py", line 519, in <module>
history = model.fit(X_train, y_train, epochs=n_epochs, batch_size=batch_size, \
File "C:\Anaconda3_64\lib\site-packages\tensorflow\python\keras\engine\training.py", line 108, in _method_wrapper
return method(self, *args, **kwargs)
File "C:\Anaconda3_64\lib\site-packages\tensorflow\python\keras\engine\training.py", line 1103, in fit
callbacks.on_train_batch_end(end_step, logs)
File "C:\Anaconda3_64\lib\site-packages\tensorflow\python\keras\callbacks.py", line 440, in on_train_batch_end
self._call_batch_hook(ModeKeys.TRAIN, 'end', batch, logs=logs)
File "C:\Anaconda3_64\lib\site-packages\tensorflow\python\keras\callbacks.py", line 289, in _call_batch_hook
self._call_batch_end_hook(mode, batch, logs)
File "C:\Anaconda3_64\lib\site-packages\tensorflow\python\keras\callbacks.py", line 309, in _call_batch_end_hook
self._call_batch_hook_helper(hook_name, batch, logs)
File "C:\Anaconda3_64\lib\site-packages\tensorflow\python\keras\callbacks.py", line 342, in _call_batch_hook_helper
hook(batch, logs)
File "C:\Anaconda3_64\lib\site-packages\tensorflow\python\keras\callbacks.py", line 961, in on_train_batch_end
self._batch_update_progbar(batch, logs)
File "C:\Anaconda3_64\lib\site-packages\tensorflow\python\keras\callbacks.py", line 1016, in _batch_update_progbar
logs = tf_utils.to_numpy_or_python_type(logs)
File "C:\Anaconda3_64\lib\site-packages\tensorflow\python\keras\utils\tf_utils.py", line 537, in to_numpy_or_python_type
return nest.map_structure(_to_single_numpy_or_python_type, tensors)
File "C:\Anaconda3_64\lib\site-packages\tensorflow\python\util\nest.py", line 635, in map_structure
structure[0], [func(*x) for x in entries],
File "C:\Anaconda3_64\lib\site-packages\tensorflow\python\util\nest.py", line 635, in <listcomp>
structure[0], [func(*x) for x in entries],
File "C:\Anaconda3_64\lib\site-packages\tensorflow\python\keras\utils\tf_utils.py", line 533, in _to_single_numpy_or_python_type
x = t.numpy()
File "C:\Anaconda3_64\lib\site-packages\tensorflow\python\framework\ops.py", line 1063, in numpy
maybe_arr = self._numpy() # pylint: disable=protected-access
File "C:\Anaconda3_64\lib\site-packages\tensorflow\python\framework\ops.py", line 1031, in _numpy
six.raise_from(core._status_to_exception(e.code, e.message), None) # pylint: disable=protected-access
File "<string>", line 3, in raise_from
tensorflow.python.framework.errors_impl.InternalError: GPU sync failedInternalError: GPU同步失败
有什么线索吗？
回答 1
Stack Overflow用户
发布于 2022-04-13 17:37:15
请验证CUDA和CUPTI的路径设置正确，如下所示，以便在系统中启用GPU support。
SET PATH=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.0\bin;%PATH%
SET PATH=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.0\extras\CUPTI\lib64;%PATH%
SET PATH=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.0\include;%PATH%
SET PATH=C:\tools\cuda\bin;%PATH%有时，GPU sync failed错误是由于其他应用程序或处理大量输入数据时对GPU的高使用率造成的。因此，您应该停止这些应用程序或笔记本，然后再尝试执行您的代码。
页面原文内容由Stack Overflow提供。腾讯云小微IT领域专用引擎提供翻译支持
原文链接：
https://stackoverflow.com/questions/63732386
复制相关文章
相似问题
腾讯云开发者
