本指导适用于在 TencentOS Server 3 上使用 TensorRT 推理框架运行 ResNet 模型，以 Docker 方式启动。
TensorRT 环境准备
1. 从 GitHub 下载 TensorRT 开源仓库到本地。
#下载TensorRT开源仓库到本地，版本为8.6.1git clone git@github.com:NVIDIA/TensorRT.git -b release/8.6 --single-branchcd TensorRT
2. 启动 TensorRT NGC 容器。
docker run -it --gpus all --name=tensorrt -e HF_ENDPOINT="https://hf-mirror.com" -v $PWD:/workspace nvcr.io/nvidia/pytorch:23.06-py3 /bin/bash
此时会从 nvcr 拉取 docker 镜像，请确保网络环境较好，直到镜像里所有层下载成功。成功后会直接进入容器内部。
检查必要的包的版本
1. 确保使用较新的 pip 包和 TensorRT 包，并使用命令更新。
#更新pip包 python3 -m pip install --upgrade pip
2. 检查 TensorRT 版本，最低要求为8.6.0。
#检查TensorRT版本 python3 -c 'import tensorrt;print(tensorrt.__version__)'
本指导下载的 TensorRT 版本为8.6.1，如版本低于8.6.0，请卸载 TensorRT 并重新安装。
#卸载TensorRT包 python3 -m pip uninstall tensorrt #下载新的TensorRT包，且指定版本，这里指定为8.6.1 python3 -m pip install tensorrt==8.6.1 python3 -c 'import tensorrt;print(tensorrt.__version__)'
下载运行框架和模型必要的包
1. TensorRT 没有官方 ResNet demo 代码，我们自己创建代码以及安装运行模型需要的包。
#运行文件夹构建 export TRT_OSSPATH=/workspace cd $TRT_OSSPATH/demo/ mkdir ResNetcd ResNet
2. 安装运行框架和模型所需的包。
#安装torch2trt包，方便后续模型从torch转为TensorRT形式git clone https://github.com/NVIDIA-AI-IOT/torch2trtcd torch2trtpython setup.py install#检查torch2trt是否安装好，安装好的话能看到对应的版本号等信息pip show torch2trt
3. 安装好的话可以看到如下信息（参考）：
Name: torch2trtVersion: 0.5.0Summary: An easy to use PyTorch to TensorRT converterHome-page:Author:Author-email:License: UNKNOWNLocation: /usr/local/lib/python3.10/dist-packages/torch2trt-0.5.0-py3.10.eggRequires:Required-by:
运行模型
回到 ResNet 文件夹下，创建 ResNet.py 文件，写入以下代码，本指导使用 Pytorch 和 TensorRT 两种方式运行 ResNet-50 模型：
import torchimport torch.nn.functional as Fimport osimport requestsfrom pathlib import Pathfrom PIL import Imageimport timefrom torch2trt import torch2trtfrom torch2trt import TRTModulefrom torchvision.models.resnet import resnet50from torchvision import transformstransform = transforms.Compose([transforms.Resize(256),transforms.CenterCrop(224),transforms.ToTensor(),transforms.Normalize(mean=[0.485, 0.456, 0.406],std=[0.229, 0.224, 0.225])])# inference using Pytorch# setup test input: download image and label filesample_path = Path("data/cats_image.jpeg")label_path = Path("data/imagenet_classes.txt")model_trt_path = Path("model/resnet50_trt.pth")# download imageif os.path.exists(sample_path):print("sample exists.")else:print("download sample.")sample_path.parent.mkdir(parents=True, exist_ok=True)r = requests.get("https://hf-mirror.com/datasets/huggingface/cats-image/resolve/main/cats_image.jpeg")with sample_path.open("wb") as f:f.write(r.content)# download label fileif os.path.exists(label_path):print("label file exists.")else:print("download label file.")label_path.parent.mkdir(parents=True, exist_ok=True)r = requests.get("https://raw.githubusercontent.com/Lasagne/Recipes/master/examples/resnet50/imagenet_classes.txt")with label_path.open("wb") as f:f.write(r.content)# open imageimage = Image.open(sample_path).convert("RGB")inputs = transform(image)batch_inputs = torch.unsqueeze(inputs, 0).cuda()# load model and labelsmodel = resnet50(pretrained=True).eval().cuda()with open('data/imagenet_classes.txt') as f:classes = [line.strip() for line in f.readlines()]# inference by Pytorchstart = time.perf_counter()output_logits = model(batch_inputs)end = time.perf_counter() - startoutput_prob = F.softmax(output_logits, dim=-1)predicted_class_indices = torch.argmax(output_prob, dim=-1)predicted_class = classes[predicted_class_indices]print(f"Pytorch Predict class: {predicted_class}")print(f"Pytorch Processing time: {end:.4f}")# inference by TensorRT# load TensorRT modelif os.path.exists(model_trt_path):print("TensorRT model exists.")model_trt = TRTModule()model_trt.load_state_dict(torch.load(model_trt_path))else:print("Convert and save TensorRT model.")model_trt_path.parent.mkdir(parents=True, exist_ok=True)# Build TensorRT enginemodel_trt = torch2trt(model, [batch_inputs], fp16_mode=True).cuda()# save TensorRT modeltorch.save(model_trt.state_dict(), model_trt_path)start = time.perf_counter()output_trt_logits = model_trt(batch_inputs)end = time.perf_counter() - startoutput_trt_prob = F.softmax(output_trt_logits, dim=-1)trt_predicted_class_indices = torch.argmax(output_trt_prob, dim=-1)trt_predicted_class = classes[trt_predicted_class_indices]print(f"TensorRT Predict class: {trt_predicted_class}")print(f"TensorRT Processing time: {end:.4f}")
随后运行该代码：
python ResNet.py
运行后会先下载测试图像，label 名文件以及网络模型权重。这里我们使用 ResNet-50 模型进行图像分类任务，分类测试图像如下：
该测试图像来源于 ImageNet-1K，而模型最后一层是从2048通过fc层降维到1000，所以我们需要 ImageNet 的 label 文件 imagenet_classes.txt 来确定分类结果，1000个 label 名称如下：
tench, Tinca tincagoldfish, Carassius auratusgreat white shark, white shark, man-eater, man-eating shark, Carcharodon carchariastiger shark, Galeocerdo cuvierihammerhead, hammerhead sharkelectric ray, crampfish, numbfish, torpedostingraycockhenostrich, Struthio camelusbrambling, Fringilla montifringillagoldfinch, Carduelis carduelishouse finch, linnet, Carpodacus mexicanusjunco, snowbirdindigo bunting, indigo finch, indigo bird, Passerina cyanearobin, American robin, Turdus migratoriusbulbuljaymagpiechickadeewater ouzel, dipperkitebald eagle, American eagle, Haliaeetus leucocephalusvulturegreat grey owl, great gray owl, Strix nebulosaEuropean fire salamander, Salamandra salamandracommon newt, Triturus vulgariseftspotted salamander, Ambystoma maculatumaxolotl, mud puppy, Ambystoma mexicanumbullfrog, Rana catesbeianatree frog, tree-frogtailed frog, bell toad, ribbed toad, tailed toad, Ascaphus truiloggerhead, loggerhead turtle, Caretta carettaleatherback turtle, leatherback, leathery turtle, Dermochelys coriaceamud turtleterrapinbox turtle, box tortoisebanded geckocommon iguana, iguana, Iguana iguanaAmerican chameleon, anole, Anolis carolinensiswhiptail, whiptail lizardagamafrilled lizard, Chlamydosaurus kingialligator lizardGila monster, Heloderma suspectumgreen lizard, Lacerta viridisAfrican chameleon, Chamaeleo chamaeleonKomodo dragon, Komodo lizard, dragon lizard, giant lizard, Varanus komodoensisAfrican crocodile, Nile crocodile, Crocodylus niloticusAmerican alligator, Alligator mississipiensistriceratopsthunder snake, worm snake, Carphophis amoenusringneck snake, ring-necked snake, ring snakehognose snake, puff adder, sand vipergreen snake, grass snakeking snake, kingsnakegarter snake, grass snakewater snakevine snakenight snake, Hypsiglena torquataboa constrictor, Constrictor constrictorrock python, rock snake, Python sebaeIndian cobra, Naja najagreen mambasea snakehorned viper, cerastes, sand viper, horned asp, Cerastes cornutusdiamondback, diamondback rattlesnake, Crotalus adamanteussidewinder, horned rattlesnake, Crotalus cerastestrilobiteharvestman, daddy longlegs, Phalangium opilioscorpionblack and gold garden spider, Argiope aurantiabarn spider, Araneus cavaticusgarden spider, Aranea diadematablack widow, Latrodectus mactanstarantulawolf spider, hunting spidertickcentipedeblack grouseptarmiganruffed grouse, partridge, Bonasa umbellusprairie chicken, prairie grouse, prairie fowlpeacockquailpartridgeAfrican grey, African gray, Psittacus erithacusmacawsulphur-crested cockatoo, Kakatoe galerita, Cacatua galeritalorikeetcoucalbee eaterhornbillhummingbirdjacamartoucandrakered-breasted merganser, Mergus serratorgooseblack swan, Cygnus atratustuskerechidna, spiny anteater, anteaterplatypus, duckbill, duckbilled platypus, duck-billed platypus, Ornithorhynchus anatinuswallaby, brush kangarookoala, koala bear, kangaroo bear, native bear, Phascolarctos cinereuswombatjellyfishsea anemone, anemonebrain coralflatworm, platyhelminthnematode, nematode worm, roundwormconchsnailslugsea slug, nudibranchchiton, coat-of-mail shell, sea cradle, polyplacophorechambered nautilus, pearly nautilus, nautilusDungeness crab, Cancer magisterrock crab, Cancer irroratusfiddler crabking crab, Alaska crab, Alaskan king crab, Alaska king crab, Paralithodes camtschaticaAmerican lobster, Northern lobster, Maine lobster, Homarus americanusspiny lobster, langouste, rock lobster, crawfish, crayfish, sea crawfishcrayfish, crawfish, crawdad, crawdaddyhermit crabisopodwhite stork, Ciconia ciconiablack stork, Ciconia nigraspoonbillflamingolittle blue heron, Egretta caeruleaAmerican egret, great white heron, Egretta albusbitterncranelimpkin, Aramus pictusEuropean gallinule, Porphyrio porphyrioAmerican coot, marsh hen, mud hen, water hen, Fulica americanabustardruddy turnstone, Arenaria interpresred-backed sandpiper, dunlin, Erolia alpinaredshank, Tringa totanusdowitcheroystercatcher, oyster catcherpelicanking penguin, Aptenodytes patagonicaalbatross, mollymawkgrey whale, gray whale, devilfish, Eschrichtius gibbosus, Eschrichtius robustuskiller whale, killer, orca, grampus, sea wolf, Orcinus orcadugong, Dugong dugonsea lionChihuahuaJapanese spanielMaltese dog, Maltese terrier, MaltesePekinese, Pekingese, PekeShih-TzuBlenheim spanielpapillontoy terrierRhodesian ridgebackAfghan hound, Afghanbasset, basset houndbeaglebloodhound, sleuthhoundbluetickblack-and-tan coonhoundWalker hound, Walker foxhoundEnglish foxhoundredboneborzoi, Russian wolfhoundIrish wolfhoundItalian greyhoundwhippetIbizan hound, Ibizan PodencoNorwegian elkhound, elkhoundotterhound, otter houndSaluki, gazelle houndScottish deerhound, deerhoundWeimaranerStaffordshire bullterrier, Staffordshire bull terrierAmerican Staffordshire terrier, Staffordshire terrier, American pit bull terrier, pit bull terrierBedlington terrierBorder terrierKerry blue terrierIrish terrierNorfolk terrierNorwich terrierYorkshire terrierwire-haired fox terrierLakeland terrierSealyham terrier, SealyhamAiredale, Airedale terriercairn, cairn terrierAustralian terrierDandie Dinmont, Dandie Dinmont terrierBoston bull, Boston terrierminiature schnauzergiant schnauzerstandard schnauzerScotch terrier, Scottish terrier, ScottieXizang terrier, chrysanthemum dogsilky terrier, Sydney silkysoft-coated wheaten terrierWest Highland white terrierLhasa, Lhasa apsoflat-coated retrievercurly-coated retrievergolden retrieverLabrador retrieverChesapeake Bay retrieverGerman short-haired pointervizsla, Hungarian pointerEnglish setterIrish setter, red setterGordon setterBrittany spanielclumber, clumber spanielEnglish springer, English springer spanielWelsh springer spanielcocker spaniel, English cocker spaniel, cockerSussex spanielIrish water spanielkuvaszschipperkegroenendaelmalinoisbriardkelpiekomondorOld English sheepdog, bobtailShetland sheepdog, Shetland sheep dog, ShetlandcollieBorder collieBouvier des Flandres, Bouviers des FlandresRottweilerGerman shepherd, German shepherd dog, German police dog, alsatianDoberman, Doberman pinscherminiature pinscherGreater Swiss Mountain dogBernese mountain dogAppenzellerEntleBucherboxerbull mastiffXizang mastiffFrench bulldogGreat DaneSaint Bernard, St BernardEskimo dog, huskymalamute, malemute, Alaskan malamuteSiberian huskydalmatian, coach dog, carriage dogaffenpinscher, monkey pinscher, monkey dogbasenjipug, pug-dogLeonbergNewfoundland, Newfoundland dogGreat PyreneesSamoyed, SamoyedePomeranianchow, chow chowkeeshondBrabancon griffonPembroke, Pembroke Welsh corgiCardigan, Cardigan Welsh corgitoy poodleminiature poodlestandard poodleMexican hairlesstimber wolf, grey wolf, gray wolf, Canis lupuswhite wolf, Arctic wolf, Canis lupus tundrarumred wolf, maned wolf, Canis rufus, Canis nigercoyote, prairie wolf, brush wolf, Canis latransdingo, warrigal, warragal, Canis dingodhole, Cuon alpinusAfrican hunting dog, hyena dog, Cape hunting dog, Lycaon pictushyena, hyaenared fox, Vulpes vulpeskit fox, Vulpes macrotisArctic fox, white fox, Alopex lagopusgrey fox, gray fox, Urocyon cinereoargenteustabby, tabby cattiger catPersian catSiamese cat, SiameseEgyptian catcougar, puma, catamount, mountain lion, painter, panther, Felis concolorlynx, catamountleopard, Panthera pardussnow leopard, ounce, Panthera unciajaguar, panther, Panthera onca, Felis oncalion, king of beasts, Panthera leotiger, Panthera tigrischeetah, chetah, Acinonyx jubatusbrown bear, bruin, Ursus arctosAmerican black bear, black bear, Ursus americanus, Euarctos americanusice bear, polar bear, Ursus Maritimus, Thalarctos maritimussloth bear, Melursus ursinus, Ursus ursinusmongoosemeerkat, mierkattiger beetleladybug, ladybeetle, lady beetle, ladybird, ladybird beetleground beetle, carabid beetlelong-horned beetle, longicorn, longicorn beetleleaf beetle, chrysomeliddung beetlerhinoceros beetleweevilflybeeant, emmet, pismiregrasshopper, hoppercricketwalking stick, walkingstick, stick insectcockroach, roachmantis, mantidcicada, cicalaleafhopperlacewing, lacewing flydragonfly, darning needle, devil's darning needle, sewing needle, snake feeder, snake doctor, mosquito hawk, skeeter hawkdamselflyadmiralringlet, ringlet butterflymonarch, monarch butterfly, milkweed butterfly, Danaus plexippuscabbage butterflysulphur butterfly, sulfur butterflylycaenid, lycaenid butterflystarfish, sea starsea urchinsea cucumber, holothurianwood rabbit, cottontail, cottontail rabbithareAngora, Angora rabbithamsterporcupine, hedgehogfox squirrel, eastern fox squirrel, Sciurus nigermarmotbeaverguinea pig, Cavia cobayasorrelzebrahog, pig, grunter, squealer, Sus scrofawild boar, boar, Sus scrofawarthoghippopotamus, hippo, river horse, Hippopotamus amphibiusoxwater buffalo, water ox, Asiatic buffalo, Bubalus bubalisbisonram, tupbighorn, bighorn sheep, cimarron, Rocky Mountain bighorn, Rocky Mountain sheep, Ovis canadensisibex, Capra ibexhartebeestimpala, Aepyceros melampusgazelleArabian camel, dromedary, Camelus dromedariusllamaweaselminkpolecat, fitch, foulmart, foumart, Mustela putoriusblack-footed ferret, ferret, Mustela nigripesotterskunk, polecat, wood pussybadgerarmadillothree-toed sloth, ai, Bradypus tridactylusorangutan, orang, orangutang, Pongo pygmaeusgorilla, Gorilla gorillachimpanzee, chimp, Pan troglodytesgibbon, Hylobates larsiamang, Hylobates syndactylus, Symphalangus syndactylusguenon, guenon monkeypatas, hussar monkey, Erythrocebus patasbaboonmacaquelangurcolobus, colobus monkeyproboscis monkey, Nasalis larvatusmarmosetcapuchin, ringtail, Cebus capucinushowler monkey, howlertiti, titi monkeyspider monkey, Ateles geoffroyisquirrel monkey, Saimiri sciureusMadagascar cat, ring-tailed lemur, Lemur cattaindri, indris, Indri indri, Indri brevicaudatusIndian elephant, Elephas maximusAfrican elephant, Loxodonta africanalesser panda, red panda, panda, bear cat, cat bear, Ailurus fulgensgiant panda, panda, panda bear, coon bear, Ailuropoda melanoleucabarracouta, snoekeelcoho, cohoe, coho salmon, blue jack, silver salmon, Oncorhynchus kisutchrock beauty, Holocanthus tricoloranemone fishsturgeongar, garfish, garpike, billfish, Lepisosteus osseuslionfishpuffer, pufferfish, blowfish, globefishabacusabayaacademic gown, academic robe, judge's robeaccordion, piano accordion, squeeze boxacoustic guitaraircraft carrier, carrier, flattop, attack aircraft carrierairlinerairship, dirigiblealtarambulanceamphibian, amphibious vehicleanalog clockapiary, bee houseapronashcan, trash can, garbage can, wastebin, ash bin, ash-bin, ashbin, dustbin, trash barrel, trash binassault rifle, assault gunbackpack, back pack, knapsack, packsack, rucksack, haversackbakery, bakeshop, bakehousebalance beam, beamballoonballpoint, ballpoint pen, ballpen, BiroBand Aidbanjobannister, banister, balustrade, balusters, handrailbarbellbarber chairbarbershopbarnbarometerbarrel, caskbarrow, garden cart, lawn cart, wheelbarrowbaseballbasketballbassinetbassoonbathing cap, swimming capbath towelbathtub, bathing tub, bath, tubbeach wagon, station wagon, wagon, estate car, beach waggon, station waggon, waggonbeacon, lighthouse, beacon light, pharosbeakerbearskin, busby, shakobeer bottlebeer glassbell cote, bell cotbibbicycle-built-for-two, tandem bicycle, tandembikini, two-piecebinder, ring-binderbinoculars, field glasses, opera glassesbirdhouseboathousebobsled, bobsleigh, bobbolo tie, bolo, bola tie, bolabonnet, poke bonnetbookcasebookshop, bookstore, bookstallbottlecapbowbow tie, bow-tie, bowtiebrass, memorial tablet, plaquebrassiere, bra, bandeaubreakwater, groin, groyne, mole, bulwark, seawall, jettybreastplate, aegis, egisbroombucket, pailbucklebulletproof vestbullet train, bulletbutcher shop, meat marketcab, hack, taxi, taxicabcaldron, cauldroncandle, taper, wax lightcannoncanoecan opener, tin openercardigancar mirrorcarousel, carrousel, merry-go-round, roundabout, whirligigcarpenter's kit, tool kitcartoncar wheelcash machine, cash dispenser, automated teller machine, automatic teller machine, automated teller, automatic teller, ATMcassettecassette playercastlecatamaranCD playercello, violoncellocellular telephone, cellular phone, cellphone, cell, mobile phonechainchainlink fencechain mail, ring mail, mail, chain armor, chain armour, ring armor, ring armourchain saw, chainsawchestchiffonier, commodechime, bell, gongchina cabinet, china closetChristmas stockingchurch, church buildingcinema, movie theater, movie theatre, movie house, picture palacecleaver, meat cleaver, choppercliff dwellingcloakclog, geta, patten, sabotcocktail shakercoffee mugcoffeepotcoil, spiral, volute, whorl, helixcombination lockcomputer keyboard, keypadconfectionery, confectionary, candy storecontainer ship, containership, container vesselconvertiblecorkscrew, bottle screwcornet, horn, trumpet, trumpcowboy bootcowboy hat, ten-gallon hatcradlecranecrash helmetcratecrib, cotCrock Potcroquet ballcrutchcuirassdam, dike, dykedeskdesktop computerdial telephone, dial phonediaper, nappy, napkindigital clockdigital watchdining table, boarddishrag, dishclothdishwasher, dish washer, dishwashing machinedisk brake, disc brakedock, dockage, docking facilitydogsled, dog sled, dog sleighdomedoormat, welcome matdrilling platform, offshore rigdrum, membranophone, tympandrumstickdumbbellDutch ovenelectric fan, blowerelectric guitarelectric locomotiveentertainment centerenvelopeespresso makerface powderfeather boa, boafile, file cabinet, filing cabinetfireboatfire engine, fire truckfire screen, fireguardflagpole, flagstaffflute, transverse flutefolding chairfootball helmetforkliftfountainfountain penfour-posterfreight carFrench horn, hornfrying pan, frypan, skilletfur coatgarbage truck, dustcartgasmask, respirator, gas helmetgas pump, gasoline pump, petrol pump, island dispensergobletgo-kartgolf ballgolfcart, golf cartgondolagong, tam-tamgowngrand piano, grandgreenhouse, nursery, glasshousegrille, radiator grillegrocery store, grocery, food market, marketguillotinehair slidehair sprayhalf trackhammerhamperhand blower, blow dryer, blow drier, hair dryer, hair drierhand-held computer, hand-held microcomputerhandkerchief, hankie, hanky, hankeyhard disc, hard disk, fixed diskharmonica, mouth organ, harp, mouth harpharpharvester, reaperhatchetholsterhome theater, home theatrehoneycombhook, clawhoopskirt, crinolinehorizontal bar, high barhorse cart, horse-carthourglassiPodiron, smoothing ironjack-o'-lanternjean, blue jean, denimjeep, landroverjersey, T-shirt, tee shirtjigsaw puzzlejinrikisha, ricksha, rickshawjoystickkimonoknee padknotlab coat, laboratory coatladlelampshade, lamp shadelaptop, laptop computerlawn mower, mowerlens cap, lens coverletter opener, paper knife, paperknifelibrarylifeboatlighter, light, igniter, ignitorlimousine, limoliner, ocean linerlipstick, lip rougeLoaferlotionloudspeaker, speaker, speaker unit, loudspeaker system, speaker systemloupe, jeweler's loupelumbermill, sawmillmagnetic compassmailbag, postbagmailbox, letter boxmaillotmaillot, tank suitmanhole covermaracamarimba, xylophonemaskmatchstickmaypolemaze, labyrinthmeasuring cupmedicine chest, medicine cabinetmegalith, megalithic structuremicrophone, mikemicrowave, microwave ovenmilitary uniformmilk canminibusminiskirt, miniminivanmissilemittenmixing bowlmobile home, manufactured homeModel Tmodemmonasterymonitormopedmortarmortarboardmosquemosquito netmotor scooter, scootermountain bike, all-terrain bike, off-roadermountain tentmouse, computer mousemousetrapmoving vanmuzzlenailneck bracenecklacenipplenotebook, notebook computerobeliskoboe, hautboy, hautboisocarina, sweet potatoodometer, hodometer, mileometer, milometeroil filterorgan, pipe organoscilloscope, scope, cathode-ray oscilloscope, CROoverskirtoxcartoxygen maskpacketpaddle, boat paddlepaddlewheel, paddle wheelpadlockpaintbrushpajama, pyjama, pj's, jammiespalacepanpipe, pandean pipe, syrinxpaper towelparachute, chuteparallel bars, barspark benchparking meterpassenger car, coach, carriagepatio, terracepay-phone, pay-stationpedestal, plinth, footstallpencil box, pencil casepencil sharpenerperfume, essencePetri dishphotocopierpick, plectrum, plectronpickelhaubepicket fence, palingpickup, pickup truckpierpiggy bank, penny bankpill bottlepillowping-pong ballpinwheelpirate, pirate shippitcher, ewerplane, carpenter's plane, woodworking planeplanetariumplastic bagplate rackplow, ploughplunger, plumber's helperPolaroid camera, Polaroid Land camerapolepolice van, police wagon, paddy wagon, patrol wagon, wagon, black Mariaponchopool table, billiard table, snooker tablepop bottle, soda bottlepot, flowerpotpotter's wheelpower drillprayer rug, prayer matprinterprison, prison houseprojectile, missileprojectorpuck, hockey puckpunching bag, punch bag, punching ball, punchballpursequill, quill penquilt, comforter, comfort, puffracer, race car, racing carracket, racquetradiatorradio, wirelessradio telescope, radio reflectorrain barrelrecreational vehicle, RV, R.V.reelreflex camerarefrigerator, iceboxremote control, remoterestaurant, eating house, eating place, eateryrevolver, six-gun, six-shooterriflerocking chair, rockerrotisserierubber eraser, rubber, pencil eraserrugby ballrule, rulerrunning shoesafesafety pinsaltshaker, salt shakersandalsarongsax, saxophonescabbardscale, weighing machineschool busschoonerscoreboardscreen, CRT screenscrewscrewdriverseat belt, seatbeltsewing machineshield, bucklershoe shop, shoe-shop, shoe storeshojishopping basketshopping cartshovelshower capshower curtainskiski masksleeping bagslide rule, slipsticksliding doorslot, one-armed banditsnorkelsnowmobilesnowplow, snowploughsoap dispensersoccer ballsocksolar dish, solar collector, solar furnacesombrerosoup bowlspace barspace heaterspace shuttlespatulaspeedboatspider web, spider's webspindlesports car, sport carspotlight, spotstagesteam locomotivesteel arch bridgesteel drumstethoscopestolestone wallstopwatch, stop watchstovestrainerstreetcar, tram, tramcar, trolley, trolley carstretcherstudio couch, day bedstupa, topesubmarine, pigboat, sub, U-boatsuit, suit of clothessundialsunglasssunglasses, dark glasses, shadessunscreen, sunblock, sun blockersuspension bridgeswab, swob, mopsweatshirtswimming trunks, bathing trunksswingswitch, electric switch, electrical switchsyringetable lamptank, army tank, armored combat vehicle, armoured combat vehicletape playerteapotteddy, teddy beartelevision, television systemtennis ballthatch, thatched rooftheater curtain, theatre curtainthimblethresher, thrasher, threshing machinethronetile rooftoastertobacco shop, tobacconist shop, tobacconisttoilet seattorchtotem poletow truck, tow car, wreckertoyshoptractortrailer truck, tractor trailer, trucking rig, rig, articulated lorry, semitraytrench coattricycle, trike, velocipedetrimarantripodtriumphal archtrolleybus, trolley coach, trackless trolleytrombonetub, vatturnstiletypewriter keyboardumbrellaunicycle, monocycleupright, upright pianovacuum, vacuum cleanervasevaultvelvetvending machinevestmentviaductviolin, fiddlevolleyballwaffle ironwall clockwallet, billfold, notecase, pocketbookwardrobe, closet, presswarplane, military planewashbasin, handbasin, washbowl, lavabo, wash-hand basinwasher, automatic washer, washing machinewater bottlewater jugwater towerwhiskey jugwhistlewigwindow screenwindow shadeWindsor tiewine bottlewingwokwooden spoonwool, woolen, woollenworm fence, snake fence, snake-rail fence, Virginia fencewreckyawlyurtweb site, website, internet site, sitecomic bookcrossword puzzle, crosswordstreet signtraffic light, traffic signal, stoplightbook jacket, dust cover, dust jacket, dust wrappermenuplateguacamoleconsommehot pot, hotpottrifleice cream, icecreamice lolly, lolly, lollipop, popsicleFrench loafbagel, beigelpretzelcheeseburgerhotdog, hot dog, red hotmashed potatohead cabbagebroccolicauliflowerzucchini, courgettespaghetti squashacorn squashbutternut squashcucumber, cukeartichoke, globe artichokebell peppercardoonmushroomGranny Smithstrawberryorangelemonfigpineapple, ananasbananajackfruit, jak, jackcustard applepomegranatehaycarbonarachocolate sauce, chocolate syrupdoughmeat loaf, meatloafpizza, pizza piepotpieburritored wineespressocupeggnogalpbubblecliff, drop, drop-offcoral reefgeyserlakeside, lakeshorepromontory, headland, head, forelandsandbar, sand barseashore, coast, seacoast, sea-coastvalley, valevolcanoballplayer, baseball playergroom, bridegroomscuba diverrapeseeddaisyyellow lady's slipper, yellow lady-slipper, Cypripedium calceolus, Cypripedium parviflorumcornacornhip, rose hip, rosehipbuckeye, horse chestnut, conkercoral fungusagaricgyromitrastinkhorn, carrion fungusearthstarhen-of-the-woods, hen of the woods, Polyporus frondosus, Grifola frondosaboleteear, spike, capitulumtoilet tissue, toilet paper, bathroom tissue
注意：
如果下载测试图像，label 名称文件以及模型权重太慢，可以使用浏览器下载：
在浏览器输入 https://hf-mirror.com/datasets/huggingface/cats-image/resolve/main/cats_image.jpeg，将下载好的图片放在 data/cats_image.jpeg下。
在浏览器输入 https://raw.githubusercontent.com/Lasagne/Recipes/master/examples/resnet50/imagenet_classes.txt，将下载好的 txt 文件放在data/imagenet_classes.txt下。
在浏览器输入 https://download.pytorch.org/models/resnet50-0676ba61.pth，将下载好的模型权重放在 root/.cache/torch/hub/checkpoints/resnet50-0676ba61.pth 下。
图像和 label 文件下载完成后，会先将图像进行 transform 以及变换为 batch 形式以适配网络输入；随后加载模型进行推理得到使用 Pytorch 的输出结果和推理时间；随后将模型转换为 TensorRT 形式并保存在 model/resnet50_trt.pth 下以便后续使用；最后使用 TensorRT 运行模型得到推理结果以及运行时间。输出结果如下（参考）：
download sample.download label file.Pytorch Predict class: tabby, tabby catPytorch Processing time: 0.1641Convert and save TensorRT model.TensorRT Predict class: tabby, tabby catTensorRT Processing time: 0.0549
出现以上结果表明模型运行成功。可以看到无论是使用 Pytorch 还是 TensorRT 跑出的结果都是 tabby，tabby cat，但使用 TensorRT 推理时的运行时间要远小于单纯 Pytorch 运行。
注意事项
说明：
由于 OpenCloudOS 是 TencentOS Server 的开源版本，理论上上述文档当中的所有操作同样适用于 OpenCloudOS。
参考文档
