libtorch study notes - MNIST combat

MNIST libtorch practical exercise Ready to work First download the MNIST database, http://yann.lecun.com/exdb/mnist/ After downloading, do not decompress it with software such as winrar. For example, t10k-images-idx3-ubyte is decompressed into t10k-images.idx3-ubyte. It is best to decompress it with tar in Linux environment. Suppose you unzip t ...

Posted by chrys on Wed, 25 May 2022 15:51:55 +0300

pytorch on GPU - training neural network with CUDA (pytorch series-30)

Running PyTorch code on GPU - neural network programming guide In this episode, we will learn how to use GPU and PyTorch. We will see how to use the general methods of GPU, and we will see how to apply these general techniques to train our neural networks. Deep learning using GPU If you haven't seen the episode about why deep learning and neur ...

Posted by bmbc on Mon, 23 May 2022 12:42:05 +0300

Using Docker to run HuggingFace massive model

This article will share how to quickly run the interesting model on Hugging Face locally through Docker. Run the model with less code and less time cost than the original project. If you are familiar with Python, most model projects can be deployed and run locally in about 10 minutes. Write in front In order to facilitate the display, I chos ...

Posted by besa on Sat, 21 May 2022 01:07:42 +0300

[PyTorch] Note 02: Autograd auto derivation

From PyTorch 1.4 tutorial Outline Tensor torch.autograd.backward If the result node is scalar If the result node is a vector [PyTorch] Note 02: Autograd auto derivation In PyTorch, the core of all neural networks is autograd package 1 Tensor torch.Tensor is the core class of this autograd A Tensor tensor usually records the following ...

Posted by rusbb on Thu, 19 May 2022 21:17:09 +0300

weibu's in-depth learning chapter: pytorch -- utils Data and torch vision

Overview of data processing toolbox Pytoch involves data processing (data loading, data preprocessing, data enhancement, etc.), and the main toolkits and related relationships are as follows: Overview of pytorch data processing toolkit torch.utils.data Toolkit 1) Dataset: abstract class. Other datasets should inherit this class and contain ...

Posted by sid on Sun, 15 May 2022 05:28:39 +0300

[pytorch] code implementation of ECA-NET attention mechanism applied to ResNet

1, Foreword Introduction to ECA-NET(CVPR 2020): Thesis title:ECA-Net: Effificient Channel Attention for Deep Convolutional Neural NetworksThesis address:https://arxiv.org/abs/1910.03151Open source code:https://github.com/BangguWu/ECANet As a lightweight attention mechanism, ECA net is actually an implementation form of channel attention mecha ...

Posted by phpflixnewbie on Sun, 15 May 2022 01:47:39 +0300

CASIA-HWDB2.x (offline) data set is merged into page type and marked with row-level bbox

Recently, I will do line-level handwritten document detection work, merge CASIA-HWDB2.x (offline) data, and generate a page-level dataset with corresponding bbox. If you want to exchange ocr-related work, you can join the group (at the end of the article): CASIA-HWDB2.x (offline) data set download address: http://www.nlpr.ia.ac.cn/databases/ha ...

Posted by nwoeddie23 on Sat, 14 May 2022 10:42:27 +0300

pytorch collate_fn function to realize variable length batch - Dynamic padding

Note: batch here refers to mini batch Two methods to realize sequence (text, log) batch processing Fixed length batches (uniform length batches) All batch sequences have the same length. For example, seqs = [[1,2,3,3,4,5,6,7], [1,2,3], [2,4,1,2,3], [1,2,4,1]] batch_size = 2 Then the maximum sequence length is 8. If it is less than 8, fill it ...

Posted by sonic_2k_uk on Sat, 14 May 2022 05:21:32 +0300

[PyTorch learning notes] 1.2 introduction to tensor

thumbnail: https://image.zhangxiann.com/...toc: truedate: 2020/2/5 20:39:20disqusId: zhangxiancategories: PyTorch tags: AI Deep Learning Code of this chapter: https://github.com/zhangxiann/PyTorch_Practice/blob/master/lesson1/tensor_introduce1.py https://github.com/zhangxiann/PyTorch_Practice/blob/master/lesson1/tensor_introduce1.py Tensor c ...

Posted by sean14592 on Wed, 11 May 2022 06:42:57 +0300

Knowledge map tracing 1.1 -- starting from NER

Overview of this article: recurrence of knowledge- KG open source project set Medium BERT-NER-pytorch Some learning records after the project are of reference significance to Xiaobai, who is also a newcomer. Data: about the introduction of transformer in BERT model, what must be shared is Animation of Jay Alammar , why didn't I see such a good ...

Posted by MartiniMan on Sun, 08 May 2022 05:09:16 +0300