Twins: revising the design of spatial attention in vision transformers
article: https://arxiv.org/abs/2104.13840
code: GitHub - Meituan-AutoML/Twins: Two simple and effective designs of vision transformer, which is on par with the Swin transformerTwo simple and effective designs of vision transformer, which is on par with the Swin transformer - GitHub - Meituan-AutoML/Twins: Two simple and effective designs of vi ...
Posted by devilincarnated on Mon, 18 Apr 2022 08:35:36 +0300
logistic regression and binary classification of iris based on TensorFlow
Learning notes of the second edition of Li Hang's statistical learning methods
Knowledge points
Classification algorithmBelongs to linear modelThe graph is an S-shaped curve, monotonically increasing, and the definition domain is (− ∞, + ∞) and the value domain is (0,1) Logistic regression compares the size of two condition ...
Posted by Placebo on Sun, 17 Apr 2022 09:48:54 +0300
Complete model training of Pytorch learning notes (taking Cifar10 as an example)
Introduction to data set
After learning the theory of deep learning, we should start code practice, which is basically divided into data reading, data preprocessing (enhancement), model construction and training
First, let's introduce the data set. The data set used this time is CIFAR10, which is a classic 10 classification color picture ...
Posted by ShadowIce on Sun, 17 Apr 2022 05:45:23 +0300
Machine learning notes - music generation using TensorFlow
1, Overview
Here, we will explore the construction of circular neural network (RNN) for music generation. We will train a model to learn the pattern in the original score of [ABC notation], and then use the model to generate new music.
1. On ABC notation
For an overview of ABC notation, you can check the following website.
What is ABC notat ...
Posted by johnseito on Sun, 17 Apr 2022 01:08:40 +0300
Introduction to machine learning: Chapter 12 svd algorithm
Machine learning series - SVD
SVD is Singular value decomposition.
An important decomposition form in linear algebra. The special meaning of its matrix can be used to deal with linear correlation. For example, in natural language processing, SVD method can be used for news classification, and good results have been achieved. The specific proc ...
Posted by harkonenn on Sat, 16 Apr 2022 04:31:52 +0300
Introduction to machine learning: Chapter 17 Boltzmann Boltzmann machine
Boltzmann Boltzmann machine
Based on the idea of simulated annealing, Hinton and Ackley introduced random mechanism into Hopfield model and proposed Boltzmann machine.
Like Hopfield model, the idea of Boltzmann machine is also the idea of energy. Hopfield model is a definite mechanism when calculating the state transition. Boltzmann machine i ...
Posted by joshuamd3 on Sat, 16 Apr 2022 04:28:52 +0300
PyTorch learning --- 1 Data sorting
PyTorch installation
To learn PyTorch, you need to install it first. The installation of PyTorch is relatively simple. If you won't, you can go directly to its official website, I'm the way to the official website , click and pull down to see the following picture: Most people will install the following version according to the type of machin ...
Posted by Ulujain on Sat, 16 Apr 2022 00:17:10 +0300
Machine learning -- eXtreme Gradient Boosting (XGBoost) model practice
XGBoost actual combat notes
In recent projects, XGBoost model is used as the Baseline for comparison. This article records some learning resources and some problems and solutions encountered in the process of writing code.
1. Learning resources
Original XGBoost paperInterpretation of XGBoost and its parametersXGBoost parameter adjustment met ...
Posted by wikedawsum on Thu, 14 Apr 2022 20:57:34 +0300
On single pass algorithm
On single pass algorithm
Official account: ChallengeHub
Single pass algorithm, also known as single channel method or single pass method, is a classical method of streaming data clustering. For the data streams arriving in turn, the method processes one data at a time according to the input order. According to the matching degree between the ...
Posted by river001 on Thu, 14 Apr 2022 16:28:04 +0300
Real time face recognition
Real time face recognition
executive summary
There are three steps in coding:
Step 1: collect face data and face detection
Step 2: training face recognition model
Step 3: face recognition reasoning
1, Installation environment
This paper adopts the combination of Python + opencv + opencv contrib, which can be transplanted to Linux s ...
Posted by lookee on Tue, 12 Apr 2022 03:06:16 +0300