Twins: revising the design of spatial attention in vision transformers

article: https://arxiv.org/abs/2104.13840 code: GitHub - Meituan-AutoML/Twins: Two simple and effective designs of vision transformer, which is on par with the Swin transformerTwo simple and effective designs of vision transformer, which is on par with the Swin transformer - GitHub - Meituan-AutoML/Twins: Two simple and effective designs of vi ...

Posted by devilincarnated on Mon, 18 Apr 2022 08:35:36 +0300

logistic regression and binary classification of iris based on TensorFlow

Learning notes of the second edition of Li Hang's statistical learning methods Knowledge points Classification algorithmBelongs to linear modelThe graph is an S-shaped curve, monotonically increasing, and the definition domain is (− ∞, + ∞) and the value domain is (0,1) Logistic regression compares the size of two condition ...

Posted by Placebo on Sun, 17 Apr 2022 09:48:54 +0300

Complete model training of Pytorch learning notes (taking Cifar10 as an example)

Introduction to data set After learning the theory of deep learning, we should start code practice, which is basically divided into data reading, data preprocessing (enhancement), model construction and training First, let's introduce the data set. The data set used this time is CIFAR10, which is a classic 10 classification color picture ...

Posted by ShadowIce on Sun, 17 Apr 2022 05:45:23 +0300

Machine learning notes - music generation using TensorFlow

1, Overview Here, we will explore the construction of circular neural network (RNN) for music generation. We will train a model to learn the pattern in the original score of [ABC notation], and then use the model to generate new music. 1. On ABC notation For an overview of ABC notation, you can check the following website. What is ABC notat ...

Posted by johnseito on Sun, 17 Apr 2022 01:08:40 +0300

Introduction to machine learning: Chapter 12 svd algorithm

Machine learning series - SVD SVD is Singular value decomposition. An important decomposition form in linear algebra. The special meaning of its matrix can be used to deal with linear correlation. For example, in natural language processing, SVD method can be used for news classification, and good results have been achieved. The specific proc ...

Posted by harkonenn on Sat, 16 Apr 2022 04:31:52 +0300

Introduction to machine learning: Chapter 17 Boltzmann Boltzmann machine

Boltzmann Boltzmann machine Based on the idea of simulated annealing, Hinton and Ackley introduced random mechanism into Hopfield model and proposed Boltzmann machine. Like Hopfield model, the idea of Boltzmann machine is also the idea of energy. Hopfield model is a definite mechanism when calculating the state transition. Boltzmann machine i ...

Posted by joshuamd3 on Sat, 16 Apr 2022 04:28:52 +0300

PyTorch learning --- 1 Data sorting

PyTorch installation To learn PyTorch, you need to install it first. The installation of PyTorch is relatively simple. If you won't, you can go directly to its official website, I'm the way to the official website , click and pull down to see the following picture: Most people will install the following version according to the type of machin ...

Posted by Ulujain on Sat, 16 Apr 2022 00:17:10 +0300

Machine learning -- eXtreme Gradient Boosting (XGBoost) model practice

XGBoost actual combat notes In recent projects, XGBoost model is used as the Baseline for comparison. This article records some learning resources and some problems and solutions encountered in the process of writing code. 1. Learning resources Original XGBoost paperInterpretation of XGBoost and its parametersXGBoost parameter adjustment met ...

Posted by wikedawsum on Thu, 14 Apr 2022 20:57:34 +0300

On single pass algorithm

On single pass algorithm Official account: ChallengeHub Single pass algorithm, also known as single channel method or single pass method, is a classical method of streaming data clustering. For the data streams arriving in turn, the method processes one data at a time according to the input order. According to the matching degree between the ...

Posted by river001 on Thu, 14 Apr 2022 16:28:04 +0300

Real time face recognition

Real time face recognition executive summary There are three steps in coding: Step 1: collect face data and face detection Step 2: training face recognition model Step 3: face recognition reasoning 1, Installation environment This paper adopts the combination of Python + opencv + opencv contrib, which can be transplanted to Linux s ...

Posted by lookee on Tue, 12 Apr 2022 03:06:16 +0300