qdtsne
A quick and dirty t-SNE C++ library
Loading...
Searching...
No Matches
Public Attributes | List of all members
qdtsne::Options Struct Reference

Options for initialize(). More...

#include <Options.hpp>

Public Attributes

double perplexity = 30
 
bool infer_perplexity = true
 
double theta = 1
 
int max_iterations = 1000
 
int stop_lying_iter = 250
 
int mom_switch_iter = 250
 
double start_momentum = 0.5
 
double final_momentum = 0.8
 
double eta = 200
 
double exaggeration_factor = 12
 
int max_depth = 20
 
bool leaf_approximation = false
 
int num_threads = 1
 

Detailed Description

Options for initialize().

Member Data Documentation

◆ eta

double qdtsne::Options::eta = 200

The learning rate, used to scale the updates. Larger values yield larger updates that speed up convergence to a local minima at the cost of stability.

◆ exaggeration_factor

double qdtsne::Options::exaggeration_factor = 12

Factor to scale the probabilities during the early exaggeration phase (see Options::stop_lying_iter).

◆ final_momentum

double qdtsne::Options::final_momentum = 0.8

Final momentum, to be used in the later iterations after the momentum switch.

◆ infer_perplexity

bool qdtsne::Options::infer_perplexity = true

Whether to infer the perplexity in initialize() methods that accept a NeighborList object. In such cases, the value in Options::perplexity is ignored. The perplexity is instead defined from the NeighborList as the number of nearest neighbors per point divided by 3.

◆ leaf_approximation

bool qdtsne::Options::leaf_approximation = false

Whether to replace a point with the center of mass of its leaf node when computing the repulsive forces to all other points. This allows the repulsive forces to be computed once per leaf node and then re-used across all points in that leaf node. The effectiveness of this option depends on Options::max_depth, which needs to be small enough so that many leaf nodes have multiple assigned points.

◆ max_depth

int qdtsne::Options::max_depth = 20

Maximum depth of the tree used in the Barnes-Hut approximation of the repulsive forces. This effectively replaces each point with the center of mass of the most fine-grained partition at the leaves of the tree. Setting this to a smaller value (e.g., 7 - 10) improves speed by bounding the depth of recursion, at the cost of some accuracy.

The default is to use a large value, which means that the tree's depth is unbounded for most practical applications. This aims to be consistent with the original implementation of the BH search, but with some protection against near-duplicate points that would otherwise result in unnecessary recursion.

◆ max_iterations

int qdtsne::Options::max_iterations = 1000

Maximum number of iterations to perform.

◆ mom_switch_iter

int qdtsne::Options::mom_switch_iter = 250

Number of iterations to perform before switching from the starting momentum to the final momentum.

The update to each point includes a small step in the direction of its previous update, i.e., there is some "momentum" from the previous update. This aims to speed up the optimization and to avoid local minima by effectively smoothing the updates. The starting momentum is usually smaller than the final momentum, to give a chance for the points to improve their organization before encouraging iteration to a specific local minima.

◆ num_threads

int qdtsne::Options::num_threads = 1

Number of threads to use. The parallelization scheme is determined by parallelize() for most calculations. The exception is the nearest-neighbor search in some of the initialize() overloads, where the scheme is determined by knncolle::parallelize() instead.

◆ perplexity

double qdtsne::Options::perplexity = 30

Perplexity value that determines the balance between local and global structure. Higher perplexities will focus on global structure, at the cost of increased runtime and decreased local resolution.

This option affects all initialize() methods except if precomputed neighbor search results are supplied and Options::infer_perplexity = true. In such cases, the perplexity is inferred from the number of neighbors per point in the supplied search results.

◆ start_momentum

double qdtsne::Options::start_momentum = 0.5

Starting momentum, to be used in the early iterations before the momentum switch.

◆ stop_lying_iter

int qdtsne::Options::stop_lying_iter = 250

Number of iterations to perform with exaggerated probabilities, as part of the early exaggeration phase.

In the early exaggeration phase, the probabilities are multiplied by Options::exaggeration_factor. This forces the algorithm to minimize the distances between neighbors, creating an embedding containing tight, well-separated clusters of neighboring cells. Because there is so much empty space, these clusters have an opportunity to move around to find better global positions before the phase ends and they are forced to settle down.

◆ theta

double qdtsne::Options::theta = 1

Amount of approximation to use in the Barnes-Hut calculation of repulsive forces. This is defined as the maximum \(s/d\) at which a group of points can be approximated by their center of mass, where \(s\) is the maximum width of the box containing all points in the group (i.e., the longest side across all dimensions) and \(d\) is the distance from a point to the center of mass. Lower values increase accuracy at the cost of computational time.


The documentation for this struct was generated from the following file: