Data cleaning#

Size#

cols	Returns number of columns in a matrix, string array or dataframe.
getdims	Returns the number of dimensions in a matrix, string array or n-dimensional array.
getorders	Returns the dimensions corresponding to matrix, string array or n-dimensional array.
rows	Returns number of rows in a matrix, string array or dataframe.

Selection#

delcols	Removes variables from a dataframe specified by index or name.
delif	Removes rows of data based on a logical expression.
delrows	Removes observations (rows) from a dataframe by index.
diag	Extracts the diagonal of a matrix.
getmatrix	Gets a contiguous matrix from an N-dimensional array.
head	Returns the first `n` rows of a matrix, dataframe or string array.
selif	Keeps rows of data based on a logical expression.
submat	Extracts a submatrix from a matrix.
subvec	Extracts an Nx1 vector of elements from an NxK matrix.
tail	Returns the last `n` rows of a matrix, dataframe or string array.
trimr	Trims rows from the top or bottom.

Merging#

innerJoin	Performs a left, or full, outer join on two matrices based upon user-specified key columns.
insertcols	Inserts one or more new columns into a matrix or dataframe at a specified location.
outerJoin	Joins two matrices, or dataframes based upon user-specified key columns, with non-matching rows removed.
where	Returns elements from `a` or `b`, depending on `condition`.

Duplicate observations#

dropduplicates	Drops duplicate observations from data.
getduplicates	Identifies duplicate observations and prints report.
isunique	Checks if all observations in the matrix or dataframe are unique.
isrowunique	Returns a binary vector with a one for every row that is unique, otherwise a zero.

Missing values#

impute	Replaces missing values in the columns of a matrix by a specified imputation method.
isinfnanmiss	Returns true if the argument contains an infinity, NaN, or missing value.
ismiss	Returns 1 if matrix has any missing values, 0 otherwise.
miss, missrv	Creates a scalar missing value, or converts (or replaces) specified elements in a matrix to GAUSS’s missing value code.
missex	Converts numeric values to the missing value code according to the values given in a logical expression.
msym	Controls the symbol printed to represent missing values.
packr	Deletes the rows of a matrix that contain any missing values.
scalmiss	Returns 1 if the input is a scalar missing value.

Searching#

between	Indicates whether elements in a matrix fall between a specified lower and upper bound.
contains	Indicates whether one matrix, multidimensional array or string array contains any elements from another symbol.
counts	Returns number of elements of a vector falling in specified ranges.
countwts	Returns weighted count of elements of a vector falling in specified ranges.
indexcat	Returns indices of elements falling within a specified range.
indnv	Checks one numeric vector against another and returns the indices of the elements of the first vector in the second vector.
isempty	Checks whether a symbol is an empty matrix.
ismember	Checks whether each element of a matrix or string array matches any element from a separate symbol.
maxindc	Returns row number of largest element in each column of a matrix.
minindc	Returns row number of smallest element in each column of a matrix.
rowcontains	Checks whether any element in the row of a matrix or string array matches any element from a separate symbol.

Sorting and set functions#

intrsect	Returns the intersection of two vectors.
setdif	Returns the unique elements in one vector that are not present in a second vector.
sortc	Sorts a numeric matrix, character matrix or string array.
sortind, sortindc	Returns the sorted index of x.
sortmc	Sorts a matrix on multiple columns.
sortr, sortrc	Sorts the columns of a matrix of numeric or character data, with respect to a specified row.
union	Returns the union of two vectors.
unique	Sorts and removes duplicate elements from a vector.
uniqindx	Computes the sorted index of x, leaving out duplicate elements.

String and categorical variables#

getcollabels	Returns the unique set of column labels and corresponding key values for a categorical variable.
recodeCatLabels	Replaces the labels in a categorical variable of a dataframe.
reorderCatLabels	Changes the order of the labels in a categorical variable of a dataframe.
setBaseCat	Sets a specified category to be the base case for a categorical variable.

These functions can be used to fix errors in categorical labels.

strreplace	Replaces a substring within a categorical label or string element.
strtof	Converts a string or categorical variable of a dataframe to a numeric variable.
strtrim	Strips all white space characters from the left and right side of each element in a categorical variable or string array.
strtriml	Strips all white space characters from the left side of each element in a categorical variable or string array.
strtrimr	Strips all white space characters from the right side of each element in a categorical variable or string array.

Transform#

code	Allows a new variable to be created (coded) with different values depending upon which one of a set of logical expressions is true.
dfLonger	Converts a GAUSS dataframe in wide panel format to long panel format.
dfWider	Converts a GAUSS dataframe in long panel format to wide panel format.
diagrv	Inserts a vector into the diagonal of a matrix.
dummy	Creates a set of dummy (0/1) variables by breaking up a variable into specified categories. The highest (rightmost) category is unbounded on the right.
dummybr	Creates a set of dummy (0/1) variables. The highest (rightmost) category is bounded on the right.
dummydn	Creates a set of dummy (0/1) variables by breaking up a variable into specified categories. The highest (rightmost) category is unbounded on the right, and a specified column of dummies is dropped.
lagn	Lags (or leads) a matrix a specified number of time periods for time series analysis.
lagTrim	Lags (or leads) a vector a specified number of time periods and removes the incomplete rows.
maxv	Performs an element by element comparison of two matrices and returns the maximum value for each element.
minv	Performs an element by element comparison of two matrices and returns the minimum value for each element.
order	Reorder a matrix based on user-specified ordering. Relocates columns to the beginning of the dataset in the order in which the variables are specified.
reclassify	Replaces specified values of a matrix, array or string array
reclassifyCuts	Replaces values of a matrix or array within specified ranges
rev	Reverses the order of rows of a matrix.
reshape	Reshapes a dataframe, matrix or string array to new dimensions.
rotater	Rotates the rows of a matrix, wrapping elements as necessary.
shiftc	Shifts, lags or leads, columns of a matrix, filling in holes with a specified value.
shiftr	Shifts rows of a matrix, filling in holes with a specified value.
subscat	Changes the values in a vector depending on the category a particular element falls in.
substute	Substitutes new values for old values in a matrix, depending on the outcome of a logical expression.
vec, vecr	Stacks columns or rows of a matrix to form a single column.
vech	Reshapes the lower triangular portion of a symmetric matrix into a column vector.
xpnd	Expands a column vector into a symmetric matrix.

Scaling and normalization#

rescale

Scales the columns of a matrix using a specified centering and scaling method.