title: SYMBA: Symbolic Computation of Squared Amplitudes in High Energy Physics with Machine Learning

abstract: The cross section is one of the most important physical quantities in high-energy physics and the most time consuming to compute. While machine learning has proven to be highly successful in numerical calculations in high-energy physics, analytical calculations using machine learning are still in their infancy. In this work, we use a sequence-to-sequence model, specifically, a transformer, to compute a key element of the cross section calculation, namely, the squared amplitude of an interaction. We show that a transformer model is able to predict correctly 97.6% and 99% of squared amplitudes of QCD and QED processes, respectively, at a speed that is up to orders of magnitude faster than current symbolic computation frameworks. We discuss the performance of the current model, its limitations and possible future directions for this work.


title: Lectures on Quantum Groups and Yang-Baxter Equations

abstract: The principles of the theory of quantum groups are reviewed from the point of view of the possibility of their use for deformations of symmetries in physical models. The R-matrix approach to the theory of quantum groups is discussed in detail and is taken as the basis of the quantization of classical Lie groups, as well as some Lie supergroups. We start by laying out the foundations of non-commutative and non-cocommutative Hopf algebras. Much attention has been paid to Hecke and Birman-Murakami-Wenzl (BMW) R-matrices and related quantum matrix algebras. Trigonometric solutions of the Yang-Baxter equation associated with the quantum groups GL_q(N), SO_q(N), Sp_q(2n) and supergroups GL_q(N|M), Osp_q(N|2m), as well as their rational (Yangian) limits, are presented. Rational R-matrices for exceptional Lie algebras and elliptic solutions of the Yang-Baxter equation are also considered. The basic concepts of the group algebra of the braid group and its finite dimensional quotients (such as Hecke and BMW algebras) are outlined. A sketch of the representation theories of the Hecke and BMW algebras is given (including methods for finding idempotents and their quantum dimensions). Applications of the theory of quantum groups and Yang-Baxter equations in various areas of theoretical physics are briefly discussed.


title: Colonoscopy 3D Video Dataset with Paired Depth from 2D-3D Registration

abstract: Screening colonoscopy is an important clinical application for several 3D computer vision techniques, including depth estimation, surface reconstruction, and missing region detection. However, the development, evaluation, and comparison of these techniques in real colonoscopy videos remain largely qualitative due to the difficulty of acquiring ground truth data. In this work, we present a Colonoscopy 3D Video Dataset (C3VD) acquired with a high definition clinical colonoscope and high-fidelity colon models for benchmarking computer vision methods in colonoscopy. We introduce a novel multimodal 2D-3D registration technique to register optical video sequences with ground truth rendered views of a known 3D model. The different modalities are registered by transforming optical images to depth maps with a Generative Adversarial Network and aligning edge features with an evolutionary optimizer. This registration method achieves an average translation error of 0.321 millimeters and an average rotation error of 0.159 degrees in simulation experiments where error-free ground truth is available. The method also leverages video information, improving registration accuracy by 55.6% for translation and 60.4% for rotation compared to single frame registration. 22 short video sequences were registered to generate 10,015 total frames with paired ground truth depth, surface normals, optical flow, occlusion, six degree-of-freedom pose, coverage maps, and 3D models. The dataset also includes screening videos acquired by a gastroenterologist with paired ground truth pose and 3D surface models. The dataset and registration source code are available at durr.jhu.edu/C3VD.


title: Mass-Zero constrained dynamics for simulations based on orbital-free density functional theory

abstract: A new algorithm for efficient and fully time-reversible integration of first-principles molecular dynamics based on orbital-free density functional theory (OFDFT) is presented. The algorithm adapts to this nontrivial case the recently introduced Mass-Zero (MaZe) constrained dynamics. The formalism ensures that full adiabatic separation is enforced between nuclear and electronic degrees of freedom and, consequently, that the exact Born-Oppenheimer probability for the nuclei is sampled. Numerical integration of the MaZe dynamics combines standard molecular dynamics algorithms, e.g. Verlet or velocity Verlet, with the SHAKE method to impose the minimum conditions on the electronic degrees of freedom as a set of constraints. The developments presented in this work, that include a bespoke adaptation of the standard SHAKE algorithm, ensure that the quasilinear scaling of OFDFT is preserved by the new method for a broad range of kinetic and exchange-correlation functionals, including nonlocal ones. The efficiency and accuracy of the approach is demonstrated via calculations of static and dynamic properties of liquid sodium in the constant energy and constant temperature ensembles.


title: What makes Ethereum blockchain transactions be processed fast or slow? An empirical study

abstract: The Ethereum platform allows developers to implement and deploy applications called Dapps onto the blockchain for public use through the use of smart contracts. To execute code within a smart contract, a paid transaction must be issued towards one of the functions that are exposed in the interface of a contract. However, such a transaction is only processed once one of the miners in the peer-to-peer network selects it, adds it to a block, and appends that block to the blockchain This creates a delay between transaction submission and code execution. It is crucial for Dapp developers to be able to precisely estimate when transactions will be processed, since this allows them to define and provide a certain Quality of Service (QoS) level (e.g., 95% of the transactions processed within 1 minute). However, the impact that different factors have on these times have not yet been studied. Processing time estimation services are used by Dapp developers to achieve predefined QoS. Yet, these services offer minimal insights into what factors impact processing times. Considering the vast amount of data that surrounds the Ethereum blockchain, changes in processing times are hard for Dapp developers to predict, making it difficult to maintain said QoS. In our study, we build random forest models to understand the factors that are associated with transaction processing times. We engineer several features that capture blockchain internal factors, as well as gas pricing behaviors of transaction issuers. By interpreting our models, we conclude that features surrounding gas pricing behaviors are very strongly associated with transaction processing times. Based on our empirical results, we provide Dapp developers with concrete insights that can help them provide and maintain high levels of QoS.


title: Set-theoretical solutions of simplex equations

abstract: The $n$-simplex equation ($n$-SE) was introduced by A. B. Zamolodchikov as a generalization of the Yang--Baxter equation, which is the $2$-simplex equation in these terms. In the present paper we suggest some general approaches to constructing solutions of $n$-simplex equations, describe some types of solutions, introduce an operation which under some conditions allows us to construct a solution of $(n+m+k)$-SE from solution of $(n+k)$-SE and $(m+k)$-SE. We consider the tropicalization of rational solutions and discuss a way to generalize it. We prove that if a group $G$ is an extension of a group $H$ by a group $K$, then we can find a solution of the $n$-SE on $G$ from solutions of this equation on $H$ and on $K$. Also, we find solutions of the parametric Yang-Baxter equation on $H$ with parameters in $K$. For studying solutions of the 3-simplex equations we introduce algebraic systems with ternary operations and give examples of these systems which gives solutions of the $3$-SE. We find all elementary verbal solutions of the $3$-SE on free groups.


title: Simulations for the Q statistic with constant and inverse variance weights for binary effect measures

abstract: Cochran's $Q$ statistic is routinely used for testing heterogeneity in meta-analysis. Its expected value (under an incorrect null distribution) is part of several popular estimators of the between-study variance, $\tau^2$. Those applications generally do not account for the studies' use of estimated variances in the inverse-variance weights that define $Q$ (more explicitly, $Q_{IV}$). Importantly, those weights make approximating the distribution of $Q_{IV}$ rather complicated. As an alternative, we are investigating a $Q$ statistic, $Q_F$, whose constant weights use only the studies' arm-level sample sizes. For log-odds-ratio, log-relative-risk, and risk difference as the measure of effect, these simulations study approximations to the distributions of $Q_F$ and $Q_{IV}$, as the basis for tests of heterogeneity. We present the results in 132 Figures, 153 pages in total.


title: Parameter region for multistationarity in $n-$site phosphorylation networks

abstract: Multisite phosphorylation is a signaling mechanism well known to give rise to multiple steady states, a property termed multistationarity. When phosphorylation occurs in a sequential and distributive manner, we obtain a family of networks indexed by the number of phosphorylation sites $n$. This work addresses the problem of understanding the parameter region where this family of networks displays multistationarity, by focusing on the projection of this region onto the set of kinetic parameters. The problem is phrased in the context of real algebraic geometry and reduced to studying whether a polynomial, defined as the determinant of a parametric matrix of size three, attains negative values over the positive orthant. The coefficients of the polynomial are functions of the kinetic parameters. For any $n$, we provide sufficient conditions for the polynomial to be positive and hence, preclude multistationarity, and also sufficient conditions for it to attain negative values and hence, enable multistationarity. These conditions are derived by exploiting the structure of the polynomial, its Newton polytope, and employing circuit polynomials. A relevant consequence of our results is that the set of kinetic parameters that enable or preclude multistationarity are both connected for all $n$.


title: Quantum Simulation of Z2 Lattice Gauge theory with minimal resources

abstract: The quantum simulation of fermionic gauge field theories is one of the anticipated uses of quantum computers in the NISQ era. Recently work has been done to simulate properties of the fermionic Z2 gauge field theory in (1+1) D and the pure gauge theory in (2+1) D. In this work, we investigate various options for simulating the fermionic Z2 gauge field theory in (2+1) D. To simulate the theory on a NISQ device it is vital to minimize both the number of qubits used and the circuit depth. In this work we propose ways to optimize both criteria for simulating time dynamics. In particular, we develop a new way to simulate this theory on a quantum computer, with minimal qubit requirements. We provide a quantum circuit, simulating a single first order Trotter step, that minimizes the number of 2-qubit gates needed and gives comparable results to methods requiring more qubits. Furthermore, variational approaches are investigated that allow to further decrease the circuit depth.


title: niksss at HinglishEval: Language-agnostic BERT-based Contextual Embeddings with Catboost for Quality Evaluation of the Low-Resource Synthetically Generated Code-Mixed Hinglish Text

abstract: This paper describes the system description for the HinglishEval challenge at INLG 2022. The goal of this task was to investigate the factors influencing the quality of the code-mixed text generation system. The task was divided into two subtasks, quality rating prediction and annotators disagreement prediction of the synthetic Hinglish dataset. We attempted to solve these tasks using sentence-level embeddings, which are obtained from mean pooling the contextualized word embeddings for all input tokens in our text. We experimented with various classifiers on top of the embeddings produced for respective tasks. Our best-performing system ranked 1st on subtask B and 3rd on subtask A.


title: The Combinatorics of Causality

abstract: We introduce and explore the notion of "spaces of input histories", a broad family of combinatorial objects which can be used to model input-dependent, dynamical causal order. We motivate our definition with reference to traditional partial order- and preorder-based notions of causal order, adopted by the majority of previous literature on the subject, and we proceed to explore the novel landscape of combinatorial complexity made available by our generalisation of those notions. In the process, we discover that the fine-grained structure of causality is significantly more complex than we might have previously believed: in the simplest case of binary inputs, the number of available "causally complete" spaces grows from 7 on 2 events, to 2644 on 3 events, to an unknown number on 4 events (likely around a billion). For perspective, previous literature on non-locality and contextuality used a single one of the 2644 available spaces on 3 events, work on definite causality used 19 spaces, derived from partial orders, and work on indefinite causality used only 6 more, for a grand total of 25. This paper is the first instalment in a trilogy: the sheaf-theoretic treatment of causal distributions is detailed in Part 2, "The Topology of Causality" [arXiv:2303.07148], while the polytopes formed by the associated empirical models are studied in Part 3, "The Geometry of Causality" [arXiv:2303.09017]. An exhaustive classification of the 2644 causally complete spaces on 3 events with binary inputs is provided in the supplementary work "Classification of causally complete spaces on 3 events with binary inputs", together with the algorithm used for the classification and partial results from the ongoing search on 4 events.


title: Estimating Quantum Hamiltonians via Joint Measurements of Noisy Non-Commuting Observables

abstract: Estimation of expectation values of incompatible observables is an essential practical task in quantum computing, especially for approximating energies of chemical and other many-body quantum systems. In this work we introduce a method for this purpose based on performing a single joint measurement that can be implemented locally and whose marginals yield noisy (unsharp) versions of the target set of non-commuting Pauli observables. We derive bounds on the number of experimental repetitions required to estimate energies up to a certain precision. We compare this strategy to the classical shadow formalism and show that our method yields the same performance as the locally biased classical shadow protocol. We also highlight some general connections between the two approaches by showing that classical shadows can be used to construct joint measurements and vice versa. Finally, we adapt the joint measurement strategy to minimise the sample complexity when the implementation of measurements is assumed noisy. This can provide significant efficiency improvements compared to known generalisations of classical shadows to noisy scenarios.


title: Automorphisms of del Pezzo surfaces of degree 2 in characteristic 2

abstract: We find normal forms for del Pezzo surfaces of degree $2$ over algebraically closed fields of characteristic $2$. For each normal form, we describe the structure of the group of automorphisms of the surface. In particular, we classify all finite groups that can act on such del Pezzo surfaces.


title: Graphs with Sudoku number $n-1$

abstract: Recently Lau-Jeyaseeli-Shiu-Arumugam introduced the concept of the "Sudoku colourings" of graphs -- partial $\chi(G)$-colourings of $G$ that have a unique extension to a proper $\chi(G)$-colouring of all the vertices. They introduced the Sudoku number of a graph as the minimal number of coloured vertices in a Sudoku colouring. They conjectured that a connected graph has Sudoku number $n-1$ if, and only if, it is complete. In this note we prove that this is true.


title: Two-qubit gate in neutral atoms using transitionless quantum driving

abstract: A neutral-atom system serves as a promising platform for realizing gate-based quantum computing because of its capability to trap and control several atomic qubits in different geometries and the ability to perform strong, long-range interactions between qubits; however, the two-qubit entangling gate fidelity lags behind competing platforms such as superconducting systems and trapped ions. The aim of our work is to design a fast, robust, high-fidelity controlled-Z (CZ) gate, based on the Rydberg-blockade mechanism, for neutral atoms. We propose a gate procedure that relies on simultaneous and transitionless quantum driving of a pair of atoms using broadband lasers. By simulating a system of two interacting Caesium atoms, including spontaneous emission from excited levels and parameter fluctuations, we yield a Rydberg-blockade CZ gate with fidelity 0.9985 over an operation time of $0.12~\mu$s. Our gate procedure delivers CZ gates that are superior than the state-of-the-art experimental CZ gate and the simulated CZ gates based on adiabatic driving of atoms. Our results show that our gate procedure carries significant potential for achieving scalable quantum computing using neutral atoms.


title: Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Tasks

abstract: We propose Unified-IO, a model that performs a large variety of AI tasks spanning classical computer vision tasks, including pose estimation, object detection, depth estimation and image generation, vision-and-language tasks such as region captioning and referring expression, to natural language processing tasks such as question answering and paraphrasing. Developing a single unified model for such a large variety of tasks poses unique challenges due to the heterogeneous inputs and outputs pertaining to each task, including RGB images, per-pixel maps, binary masks, bounding boxes, and language. We achieve this unification by homogenizing every supported input and output into a sequence of discrete vocabulary tokens. This common representation across all tasks allows us to train a single transformer-based architecture, jointly on over 90 diverse datasets in the vision and language fields. Unified-IO is the first model capable of performing all 7 tasks on the GRIT benchmark and produces strong results across 16 diverse benchmarks like NYUv2-Depth, ImageNet, VQA2.0, OK-VQA, Swig, VizWizGround, BoolQ, and SciTail, with no task-specific fine-tuning. Code and demos for Unified-IO are available at: https://unified-io.allenai.org.


title: The Open Catalyst 2022 (OC22) Dataset and Challenges for Oxide Electrocatalysts

abstract: The development of machine learning models for electrocatalysts requires a broad set of training data to enable their use across a wide variety of materials. One class of materials that currently lacks sufficient training data is oxides, which are critical for the development of OER catalysts. To address this, we developed the OC22 dataset, consisting of 62,331 DFT relaxations (~9,854,504 single point calculations) across a range of oxide materials, coverages, and adsorbates. We define generalized total energy tasks that enable property prediction beyond adsorption energies; we test baseline performance of several graph neural networks; and we provide pre-defined dataset splits to establish clear benchmarks for future efforts. In the most general task, GemNet-OC sees a ~36% improvement in energy predictions when combining the chemically dissimilar OC20 and OC22 datasets via fine-tuning. Similarly, we achieved a ~19% improvement in total energy predictions on OC20 and a ~9% improvement in force predictions in OC22 when using joint training. We demonstrate the practical utility of a top performing model by capturing literature adsorption energies and important OER scaling relationships. We expect OC22 to provide an important benchmark for models seeking to incorporate intricate long-range electrostatic and magnetic interactions in oxide surfaces. Dataset and baseline models are open sourced, and a public leaderboard is available to encourage continued community developments on the total energy tasks and data.


title: Learning a Single Neuron with Adversarial Label Noise via Gradient Descent

abstract: We study the fundamental problem of learning a single neuron, i.e., a function of the form $\mathbf{x}\mapsto\sigma(\mathbf{w}\cdot\mathbf{x})$ for monotone activations $\sigma:\mathbb{R}\mapsto\mathbb{R}$, with respect to the $L_2^2$-loss in the presence of adversarial label noise. Specifically, we are given labeled examples from a distribution $D$ on $(\mathbf{x}, y)\in\mathbb{R}^d \times \mathbb{R}$ such that there exists $\mathbf{w}^\ast\in\mathbb{R}^d$ achieving $F(\mathbf{w}^\ast)=\epsilon$, where $F(\mathbf{w})=\mathbf{E}_{(\mathbf{x},y)\sim D}[(\sigma(\mathbf{w}\cdot \mathbf{x})-y)^2]$. The goal of the learner is to output a hypothesis vector $\mathbf{w}$ such that $F(\mathbb{w})=C\, \epsilon$ with high probability, where $C>1$ is a universal constant. As our main contribution, we give efficient constant-factor approximate learners for a broad class of distributions (including log-concave distributions) and activation functions. Concretely, for the class of isotropic log-concave distributions, we obtain the following important corollaries: For the logistic activation, we obtain the first polynomial-time constant factor approximation (even under the Gaussian distribution). Our algorithm has sample complexity $\widetilde{O}(d/\epsilon)$, which is tight within polylogarithmic factors. For the ReLU activation, we give an efficient algorithm with sample complexity $\tilde{O}(d\, \polylog(1/\epsilon))$. Prior to our work, the best known constant-factor approximate learner had sample complexity $\tilde{\Omega}(d/\epsilon)$. In both of these settings, our algorithms are simple, performing gradient-descent on the (regularized) $L_2^2$-loss. The correctness of our algorithms relies on novel structural results that we establish, showing that (essentially all) stationary points of the underlying non-convex loss are approximately optimal.


title: VLMixer: Unpaired Vision-Language Pre-training via Cross-Modal CutMix

abstract: Existing vision-language pre-training (VLP) methods primarily rely on paired image-text datasets, which are either annotated by enormous human labors, or crawled from the internet followed by elaborate data cleaning techniques. To reduce the dependency on well-aligned image-text pairs, it is promising to directly leverage the large-scale text-only and image-only corpora. This paper proposes a data augmentation method, namely cross-modal CutMix (CMC), for implicit cross-modal alignment learning in unpaired VLP. Specifically, CMC transforms natural sentences from the textual view into a multi-modal view, where visually-grounded words in a sentence are randomly replaced by diverse image patches with similar semantics. There are several appealing proprieties of the proposed CMC. First, it enhances the data diversity while keeping the semantic meaning intact for tackling problems where the aligned data are scarce; Second, by attaching cross-modal noise on uni-modal data, it guides models to learn token-level interactions across modalities for better denoising. Furthermore, we present a new unpaired VLP method, dubbed as VLMixer, that integrates CMC with contrastive learning to pull together the uni-modal and multi-modal views for better instance-level alignments among different modalities. Extensive experiments on five downstream tasks show that VLMixer could surpass previous state-of-the-art unpaired VLP methods.


title: VectorMapNet: End-to-end Vectorized HD Map Learning

abstract: Autonomous driving systems require High-Definition (HD) semantic maps to navigate around urban roads. Existing solutions approach the semantic mapping problem by offline manual annotation, which suffers from serious scalability issues. Recent learning-based methods produce dense rasterized segmentation predictions to construct maps. However, these predictions do not include instance information of individual map elements and require heuristic post-processing to obtain vectorized maps. To tackle these challenges, we introduce an end-to-end vectorized HD map learning pipeline, termed VectorMapNet. VectorMapNet takes onboard sensor observations and predicts a sparse set of polylines in the bird's-eye view. This pipeline can explicitly model the spatial relation between map elements and generate vectorized maps that are friendly to downstream autonomous driving tasks. Extensive experiments show that VectorMapNet achieve strong map learning performance on both nuScenes and Argoverse2 dataset, surpassing previous state-of-the-art methods by 14.2 mAP and 14.6mAP. Qualitatively, VectorMapNet is capable of generating comprehensive maps and capturing fine-grained details of road geometry. To the best of our knowledge, VectorMapNet is the first work designed towards end-to-end vectorized map learning from onboard observations. Our project website is available at \url{https://tsinghua-mars-lab.github.io/vectormapnet/}.


title: Efficiently Learning Single-Arm Fling Motions to Smooth Garments

abstract: Recent work has shown that 2-arm "fling" motions can be effective for garment smoothing. We consider single-arm fling motions. Unlike 2-arm fling motions, which require little robot trajectory parameter tuning, single-arm fling motions are very sensitive to trajectory parameters. We consider a single 6-DOF robot arm that learns fling trajectories to achieve high garment coverage. Given a garment grasp point, the robot explores different parameterized fling trajectories in physical experiments. To improve learning efficiency, we propose a coarse-to-fine learning method that first uses a multi-armed bandit (MAB) framework to efficiently find a candidate fling action, which it then refines via a continuous optimization method. Further, we propose novel training and execution-time stopping criteria based on fling outcome uncertainty; the training-time stopping criterion increases data efficiency while the execution-time stopping criteria leverage repeated fling actions to increase performance. Compared to baselines, the proposed method significantly accelerates learning. Moreover, with prior experience on similar garments collected through self-supervision, the MAB learning time for a new garment is reduced by up to 87%. We evaluate on 36 real garments: towels, T-shirts, long-sleeve shirts, dresses, sweat pants, and jeans. Results suggest that using prior experience, a robot requires under 30 minutes to learn a fling action for a novel garment that achieves 60-94% coverage.


title: On the closed-form expected NPVs of double barrier strategies for regular diffusions

abstract: The core of the research is to provide the explicit expression for the expected net present values (NPVs) of double barrier strategies for regular diffusions on the real line without solving differential equations. Under the so-called bail-out setting, the value of the expected NPVs of an insurance company varies according to the choice of a pair of policies, which consist of dividend payments paid out and capital injections received. In the case of the double barrier strategy, the expected NPVs are expressible with the help of certain types of functions allowing explicit expression in some cases, which is called the bivariate $q$-scale function in the article. This is accomplished by making use of a perturbation technique in \cite{czarna2014dividend}, which could lead to the linear equation system. In addition, a condition ensuring the existence of an optimal (upper) barrier level is presented. In the end, examples fitting the condition for selecting the optimal barrier are given.


title: Metal content of the circumgalactic medium around star-forming galaxies at z $\sim$ 2.6 as revealed by the VIMOS Ultra-Deep Survey

abstract: The circumgalactic medium (CGM) is the location where the interplay between large-scale outflows and accretion onto galaxies occurs. Metals in different ionization states flowing between the circumgalactic and intergalactic mediums are affected by large galactic outflows and low-ionization state inflowing gas. Observational studies on their spatial distribution and their relation with galaxy properties may provide important constraints on models of galaxy formation and evolution. To provide new insights into the spatial distribution of the circumgalactic of star-forming galaxies, we select a sample of 238 close pairs at $1.5 < z <4.5$ ($\langle z\rangle\sim$2.6) from the VIMOS Ultra Deep Survey. We then generate composite spectra by co-adding spectra of $background$ galaxies that provide different sight-lines across the CGM to examine the spatial distribution of the gas located around these galaxies and investigate possible correlations between the strength of the low- and high-ionization absorption features with different galaxy properties. We detect C II, Si II, Si IV and C IV) up to separations $\langle b \rangle=$ 172 kpc and 146 kpc. Our $W_{0}$ radial profiles suggest a potential redshift evolution for the CGM gas content producing these absorptions. We find a correlation between C II and C IV with star formation rate, stellar mass and trends with galaxy size estimated by the effective radius and azimuthal angle. Galaxies with high star formation rate show stronger C IV absorptions compared with star-forming galaxies with low SFR and low stellar mass. These results could be explained by stronger outflows, softer radiation fields unable to ionize high-ionization state lines or by the galactic fountain scenario where metal-rich gas ejected from previous star-formation episodes fall back to the galaxy.


title: Effective rational approximation on spheres

abstract: We prove an effective estimate for the counting function of Diophantine approximants on the sphere S$^n$. We use homogeneous dynamics on the space of orthogonal lattices, in particular effective equidistribution results and non-divergence estimates for the Siegel transform, developping on recent results of Alam-Ghosh and Kleinbock-Merrill.


title: The poset of Specht ideals for hyperoctahedral groups

abstract: Specht polynomials classically realize the irreducible representations of the symmetric group. The ideals defined by these polynomials provide a strong connection with the combinatorics of Young tableaux and have been intensively studied by several authors. We initiate similar investigations for the ideals defined by the Specht polynomials associated to the hyperoctahedral group $B_n$. We introduce a bidominance order on bipartitions which describes the poset of inclusions of these ideals and study algebraic consequences on general $B_n$-invariant ideals and varieties, which can lead to computational simplifications.


title: From Samples to Persistent Stratified Homotopy Types

abstract: The natural occurrence of singular spaces in applications has led to recent investigations on performing topological data analysis (TDA) in a stratified framework. In many applications, there is no a priori information on what points should be regarded as singular or regular. For this purpose we describe a fully implementable process that provably approximates the stratification for a large class of two-strata Whitney stratified spaces from sufficiently close non-stratified samples. Additionally, in this work, we establish a notion of persistent stratified homotopy type obtained from a sample with two strata. In analogy to the non-stratified applications in TDA which rely on a series of convenient properties of (persistent) homotopy types of sufficiently regular spaces, we show that our persistent stratified homotopy type behaves much like its non-stratified counterpart and exhibits many properties (such as stability, and inference results) necessary for an application in TDA. In total, our results combine to a sampling theorem guaranteeing the (approximate) inference of (persistent) stratified homotopy types of sufficiently regular two-strata Whitney stratified spaces.


title: Cross-task Attention Mechanism for Dense Multi-task Learning

abstract: Multi-task learning has recently become a promising solution for a comprehensive understanding of complex scenes. Not only being memory-efficient, multi-task models with an appropriate design can favor exchange of complementary signals across tasks. In this work, we jointly address 2D semantic segmentation, and two geometry-related tasks, namely dense depth, surface normal estimation as well as edge estimation showing their benefit on indoor and outdoor datasets. We propose a novel multi-task learning architecture that exploits pair-wise cross-task exchange through correlation-guided attention and self-attention to enhance the average representation learning for all tasks. We conduct extensive experiments considering three multi-task setups, showing the benefit of our proposal in comparison to competitive baselines in both synthetic and real benchmarks. We also extend our method to the novel multi-task unsupervised domain adaptation setting. Our code is available at https://github.com/cv-rits/DenseMTL.


title: Ring Deconvolution Microscopy: An Exact Solution for Spatially-Varying Aberration Correction

abstract: The most ubiquitous form of computational aberration correction for microscopy is deconvolution. However, deconvolution relies on the assumption that the point spread function is the same across the entire field-of-view. It is well recognized that this assumption is often inadequate, but space-variant deblurring techniques generally require impractical amounts of calibration and computation. We present a new imaging pipeline, ring deconvolution microscopy (RDM), that leverages the rotational symmetry of most optical systems to provide simple and fast spatially-varying aberration correction. We formally derive theory and algorithms for exact image recovery and additionally propose a neural network based on Seidel coefficients as a fast alternative. We showcase significant enhancements both visually and quantitatively compared to standard deconvolution and existing spatially-varying deconvolution across a diverse range of microscope modalities, including miniature microscopy, multicolor fluorescence microscopy, and point-scanning multimode fiber micro-endoscopy. Our approach enables near-isotropic, subcellular resolution in each of these applications.


title: TAVA: Template-free Animatable Volumetric Actors

abstract: Coordinate-based volumetric representations have the potential to generate photo-realistic virtual avatars from images. However, virtual avatars also need to be controllable even to a novel pose that may not have been observed. Traditional techniques, such as LBS, provide such a function; yet it usually requires a hand-designed body template, 3D scan data, and limited appearance models. On the other hand, neural representation has been shown to be powerful in representing visual details, but are under explored on deforming dynamic articulated actors. In this paper, we propose TAVA, a method to create T emplate-free Animatable Volumetric Actors, based on neural representations. We rely solely on multi-view data and a tracked skeleton to create a volumetric model of an actor, which can be animated at the test time given novel pose. Since TAVA does not require a body template, it is applicable to humans as well as other creatures such as animals. Furthermore, TAVA is designed such that it can recover accurate dense correspondences, making it amenable to content-creation and editing tasks. Through extensive experiments, we demonstrate that the proposed method generalizes well to novel poses as well as unseen views and showcase basic editing capabilities.


title: Wearable Haptic Device for Individuals with Congenital Absence of Proprioception

abstract: A rare genetic condition, PIEZO2 loss of function (LOF) is characterized by absence of proprioception and light touch, which makes functional tasks (e.g., walking, manipulation) difficult. There are no pharmacological treatments or assistive technologies available for individuals with PIEZO2-LOF. We propose a sensory substitution device that communicates proprioceptive feedback via detectable haptic stimuli. We created a wearable prototype that maps measurements of elbow movement to deep pressure applied to the forearm. The prototype applies up to 18 N, includes an embedded force sensor, and is programmable to allow for various angle-to-pressure mappings. Future work includes comparing proprioceptive acuity and movement ability with and without the device in healthy and PIEZO2-LOF individuals, developing low-profile devices using soft robotics, providing sensory substitution for multiple joints simultaneously, and encoding additional aspects of joint dynamics.


title: CrowdWorkSheets: Accounting for Individual and Collective Identities Underlying Crowdsourced Dataset Annotation

abstract: Human annotated data plays a crucial role in machine learning (ML) research and development. However, the ethical considerations around the processes and decisions that go into dataset annotation have not received nearly enough attention. In this paper, we survey an array of literature that provides insights into ethical considerations around crowdsourced dataset annotation. We synthesize these insights, and lay out the challenges in this space along two layers: (1) who the annotator is, and how the annotators' lived experiences can impact their annotations, and (2) the relationship between the annotators and the crowdsourcing platforms, and what that relationship affords them. Finally, we introduce a novel framework, CrowdWorkSheets, for dataset developers to facilitate transparent documentation of key decisions points at various stages of the data annotation pipeline: task formulation, selection of annotators, platform and infrastructure choices, dataset analysis and evaluation, and dataset release and maintenance.


title: Putting GPT-3's Creativity to the (Alternative Uses) Test

abstract: AI large language models have (co-)produced amazing written works from newspaper articles to novels and poetry. These works meet the standards of the standard definition of creativity: being original and useful, and sometimes even the additional element of surprise. But can a large language model designed to predict the next text fragment provide creative, out-of-the-box, responses that still solve the problem at hand? We put Open AI's generative natural language model, GPT-3, to the test. Can it provide creative solutions to one of the most commonly used tests in creativity research? We assessed GPT-3's creativity on Guilford's Alternative Uses Test and compared its performance to previously collected human responses on expert ratings of originality, usefulness and surprise of responses, flexibility of each set of ideas as well as an automated method to measure creativity based on the semantic distance between a response and the AUT object in question. Our results show that -- on the whole -- humans currently outperform GPT-3 when it comes to creative output. But, we believe it is only a matter of time before GPT-3 catches up on this particular task. We discuss what this work reveals about human and AI creativity, creativity testing and our definition of creativity.


title: A theory of learning with constrained weight-distribution

abstract: A central question in computational neuroscience is how structure determines function in neural networks. The emerging high-quality large-scale connectomic datasets raise the question of what general functional principles can be gleaned from structural information such as the distribution of excitatory/inhibitory synapse types and the distribution of synaptic weights. Motivated by this question, we developed a statistical mechanical theory of learning in neural networks that incorporates structural information as constraints. We derived an analytical solution for the memory capacity of the perceptron, a basic feedforward model of supervised learning, with constraint on the distribution of its weights. Our theory predicts that the reduction in capacity due to the constrained weight-distribution is related to the Wasserstein distance between the imposed distribution and that of the standard normal distribution. To test the theoretical predictions, we use optimal transport theory and information geometry to develop an SGD-based algorithm to find weights that simultaneously learn the input-output task and satisfy the distribution constraint. We show that training in our algorithm can be interpreted as geodesic flows in the Wasserstein space of probability distributions. We further developed a statistical mechanical theory for teacher-student perceptron rule learning and ask for the best way for the student to incorporate prior knowledge of the rule. Our theory shows that it is beneficial for the learner to adopt different prior weight distributions during learning, and shows that distribution-constrained learning outperforms unconstrained and sign-constrained learning. Our theory and algorithm provide novel strategies for incorporating prior knowledge about weights into learning, and reveal a powerful connection between structure and function in neural networks.

categories: q-bio.NC cond-mat.dis-nn cond-mat.stat-mech cs.LG stat.ML


title: Experimental determination of Lamb wave dispersion diagrams over large frequency ranges in fiber metal laminates

abstract: Fiber metal laminates (FML) are of high interest for lightweight structures as they combine the advantageous material properties of metals and fiber-reinforced polymers. However, low-velocity impacts can lead to complex internal damage. Therefore, structural health monitoring with guided ultrasonic waves (GUW) is a methodology to identify such damage. Numerical simulations form the basis for corresponding investigations, but experimental validation of dispersion diagrams over a wide frequency range is hardly found in the literature. In this work the dispersive relation of GUWs is experimentally determined for an FML made of carbon fiber-reinforced polymer and steel. For this purpose, multi-frequency excitation signals are used to generate GUWs and the resulting wave field is measured via laser scanning vibrometry. The data are processed by means of a non-uniform discrete 2d Fourier transform and analyzed in the frequency-wavenumber domain. The experimental data are in excellent agreement with data from a numerical solution of the analytical framework. In conclusion, this work presents a highly automatable method to experimentally determine dispersion diagrams of GUWs in FML over large frequency ranges with high accuracy.


title: Programs and algorithms for the shell decomposition of oscillating functions in space

abstract: Real-space refinement of atomic models in macromolecular crystallography or in cryo electron microscopy fits a model to a map obtained experimentally. This requires generating model maps of a limited resolution which moreover may vary from one molecular region to another. Calculating such map as a sum of atomic contributions requires that these contributions reflect the local resolution of the experimental map. A possibility to refine the parameters of these contribution means to express it as a function of atomic coordinates, displacement factor and eventually of resolution. Recently, Urzhumtsev & Lunin (BioRxiv, 10.1101/2022.03.28.486044) suggested to decompose finite-resolution atomic images, and more generally spherically symmetric oscillating functions in space, into a sum of specially designed terms analytically dependent on all atomic parameters. Each term is a spherically symmetric function concentrated in a spherical shell. Here we describe the software and respective algorithms to carry out such shell decomposition of oscillating functions.


title: Simultaneous Bone and Shadow Segmentation Network using Task Correspondence Consistency

abstract: Segmenting both bone surface and the corresponding acoustic shadow are fundamental tasks in ultrasound (US) guided orthopedic procedures. However, these tasks are challenging due to minimal and blurred bone surface response in US images, cross-machine discrepancy, imaging artifacts, and low signal-to-noise ratio. Notably, bone shadows are caused by a significant acoustic impedance mismatch between the soft tissue and bone surfaces. To leverage this mutual information between these highly related tasks, we propose a single end-to-end network with a shared transformer-based encoder and task independent decoders for simultaneous bone and shadow segmentation. To share complementary features, we propose a cross task feature transfer block which learns to transfer meaningful features from decoder of shadow segmentation to that of bone segmentation and vice-versa. We also introduce a correspondence consistency loss which makes sure that network utilizes the inter-dependency between the bone surface and its corresponding shadow to refine the segmentation. Validation against expert annotations shows that the method outperforms the previous state-of-the-art for both bone surface and shadow segmentation.


title: Chemical reactivity under collective vibrational strong coupling

abstract: Recent experiments of chemical reactions in optical cavities have shown great promise to alter and steer chemical reactions but still remain poorly understood theoretically. In particular the origin of resonant effects between the cavity and certain vibrational modes in the collective limit is still subject to active research. In this paper, we study unimolecular dissociation reactions of many molecules collectively interacting with an infrared cavity mode through their vibrational dipole moment. We find that the reaction rate can slow down by increasing the number of aligned molecules if the cavity mode is resonant with a vibrational frequency of the molecules. We also discover a simple scaling relation that scales with the collective Rabi splitting to estimate the onset of reaction rate modification by collective vibrational strong coupling and numerically demonstrate these effects for up to 10,000 molecules.


title: Baseline validation of a bias-mitigated loan screening model based on the European Banking Authority's trust elements of Big Data & Advanced Analytics applications using Artificial Intelligence

abstract: The goal of our 4-phase research project was to test if a machine-learning-based loan screening application (5D) could detect bad loans subject to the following constraints: a) utilize a minimal-optimal number of features unrelated to the credit history, gender, race or ethnicity of the borrower (BiMOPT features); b) comply with the European Banking Authority and EU Commission principles on trustworthy Artificial Intelligence (AI). All datasets have been anonymized and pseudoanonymized. In Phase 0 we selected a subset of 10 BiMOPT features out of a total of 84 features; in Phase I we trained 5D to detect bad loans in a historical dataset extracted from a mandatory report to the Bank of Italy consisting of 7,289 non-performing loans (NPLs) closed in the period 2010-2021; in Phase II we assessed the baseline performance of 5D on a distinct validation dataset consisting of an active portolio of 63,763 outstanding loans (performing and non-performing) for a total financed value of over EUR 11.5 billion as of December 31, 2021; in Phase III we will monitor the baseline performance for a period of 5 years (2023-27) to assess the prospective real-world bias-mitigation and performance of the 5D system and its utility in credit and fintech institutions. At baseline, 5D correctly detected 1,461 bad loans out of a total of 1,613 (Sensitivity = 0.91, Prevalence = 0.0253;, Positive Predictive Value = 0.19), and correctly classified 55,866 out of the other 62,150 exposures (Specificity = 0.90, Negative Predictive Value = 0.997). Our preliminary results support the hypothesis that Big Data & Advanced Analytics applications based on AI can mitigate bias and improve consumer protection in the loan screening process without compromising the efficacy of the credit risk assessment. Further validation is required to assess the prospective performance and utility of 5D in credit and fintech institutions.


title: Deconfined criticalities and dualities between chiral spin liquid, topological superconductor and charge density wave Chern insulator

abstract: We propose bi-critical and tri-critical theories between chiral spin liquid (CSL), topological superconductor (SC) and charge density wave (CDW) ordered Chern insulator with Chern number $C=2$ on square, triangular and kagome lattices. The three CDW order parameters form a manifold of $S^2$ or $S^1$ depending on whether there is easy-plane anisotropy. The skyrmion defect of the CDW order carries physical charge $2e$ and its condensation leads to a topological superconductor. The CDW-SC transitions are in the same universality classes as the celebrated deconfined quantum critical points (DQCP) between Neel order and valence bond solid order on square lattice. Both SC and CDW order can be accessed from the CSL phase through a continuous phase transition. At the CSL-SC transition, there is still CDW order fluctuations although CDW is absent in both sides. We propose three different theories for the CSL-SC transition (and CSL to easy-plane CDW transition): a $U(1)$ theory with two bosons, a $U(1)$ theory with two Dirac fermions, and an $SU(2)$ theory with two bosons. Our construction offers a derivation of the duality between these three theories as well as a promising physical realization. The $SU(2)$ theory offers a unified framework for a series of fixed points with explicit $SO(5), O(4)$ or $SO(3)\times O(2)$ symmetry. There is also a transparent duality transformation mapping SC order to easy-plane CDW order. The CSL-SC-CDW tri-critical points are invariant under this duality mapping and have an enlarged $SO(5)$ or $O(4)$ symmetry. The DQCPs between CDW and SC inherit the enlarged symmetry, emergent anomaly, and self-duality from the tri-critical point. Our analysis unifies the well-studied DQCP between symmetry breaking phases into a larger framework where they are proximate to a topologically ordered phase.


title: Scalar Dark Matter Production from Preheating and Structure Formation Constraints

abstract: We investigate the out-of-equilibrium production of scalar dark matter (DM) from the inflaton condensate during inflation and reheating. We assume that this scalar couples only to the inflaton via a direct quartic coupling and is minimally coupled to gravity. We consider all possible production regimes: purely gravitational, weak direct coupling (perturbative), and strong direct coupling (non-perturbative). For each regime, we use different approaches to determine the dark matter phase space distribution and the corresponding relic abundance. For the purely gravitational regime, scalar dark matter quanta are copiously excited during inflation resulting in an infrared (IR) dominated distribution function and a relic abundance which overcloses the universe for a reheating temperature $T_\text{reh}>34 ~\text{GeV}$. A non-vanishing direct coupling induces an effective DM mass and suppresses the large IR modes in favor of ultraviolet (UV) modes and a minimal scalar abundance is generated when the interference between the direct and gravitational couplings is maximal. For large direct couplings, backreaction on the inflaton condensate is accounted for by using the Hartree approximation and lattice simulation techniques. Since scalar DM candidates can behave as non-cold dark matter, we estimate the impact of such species on the matter power spectrum and derive the corresponding constraints from the Lyman-$\alpha$ measurements. We find that they correspond to a lower bound on the DM mass of $\gtrsim 3\times 10^{-4} \, \rm{eV}$ for purely gravitational production, and $\gtrsim 20 \, \rm {eV}$ for direct coupling production. We discuss the implications of these results.


title: The BlueTides Mock Image Catalogue: Simulated observations of high-redshift galaxies and predictions for JWST imaging surveys

abstract: We present a mock image catalogue of ~100,000 MUV=-22.5 to -19.6 mag galaxies at z=7-12 from the BlueTides cosmological simulation. We create mock images of each galaxy with the James Webb (JWST), Hubble, Roman, and Euclid Space Telescopes, as well as Subaru, and VISTA, with a range of near- and mid-infrared filters. We perform photometry on the mock images to estimate the success of these instruments for detecting high-z galaxies. We predict that JWST will have unprecedented power in detecting high-z galaxies, with a 95% completeness limit at least 2.5 magnitudes fainter than VISTA and Subaru, 1.1 magnitudes fainter than Hubble, and 0.9 magnitudes fainter than Roman, for the same wavelength and exposure time. Focusing on JWST, we consider a range of exposure times and filters, and find that the NIRCam F356W and F277W filters will detect the faintest galaxies, with 95% completeness at m=27.4 mag in 10ks exposures. We also predict the number of high-z galaxies that will be discovered by upcoming JWST imaging surveys. We predict that the COSMOS-Web survey will detect ~1000 MUV<-20.1 mag galaxies at 6.5<z<7.5, by virtue of its large survey area. JADES-Medium will detect almost 100% of MUV<-20 mag galaxies at z<8.5 due to its significant depth, however with its smaller survey area it will detect only ~100 of these galaxies at 6.5<z<7.5. Cosmic variance results in a large range in the number of predicted galaxies each survey will detect, which is more evident in smaller surveys such as CEERS and the PEARLS NEP and GOODS-S fields.


title: The formation of low surface brightness galaxies in the IllustrisTNG simulation

abstract: We explore the nature of low surface brightness galaxies (LSBGs) in the hydrodynamic cosmological simulation TNG100 of the IllustrisTNG project, selecting a sample of LSBGs ($r$-band effective surface brightness $\mu_r > 22.0$ mag arcsec$^{-2}$) at $z=0$ over a wide range of stellar masses ($M_{\ast} = 10^{9}$-$10^{12}$ M$_\odot$). We find LSBGs of all stellar masses, although they are particularly prevalent at $M_{\ast} < 10^{10}$ M$_\odot$. We show that the specific star formation rates of LSBGs are not significantly different from those of high surface brightness galaxies (HSBGs) but, as a population, LSBGs are systematically less massive and more extended than HSBGs, and tend to display late-type morphologies according to a kinematic criterion. At fixed stellar mass, we find that haloes hosting LSBGs are systematically more massive and have a higher baryonic fraction than those hosting HSBGs. We find that LSBGs have higher stellar specific angular momentum and halo spin parameter values compared to HSBGs, as suggested by previous works. We track the evolution of these quantities back in time, finding that the spin parameters of the haloes hosting LSBGs and HSBGs exhibit a clear bifurcation at $z \sim 2$, which causes a similar separation in the evolutionary tracks of other properties such as galactic angular momentum and effective radius, ultimately resulting in the values observed at $z =$ 0. The higher values of specific stellar angular momentum and halo spin in LSBGs seem to be responsible for their extended nature, preventing material from collapsing into the central regions of the galaxies, also causing LSBGs to host less massive black holes at their centres.


title: Topological twists of massive SQCD, Part I

abstract: We consider topological twists of four-dimensional $\mathcal{N}=2$ supersymmetric QCD with gauge group SU(2) and $N_f\leq 3$ fundamental hypermultiplets. The twists are labelled by a choice of background fluxes for the flavour group, which provides an infinite family of topological partition functions. In this Part I, we demonstrate that in the presence of such fluxes the theories can be formulated for arbitrary gauge bundles on a compact four-manifold. Moreover, we consider arbitrary masses for the hypermultiplets, which introduce new intricacies for the evaluation of the low-energy path integral on the Coulomb branch. We develop techniques for the evaluation of these path integrals. In the forthcoming Part II, we will deal with the explicit evaluation.


title: An infinity of black holes

abstract: In general relativity (without matter), there is typically a one parameter family of static, maximally symmetric black hole solutions labelled by their mass. We show that there are situations with many more black holes. We study asymptotically anti-de Sitter solutions in six and seven dimensions having a conformal boundary which is a product of spheres cross time. We show that the number of families of static, maximally symmetric black holes depends on the ratio, $\lambda$, of the radii of the boundary spheres. As $\lambda$ approaches a critical value, $\lambda_{c}$, the number of such families becomes infinite. In each family, we can take the size of the black hole to zero, obtaining an infinite number of static, maximally symmetric non-black hole solutions. We discuss several applications of these results, including Hawking-Page phase transitions and the phase diagram of dual field theories on a product of spheres, new positive energy conjectures, and more.


title: Constraining axion-like particles with the diffuse gamma-ray flux measured by the Large High Altitude Air Shower Observatory

abstract: The detection of very high-energy neutrinos by IceCube experiment supports the existence of a comparable gamma-ray counterpart from the same cosmic accelerators. Under the likely assumption that the sources of these particles are of extragalactic origin, the emitted photon flux would be significantly absorbed during its propagation over cosmic distances. However, in the presence of photon mixing with ultra-light axion-like-particles (ALPs), this expectation would be strongly modified. Notably, photon-ALP conversions in the host galaxy would produce an ALP flux which propagates unimpeded in the extragalactic space. Then, the back-conversion of ALPs in the Galactic magnetic field leads to a diffuse high-energy photon flux. In this context, the recent detection of the diffuse high-energy photon flux by the Large High Altitude Air Shower Observatory (LHAASO) allows us to exclude at the $95\%$ CL an ALP-photon coupling $g_{a\gamma}\gtrsim 3.9-7.8 \times 10^{-11}~\mathrm{GeV^{-1}}$ for $m_{a}\lesssim 4\times10^{-7}~\mathrm{eV}$, depending on the assumptions on the magnetic fields and on the original gamma-ray spectrum. This new bound is complementary with other ALP constraints from very-high-energy gamma-ray experiments and sensitivities of future experiments.


title: Tangle of Spin Double Helices in the Honeycomb Kitaev-$\Gamma$ Model

abstract: We investigate the ground-state nature of the honeycomb Kitaev-$\Gamma$ model in the material-relevant parameter regime through a combination of classical and quantum simulations. The classical model is imprinted with a tangle of highly structured spin double helices. This helix tangle exhibits $18$ inequivalent helical axes and features a spontaneous periodicity anisotropy and a ${\rm sgn}(\Gamma)$-determined chirality pattern. Infinite PEPS simulations with clusters up to $36$ sites identify hallmarks of this many-body order in the quantum spin-$1/2$ model. Our findings provide a fresh perspective of the Kitaev-$\Gamma$ model and enrich the physics of Kitaev magnetism.


title: Multi-wavelength analysis of short GRB 201221D and its comparison with other high \& low redshift short GRBs

abstract: We present a detailed analysis of short GRB 201221D lying at redshift $z= 1.045$. We analyse the high-energy data of the burst and compare it with the sample of short gamma-ray bursts (SGRBs). The prompt emission characteristics are typical of those seen in the case of other SGRBs except for the peak energy ($E_{\rm p}$), which lies at the softer end (generally observed in the case of long bursts). We estimate the host galaxy properties by utilising the {\sc Python}-based software {\sc Prospector} to fit the spectral energy distribution of the host. The burst lies at a high redshift relative to the SGRB sample with a median redshift of $z=0.47$. We compare the burst characteristics with other SGRBs with known redshifts along with GRB 200826A (SGRB originated from a collapsar). A careful examination of the characteristics of SGRBs at different redshifts reveals that some of the SGRBs lying at high redshifts have properties similar to long GRBs indicating they might have originated from collapsars. Further study of these GRBs can help to explore the broad picture of progenitor systems of SGRBs.


title: CMT-DeepLab: Clustering Mask Transformers for Panoptic Segmentation

abstract: We propose Clustering Mask Transformer (CMT-DeepLab), a transformer-based framework for panoptic segmentation designed around clustering. It rethinks the existing transformer architectures used in segmentation and detection; CMT-DeepLab considers the object queries as cluster centers, which fill the role of grouping the pixels when applied to segmentation. The clustering is computed with an alternating procedure, by first assigning pixels to the clusters by their feature affinity, and then updating the cluster centers and pixel features. Together, these operations comprise the Clustering Mask Transformer (CMT) layer, which produces cross-attention that is denser and more consistent with the final segmentation task. CMT-DeepLab improves the performance over prior art significantly by 4.4% PQ, achieving a new state-of-the-art of 55.7% PQ on the COCO test-dev set.


title: Some identities for the Narayana polynomial and its derivatives

abstract: In this note, by employing a nice property of semicircular distributions, we derive some identities for the Narayana polynomial and its derivatives.


title: Photoelectric Factor Prediction Using Automated Learning and Uncertainty Quantification

abstract: The photoelectric factor (PEF) is an important well logging tool to distinguish between different types of reservoir rocks because PEF measurement is sensitive to elements with high atomic number. Furthermore, the ratio of rock minerals could be determined by combining PEF log with other well logs. However, PEF log could be missing in some cases such as in old well logs and wells drilled with barite-based mud. Therefore, developing models for estimating missing PEF log is essential in those circumstances. In this work, we developed various machine learning models to predict PEF values using the following well logs as inputs: bulk density (RHOB), neutron porosity (NPHI), gamma ray (GR), compressional and shear velocity. The predictions of PEF values using adaptive-network-fuzzy inference system (ANFIS) and artificial neural network (ANN) models have errors of about 16% and 14% average absolute percentage error (AAPE) in the testing dataset, respectively. Thus, a different approach was proposed that is based on the concept of automated machine learning. It works by automatically searching for the optimal model type and optimizes its hyperparameters for the dataset under investigation. This approach selected a Gaussian process regression (GPR) model for accurate estimation of PEF values. The developed GPR model decreases the AAPE of the predicted PEF values in the testing dataset to about 10% AAPE. This error could be further decreased to about 2% by modeling the potential noise in the measurements using the GPR model.


title: Denoising Scanning Tunneling Microscopy Images of Graphene with Supervised Machine Learning

abstract: Machine learning (ML) methods are extraordinarily successful at denoising photographic images. The application of such denoising methods to scientific images is, however, often complicated by the difficulty in experimentally obtaining a suitable expected result as an input to training the ML network. Here, we propose and demonstrate a simulation-based approach to address this challenge for denoising atomic-scale scanning tunneling microscopy (STM) images, which consists of training a convolutional neural network on STM images simulated based on a tight-binding electronic structure model. As model materials, we consider graphite and its mono- and few-layer counterpart, graphene. With the goal of applying it to any experimental STM image obtained on graphitic systems, the network was trained on a set of simulated images with varying characteristics such as tip height, sample bias, atomic-scale defects, and non-linear background. Denoising of both simulated and experimental images with this approach is compared to that of commonly-used filters, revealing a superior outcome of the ML method in the removal of noise as well as scanning artifacts - including on features not simulated in the training set. An extension to larger STM images is further discussed, along with intrinsic limitations arising from training set biases that discourage application to fundamentally unknown surface features. The approach demonstrated here provides an effective way to remove noise and artifacts from typical STM images, yielding the basis for further feature discernment and automated processing.


title: The Impact of Variable Ordering on Bayesian Network Structure Learning

abstract: Causal Bayesian Networks provide an important tool for reasoning under uncertainty with potential application to many complex causal systems. Structure learning algorithms that can tell us something about the causal structure of these systems are becoming increasingly important. In the literature, the validity of these algorithms is often tested for sensitivity over varying sample sizes, hyper-parameters, and occasionally objective functions. In this paper, we show that the order in which the variables are read from data can have much greater impact on the accuracy of the algorithm than these factors. Because the variable ordering is arbitrary, any significant effect it has on learnt graph accuracy is concerning, and this raises questions about the validity of the results produced by algorithms that are sensitive to, but have not been assessed against, different variable orderings.


title: Bayesian neural networks for the probabilistic forecasting of wind direction and speed using ocean data

abstract: Neural networks are increasingly being used in a variety of settings to predict wind direction and speed, two of the most important factors for estimating the potential power output of a wind farm. However, these predictions are arguably of limited value because classical neural networks lack the ability to express uncertainty. Here we instead consider the use of Bayesian Neural Networks (BNNs), for which the weights, biases and outputs are distributions rather than deterministic point values. This allows for the evaluation of both epistemic and aleatoric uncertainty and leads to well-calibrated uncertainty predictions of both wind speed and power. Here we consider the application of BNNs to the problem of offshore wind resource prediction for renewable energy applications. For our dataset, we use observations recorded at the FINO1 research platform in the North Sea and our predictors are ocean data such as water temperature and current direction. The probabilistic forecast predicted by the BNN adds considerable value to the results and, in particular, informs the user of the network's ability to make predictions of out-of-sample datapoints. We use this property of BNNs to conclude that the accuracy and uncertainty of the wind speed and direction predictions made by our network are unaffected by the construction of the nearby Alpha Ventus wind farm. Hence, at this site, networks trained on pre-farm ocean data can be used to accurately predict wind field information from ocean data after the wind farm has been constructed.


title: Bag of Image Patch Embedding Behind the Success of Self-Supervised Learning

abstract: Self-supervised learning (SSL) has recently achieved tremendous empirical advancements in learning image representation. However, our understanding of the principle behind learning such a representation is still limited. This work shows that joint-embedding SSL approaches primarily learn a representation of image patches, which reflects their co-occurrence. Such a connection to co-occurrence modeling can be established formally, and it supplements the prevailing invariance perspective. We empirically show that learning a representation for fixed-scale patches and aggregating local patch representations as the image representation achieves similar or even better results than the baseline methods. We denote this process as BagSSL. Even with 32x32 patch representation, BagSSL achieves 62% top-1 linear probing accuracy on ImageNet. On the other hand, with a multi-scale pretrained model, we show that the whole image embedding is approximately the average of local patch embeddings. While the SSL representation is relatively invariant at the global scale, we show that locality is preserved when we zoom into local patch-level representation. Further, we show that patch representation aggregation can improve various SOTA baseline methods by a large margin. The patch representation is considerably easier to understand, and this work makes a step to demystify self-supervised representation learning.


title: Making first order linear logic a generating grammar

abstract: It is known that different categorial grammars have surface representation in a fragment of first order multiplicative linear logic (MLL1). We show that the fragment of interest is equivalent to the recently introduced extended tensor type calculus (ETTC). ETTC is a calculus of specific typed terms, which represent tuples of strings, more precisely bipartite graphs decorated with strings. Types are derived from linear logic formulas, and rules correspond to concrete operations on these string-labeled graphs, so that they can be conveniently visualized. This provides the above mentioned fragment of MLL1 that is relevant for language modeling not only with some alternative syntax and intuitive geometric representation, but also with an intrinsic deductive system, which has been absent. In this work we consider a non-trivial notationally enriched variation of the previously introduced ETTC, which allows more concise and transparent computations. We present both a cut-free sequent calculus and a natural deduction formalism.


title: Probing heavy Majorana neutrinos and the Weinberg operator through vector boson fusion processes in proton-proton collisions at $\sqrt{s}$ = 13 TeV

abstract: The first search exploiting the vector boson fusion process to probe heavy Majorana neutrinos and the Weinberg operator at the LHC is presented. The search is performed in the same-sign dimuon final state using a proton-proton collision data set recorded at $\sqrt{s}$ = 13 TeV, collected with the CMS detector and corresponding to a total integrated luminosity of 138 fb$^{-1}$. The results are found to agree with the predictions of the standard model. For heavy Majorana neutrinos, constraints on the squared mixing element between the muon and the heavy neutrino are derived in the heavy neutrino mass range 50 GeV-25 TeV; for masses above 650 GeV these are the most stringent constraints from searches at the LHC to date. A first test of the Weinberg operator at colliders provides an observed upper limit at 95% confidence level on the effective $\mu\mu$ Majorana neutrino mass of 10.8 GeV.


title: Not-Quite Transcendental Functions and their Applications

abstract: Transcendental functions, such as exponentials and logarithms, appear in a broad array of computational domains: from simulations in curvilinear coordinates, to interpolation, to machine learning. Unfortunately they are typically expensive to compute accurately. In this note, we argue that in many cases, the properties of the function matters more than the exact functional form. We present new functions, which are not transcendental, that can be used as drop-in replacements for the exponential and logarithm in many settings for a significant performance boost. We show that for certain applications using these functions result in no drop in the accuracy at all, as they are perfectly accurate representations of themselves, if not the original transcendental functions.


title: Solving Complex Nanostructures With Ptychographic Atomic Electron Tomography

abstract: Transmission electron microscopy (TEM) is a potent technique for the determination of three-dimensional atomic scale structure of samples in structural biology and materials science. In structural biology, three-dimensional structures of proteins are routinely determined using phase-contrast single-particle cryo-electron microscopy from thousands of identical proteins, and reconstructions have reached atomic resolution for specific proteins. In materials science, three-dimensional atomic structures of complex nanomaterials have been determined using a combination of annular dark field (ADF) scanning transmission electron microscopic (STEM) tomography and subpixel localization of atomic peaks, in a method termed atomic electron tomography (AET). However, neither of these methods can determine the three-dimensional atomic structure of heterogeneous nanomaterials containing light elements. Here, we perform mixed-state electron ptychography from 34.5 million diffraction patterns to reconstruct a high-resolution tilt series of a double wall-carbon nanotube (DW-CNT), encapsulating a complex $\mathrm{ZrTe}$ sandwich structure. Class averaging of the resulting reconstructions and subpixel localization of the atomic peaks in the reconstructed volume reveals the complex three-dimensional atomic structure of the core-shell heterostructure with 17 picometer precision. From these measurements, we solve the full $\mathrm{Zr_{11}Te_{50}}$ structure, which contains a previously unobserved $\mathrm{ZrTe_{2}}$ phase in the core. The experimental realization of ptychographic atomic electron tomography (PAET) will allow for structural determination of a wide range of nanomaterials which are beam-sensitive or contain light elements.


title: Is my transaction done yet? An empirical study of transaction processing times in the Ethereum Blockchain Platform

abstract: Ethereum is one of the most popular platforms for the development of blockchain-powered applications. These applications are known as Dapps. When engineering Dapps, developers need to translate requests captured in the front-end of their application into one or more smart contract transactions. Developers need to pay for these transactions and, the more they pay (i.e., the higher the gas price), the faster the transaction is likely to be processed. Therefore developers need to optimize the balance between cost (transaction fees) and user experience (transaction processing times). Online services have been developed to provide transaction issuers (e.g., Dapp developers) with an estimate of how long transactions will take to be processed given a certain gas price. These estimation services are crucial in the Ethereum domain and several popular wallets such as Metamask rely on them. However, their accuracy has not been empirically investigated so far. In this paper, we quantify the transaction processing times in Ethereum, investigate the relationship between processing times and gas prices, and determine the accuracy of state-of-the-practice estimation services. We find that transactions are processed in a median of 57s and that 90% of the transactions are processed within 8m. The higher gas prices result in faster transaction processing times with diminishing returns. In particular, we observe no practical difference in processing time between expensive and very expensive transactions. In terms of accuracy of processing time estimation services, we note that they are equivalent. However, when stratifying transactions by gas prices, Etherscan's Gas Tracker is the most accurate estimation service for very cheap and cheap transaction. EthGasStation's Gas Price API, in turn, is the most accurate estimation service for regular, expensive, and very expensive transactions.


title: Discrete-time Rigid Body Pose Estimation based on Lagrange-d'Alembert principle

abstract: The problem of rigid body pose estimation is treated in discrete-time via discrete Lagrange-d'Alembert principle and discrete Lyapunov methods. The position and attitude of the rigid body are to be estimated simultaneously with the help of vision and inertial sensors. For the discrete-time estimation of pose, the continuous-time rigid body kinematics equations are discretized appropriately. We approach the pose estimation problem as minimising the energies stored in the errors of estimated quantities. With the help of measurements obtained through optical sensors, artificial rotational and translation potential energy-like terms have been designed. Similarly, artificial rotational and translation kinetic energy-like terms have been devised using inertial sensor measurements. This allows us to construct a discrete-time Lagrangian as the difference of the kinetic and potential energy like terms, to which a Lagrange-d'Alembert principle is applied to obtain an optimal pose estimation filter. The dissipation terms in the optimal filter are designed through discrete-Lyapunov analysis on a suitably constructed Morse-Lyapunov function and the overall scheme is proven to be almost globally asymptotically stable. The filtering scheme is simulated using noisy sensor data to verify the theoretical properties.


title: Design of Multi-model Linear Inferential Sensors with SVM-based Switching Logic

abstract: We study the problem of data-based design of multi-model linear inferential (soft) sensors. The multi-model linear inferential sensors promise increased prediction accuracy yet simplicity of the model structure and training. The standard approach to the multi-model inferential sensor design consists in three separate steps: 1) data labeling (establishing training subsets for individual models), 2) data classification (creating a switching logic for the models), and 3) training of individual models. There are two main issues with this concept: a) as steps 2) & 3) are separate, discontinuities can occur when switching between the models; b) as steps 1) & 3) are separate, data labelling disregards the quality of the resulting model. Our contribution aims at both the mentioned problems, where, for the problem a), we introduce a novel SVM-based model training coupled with switching logic identification and, for the problem b), we propose a direct optimization of data labelling. We illustrate the proposed methodology and its benefits on an example from the chemical engineering domain.


title: A study on $\mathcal I$-localized sequences in S-metric spaces

abstract: In this paper we study the notion of $\mathcal{I}$-localized and $\mathcal{I^*}$-localized sequences in $S$-metric spaces. Also, we investigate some properties related to $\mathcal{I}$-localized and $\mathcal{I}$-Cauchy sequences and give the idea of $\mathcal{I}$-barrier of a sequence in the same space.


title: Efficient Constrained Multi-Agent Trajectory Optimization using Dynamic Potential Games

abstract: Although dynamic games provide a rich paradigm for modeling agents' interactions, solving these games for real-world applications is often challenging. Many real-world interactive settings involve general nonlinear state and input constraints that couple agents' decisions with one another. In this work, we develop an efficient and fast planner for interactive trajectory optimization in constrained setups using a constrained game-theoretical framework. Our key insight is to leverage the special structure of agents' objective and constraint functions that are common in multi-agent interactions for fast and reliable planning. More precisely, we identify the structure of agents' cost and constraint functions under which the resulting dynamic game is an instance of a constrained dynamic potential game. Constrained dynamic potential games are a class of games for which instead of solving a set of coupled constrained optimal control problems, a constrained Nash equilibrium, i.e. a Generalized Nash equilibrium, can be found by solving a single constrained optimal control problem. This simplifies constrained interactive trajectory optimization significantly. We compare the performance of our method in a navigation setup involving four planar agents and show that our method is on average 20 times faster than the state-of-the-art. We further provide experimental validation of our proposed method in a navigation setup involving two quadrotors carrying a rigid object while avoiding collisions with two humans.


title: (2+1)-dimensional KdV, fifth-order KdV, and Gardner equations derived from the ideal fluid model. Soliton, cnoidal and superposition solutions

abstract: We study the problem of gravity surface waves for an ideal fluid model in the (2+1)-dimensional case. We apply a systematic procedure to derive the Boussinesq equations for a given relation between the orders of four expansion parameters, the amplitude parameter $\alpha$, the long-wavelength parameter $\beta$, the transverse wavelength parameter $\gamma$, and the bottom variation parameter $\delta$. We derived the only possible (2+1)-dimensional extensions of the Korteweg-de Vries equation, the fifth-order KdV equation, and the Gardner equation in three special cases of the relationship between these parameters. All these equations are non-local. When the bottom is flat, the (2+1)-dimensional KdV equation can be transformed to the Kadomtsev-Petviashvili equation in a fixed reference frame and next to the classical KP equation in a moving frame. We have found soliton, cnoidal, and superposition solutions (essentially one-dimensional) to the (2+1)-dimensional Korteweg-de Vries equation and the Kadomtsev-Petviashvili equation.


title: KitBit: A New AI Model for Solving Intelligence Tests and Numerical Series

abstract: The resolution of intelligence tests, in particular numerical sequences, has been of great interest in the evaluation of AI systems. We present a new computational model called KitBit that uses a reduced set of algorithms and their combinations to build a predictive model that finds the underlying pattern in numerical sequences, such as those included in IQ tests and others of much greater complexity. We present the fundamentals of the model and its application in different cases. First, the system is tested on a set of number series used in IQ tests collected from various sources. Next, our model is successfully applied on the sequences used to evaluate the models reported in the literature. In both cases, the system is capable of solving these types of problems in less than a second using standard computing power. Finally, KitBit's algorithms have been applied for the first time to the complete set of entire sequences of the well-known OEIS database. We find a pattern in the form of a list of algorithms and predict the following terms in the largest number of series to date. These results demonstrate the potential of KitBit to solve complex problems that could be represented numerically.


title: Actionable Guidance for High-Consequence AI Risk Management: Towards Standards Addressing AI Catastrophic Risks

abstract: Artificial intelligence (AI) systems can provide many beneficial capabilities but also risks of adverse events. Some AI systems could present risks of events with very high or catastrophic consequences at societal scale. The US National Institute of Standards and Technology (NIST) has been developing the NIST Artificial Intelligence Risk Management Framework (AI RMF) as voluntary guidance on AI risk assessment and management for AI developers and others. For addressing risks of events with catastrophic consequences, NIST indicated a need to translate from high level principles to actionable risk management guidance. In this document, we provide detailed actionable-guidance recommendations focused on identifying and managing risks of events with very high or catastrophic consequences, intended as a risk management practices resource for NIST for AI RMF version 1.0 (released in January 2023), or for AI RMF users, or for other AI risk management guidance and standards as appropriate. We also provide our methodology for our recommendations. We provide actionable-guidance recommendations for AI RMF 1.0 on: identifying risks from potential unintended uses and misuses of AI systems; including catastrophic-risk factors within the scope of risk assessments and impact assessments; identifying and mitigating human rights harms; and reporting information on AI risk factors including catastrophic-risk factors. In addition, we provide recommendations on additional issues for a roadmap for later versions of the AI RMF or supplementary publications. These include: providing an AI RMF Profile with supplementary guidance for cutting-edge increasingly multi-purpose or general-purpose AI. We aim for this work to be a concrete risk-management practices contribution, and to stimulate constructive dialogue on how to address catastrophic risks and associated issues in AI standards.


title: Random Forest of Epidemiological Models for Influenza Forecasting

abstract: Forecasting the hospitalizations caused by the Influenza virus is vital for public health planning so that hospitals can be better prepared for an influx of patients. Many forecasting methods have been used in real-time during the Influenza seasons and submitted to the CDC for public communication. The forecasting models range from mechanistic models, and auto-regression models to machine learning models. We hypothesize that we can improve forecasting by using multiple mechanistic models to produce potential trajectories and use machine learning to learn how to combine those trajectories into an improved forecast. We propose a Tree Ensemble model design that utilizes the individual predictors of our baseline model SIkJalpha to improve its performance. Each predictor is generated by changing a set of hyper-parameters. We compare our prospective forecasts deployed for the FluSight challenge (2022) to all the other submitted approaches. Our approach is fully automated and does not require any manual tuning. We demonstrate that our Random Forest-based approach is able to improve upon the forecasts of the individual predictors in terms of mean absolute error, coverage, and weighted interval score. Our method outperforms all other models in terms of the mean absolute error and the weighted interval score based on the mean across all weekly submissions in the current season (2022). Explainability of the Random Forest (through analysis of the trees) enables us to gain insights into how it improves upon the individual predictors.


title: A parallel iterative method for variational integration

abstract: Discrete variational methods show excellent performance in numerical simulations of different mechanical systems. In this paper, we introduce an iterative procedure for the solution of discrete variational equations for boundary value problems. More concretely, we explore a parallelization strategy that leverages the capabilities of multicore CPUs and GPUs (graphics cards). We study this parallel method for higher-order Lagrangian systems, which appear in fully-actuated problems and beyond. The most important part of the paper is devoted to a precise study of different convergence conditions for these methods. We illustrate their excellent behavior in some interesting examples, namely Zermelo's navigation problem, a fuel-optimal navigation problem, interpolation problems or in a fuel optimization problem for a controlled 4-body problem in astrodynamics showing the potential of our method.


title: Understanding the $sp$ magnetism in substitutional doped graphene

abstract: Defect-induced magnetism in graphene has been predicted theoretically and observed experimentally. However, there are open questions about the origin of the magnetic behavior when substitutional impurities with $sp$ electrons are considered. The aim of this work is to contribute to the understanding of impurity-induced spin magnetism in doped graphene systems. Thus, the electronic structure and spin magnetic moments for substitutional doped graphene with impurities from groups IIIA (B, Al, and Ga) and VA (N, P, As, Sb, and Bi) of the periodic table were obtained within the framework of density functional theory. The nature of the magnetic ground state was determined from calculations of the total energy as a function of the spin magnetic moment using the fixed spin moment method. We show that the spontaneous magnetization in the studied systems arises from an electronic instability by the presence of a narrow impurity band at the Fermi level. Furthermore, we found that the emergence of spin polarization requires the impurity to introduce an extra electron to the graphene lattice and that the impurity-carbon hybridization is close to the $sp^3$ geometry. These features reveal that the charge doping sign and the hybridization degree play a fundamental role in the origin of $sp$ magnetism in substitutional doped graphene.


title: MultiEarth 2022 -- The Champion Solution for the Matrix Completion Challenge via Multimodal Regression and Generation

abstract: Earth observation satellites have been continuously monitoring the earth environment for years at different locations and spectral bands with different modalities. Due to complex satellite sensing conditions (e.g., weather, cloud, atmosphere, orbit), some observations for certain modalities, bands, locations, and times may not be available. The MultiEarth Matrix Completion Challenge in CVPR 2022 [1] provides the multimodal satellite data for addressing such data sparsity challenges with the Amazon Rainforest as the region of interest. This work proposes an adaptive real-time multimodal regression and generation framework and achieves superior performance on unseen test queries in this challenge with an LPIPS of 0.2226, a PSNR of 123.0372, and an SSIM of 0.6347.


title: Capture the Flag for Team Construction in Cybersecurity

abstract: Team collaboration among individuals with diverse sets of expertise and skills is essential for solving complex problems. As part of an interdisciplinary effort, we studied the effects of Capture the Flag (CTF) game, a popular and engaging education/training tool in cybersecurity and engineering, in enhancing team construction and collaboration. We developed a framework to incorporate CTF as part of a computer-human process for expertise recognition and role assignment and evaluated and tested its effectiveness through a study with cybersecurity students enrolled in a Virtual Teams course. In our computer-human process framework, the post-CTF algorithm using the CTF outcomes assembles the team (assigning individuals to teams) and provides the initial role assignments, which then gets updated by human-based team discussions. This paper shares our insights, design choices/rationales, and analyses of our CTF-incorporated computer-human process framework. The students' evaluations revealed that the computer-human process framework was helpful in learning about their team members' backgrounds and expertise and assigning roles accordingly made a positive impact on the learning outcomes for the team collaboration skills in the course. This experience report showcases the utility of CTF as a tool for expertise recognition and role assignments in teams and highlights the complementary roles of CTF-based and discussion-based processes for an effective team collaboration among engineering students.


title: Shallow and Deep Nonparametric Convolutions for Gaussian Processes

abstract: A key challenge in the practical application of Gaussian processes (GPs) is selecting a proper covariance function. The moving average, or process convolutions, construction of GPs allows some additional flexibility, but still requires choosing a proper smoothing kernel, which is non-trivial. Previous approaches have built covariance functions by using GP priors over the smoothing kernel, and by extension the covariance, as a way to bypass the need to specify it in advance. However, such models have been limited in several ways: they are restricted to single dimensional inputs, e.g. time; they only allow modelling of single outputs and they do not scale to large datasets since inference is not straightforward. In this paper, we introduce a nonparametric process convolution formulation for GPs that alleviates these weaknesses by using a functional sampling approach based on Matheron's rule to perform fast sampling using interdomain inducing variables. Furthermore, we propose a composition of these nonparametric convolutions that serves as an alternative to classic deep GP models, and allows the covariance functions of the intermediate layers to be inferred from the data. We test the performance of our model on benchmarks for single output GPs, multiple output GPs and deep GPs and find that our approach can provide improvements over standard GP models, particularly for larger datasets.


title: Optimization stability in excited state-specific variational Monte Carlo

abstract: We investigate the issue of optimization stability in variance-based state-specific variational Monte Carlo, discussing the roles of the objective function, the complexity of wave function ansatz, the amount of sampling effort, and the choice of minimization algorithm. Using a small cyanine dye molecule as a test case, we systematically perform minimizations using variants of the linear method as both a standalone algorithm and in a hybrid combination with accelerated descent. We demonstrate that adaptive step control is crucial for maintaining the linear method's stability when optimizing complicated wave functions and that the hybrid method enjoys both greater stability and minimization performance. As a verification of variance minimization's practical utility, we report an excitation energy in the cyanine dye that is in good agreement with both benchmark quantum chemistry values and results obtained from state-averaged energy-based variational Monte Carlo.


title: DPDR: A novel machine learning method for the Decision Process for Dimensionality Reduction

abstract: This paper discusses the critical decision process of extracting or selecting the features in a supervised learning context. It is often confusing to find a suitable method to reduce dimensionality. There are pros and cons to deciding between a feature selection and feature extraction according to the data's nature and the user's preferences. Indeed, the user may want to emphasize the results toward integrity or interpretability and a specific data resolution. This paper proposes a new method to choose the best dimensionality reduction method in a supervised learning context. It also helps to drop or reconstruct the features until a target resolution is reached. This target resolution can be user-defined, or it can be automatically defined by the method. The method applies a regression or a classification, evaluates the results, and gives a diagnosis about the best dimensionality reduction process in this specific supervised learning context. The main algorithms used are the Random Forest algorithms (RF), the Principal Component Analysis (PCA) algorithm, and the multilayer perceptron (MLP) neural network algorithm. Six use cases are presented, and every one is based on some well-known technique to generate synthetic data. This research discusses each choice that can be made in the process, aiming to clarify the issues about the entire decision process of selecting or extracting the features.


title: Vibrational Levels of a Generalized Morse Potential

abstract: A Generalized Morse Potential (GMP) is an extension of the Morse Potential (MP) with an additional exponential term and an additional parameter that compensate for MP's erroneous behavior in the long range part of the interaction potential. Because of the additional term and parameter, the vibrational levels of the GMP cannot be solved analytically, unlike the case for the MP. We present several numerical approaches for solving the vibrational problem of the GMP based on Galerkin methods, namely the Laguerre Polynomial Method (LPM), the Symmetrized Laguerre Polynomial Method (SLPM) and the Polynomial Expansion method (PEM) and apply them to the vibrational levels of the homonuclear diatomic molecules B$_2$, O$_2$ and F$_2$, for which high level theoretical Full CI potential energy surfaces and experimentally measured vibrational levels have been reported. Overall the LPM produces vibrational states for the GMP that are converged to within spectroscopic accuracy of 0.01 cm$^{-1}$ in between 1 and 2 orders of magnitude faster and with much fewer basis functions / grid points than the Colbert-Miller Discrete Variable Representation (CM-DVR) method for the three homonuclear diatomic molecules examined in this study.


title: Sensitivity of non-Hermitian systems

abstract: Understanding the extreme sensitivity of the eigenvalues of non-Hermitian Hamiltonians to the boundary conditions is of great importance when analyzing non-Hermitian systems, as it appears generically and is intimately connected to the skin effect and the breakdown of the conventional bulk boundary correspondence. Here we describe a method to find the eigenvalues of one-dimensional one-band models with arbitrary boundary conditions. We use this method on several systems to find analytical expressions for the eigenvalues, which give us conditions on the parameter values in the system for when we can expect the spectrum to be insensitive to a change in boundary conditions. By stacking one-dimensional chains, we use the derived results to find corresponding conditions for insensitivity for some two-dimensional systems with periodic boundary conditions in one direction. This would be hard by using other methods to detect skin effect, such as the winding of the determinant of the Bloch Hamiltonian. Finally, we use these results to make predictions about the (dis)appearance of the skin effect in purely two-dimensional systems with open boundary conditions in both directions.