title: A novel approach for calculating galaxy rotation curves using spaxel cross-correlation and iterative smoothing

abstract: Precise measurements of the internal dynamics of galaxies have proven of great importance for understanding the internal dark matter distribution of galaxies. We present a novel method for measuring the line-of-sight (LOS) velocities across the face of galaxies by cross-correlation of spectral pixels (spaxels) and an iterative method of smoothing. On simulated data the method can accurately recover the input LOS velocities for different types of spectra (absorption line dominated, emission line dominated, and differing shapes of the continuum), and can handle stellar population radial gradients. Most important of all, it continues to provide reliable measurements of LOS velocities with reasonable uncertainties even when the spectra are very low signal-to-noise (approaching $\sim 1$), which is a challenge for traditional template-fitting approaches. We apply our method to data from a real MaNGA galaxy as a demonstration and find promising results with good precision. This novel approach can be complementary to existing methods primarily based on template fitting.


title: Lorentzian polynomials on cones and the Heron-Rota-Welsh conjecture

abstract: We give a short proof of the log-concavity of the coefficients of the reduced characteristic polynomial of a matroid. The proof uses an extension of the theory of Lorentzian polynomials to convex cones, and reproves the Hodge-Riemann relations of degree one for the Chow ring of a matroid.


title: A Hybrid Inverse Optimization-Stochastic Programming Framework for Network Protection

abstract: Disaster management is a complex problem demanding sophisticated modeling approaches. We propose utilizing a hybrid method involving inverse optimization to parameterize the cost functions for a road network's traffic equilibrium problem and employing a modified version of Fan and Liu (2010)'s two-stage stochastic model to make protection decisions using the information gained from inverse optimization. We demonstrate the framework using two types of cost functions for the traffic equilibrium problem and show that accurate parameterizations of cost functions can change spending on protection decisions in most of our experiments.


title: TIC~257060897b: an inflated, low-density, hot-Jupiter transiting a rapidly evolving subgiant star

abstract: We report the discovery of a new transiting exoplanet orbiting the star TIC~257060897 and detected using {\it TESS} full frame images. We acquired HARPS-N time-series spectroscopic data, and ground-based photometric follow-up observations from which we confirm the planetary nature of the transiting body. For the host star we determined: T$\rm_{eff}$=(6128$\pm$57) K, log~g=(4.2$\pm$0.1) and [Fe/H]=(+0.20$\pm$0.04). The host is an intermediate age ($\sim$3.5~Gyr), metal-rich, subgiant star with M$_{\star}$=(1.32$\pm$0.04) M$_{\odot}$ and R$_{\star}$=(1.82$\pm$0.05) R$_{\odot}$. The transiting body is a giant planet with a mass m$\rm_p=$(0.67$\pm$0.03) M$\rm_{j}$, a radius r$\rm_p=$(1.49$\pm$0.04) R$\rm_{j}$ yielding a density $\rho_p$=(0.25$\pm$0.02) g cm$^{-3}$ and revolving around its star every $\sim$3.66 days. TIC~257060897b is an extreme system having one of the smallest densities known so far. We argued that the inflation of the planet's radius may be related to the fast increase of luminosity of its host star as it evolves outside the main sequence and that systems like TIC~257060897b could be precursors of inflated radius short period planets found around low luminosity red giant branch stars, as recently debated in the literature.


title: Fully nonlinear elliptic equations on Hermitian manifolds for symmetric functions of partial Laplacians

abstract: We consider a class of fully nonlinear second order elliptic equations on Hermitian manifolds closely related to the general notion of $\bfG$-plurisubharmonicity of Harvey-Lawson and an equation treated by Sz\'ekelyhidi-Tosatti-Weinkove in the proof of Gauduchon conjecture. Under fairly general assumptions we derive interior estimates and establish the existence of smooth solutions for the Dirichlet problem as well as for equations on closed manifolds.


title: Dynamic Models of Spherical Parallel Robots for Model-Based Control Schemes

abstract: In this paper, derivation of different forms of dynamic formulation of spherical parallel robots (SPRs) is investigated. These formulations include the explicit dynamic forms, linear regressor, and Slotine-Li (SL) regressor, which are required for the design and implementation of the vast majority of model-based controllers and dynamic parameters identification schemes. To this end, the implicit dynamic of SPRs is first formulated using the principle of virtual work in task-space, and then by using an extension, their explicit dynamic formulation is derived. The dynamic equation is then analytically reformulated into linear and S-L regression form with respect to the inertial parameters, and by using the Gauss-Jordan procedure, it is reduced to a unique and closed-form structure. Finally, to illustrate the effectiveness of the proposed method, two different SPRs, namely, the ARAS-Diamond, and the 3-RRR, are examined as the case studies. The obtained results are verified by using the MSC-ADAMS software, and are shared to interested audience for public access.


title: Dynamic CU-DU Selection for Resource Allocation in O-RAN Using Actor-Critic Learning

abstract: Recently, there has been tremendous efforts by network operators and equipment vendors to adopt intelligence and openness in the next generation radio access network (RAN). The goal is to reach a RAN that can self-optimize in a highly complex setting with multiple platforms, technologies and vendors in a converged compute and connect architecture. In this paper, we propose two nested actor-critic learning based techniques to optimize the placement of resource allocation function, and as well, the decisions for resource allocation. By this, we investigate the impact of observability on the performance of the reinforcement learning based resource allocation. We show that when a network function (NF) is dynamically relocated based on service requirements, using reinforcement learning techniques, latency and throughput gains are obtained.


title: Preconditioned Plug-and-Play ADMM with Locally Adjustable Denoiser for Image Restoration

abstract: Plug-and-Play optimization recently emerged as a powerful technique for solving inverse problems by plugging a denoiser into a classical optimization algorithm. The denoiser accounts for the regularization and therefore implicitly determines the prior knowledge on the data, hence replacing typical handcrafted priors. In this paper, we extend the concept of plug-and-play optimization to use denoisers that can be parameterized for non-constant noise variance. In that aim, we introduce a preconditioning of the ADMM algorithm, which mathematically justifies the use of such an adjustable denoiser. We additionally propose a procedure for training a convolutional neural network for high quality non-blind image denoising that also allows for pixel-wise control of the noise standard deviation. We show that our pixel-wise adjustable denoiser, along with a suitable preconditioning strategy, can further improve the plug-and-play ADMM approach for several applications, including image completion, interpolation, demosaicing and Poisson denoising.


title: Probabilistic Robust Autoencoders for Outlier Detection

abstract: Anomalies (or outliers) are prevalent in real-world empirical observations and potentially mask important underlying structures. Accurate identification of anomalous samples is crucial for the success of downstream data analysis tasks. To automatically identify anomalies, we propose Probabilistic Robust AutoEncoder (PRAE). PRAE aims to simultaneously remove outliers and identify a low-dimensional representation for the inlier samples. We first present the Robust AutoEncoder (RAE) objective as a minimization problem for splitting the data into inliers and outliers. Our objective is designed to exclude outliers while including a subset of samples (inliers) that can be effectively reconstructed using an AutoEncoder (AE). RAE minimizes the autoencoder's reconstruction error while incorporating as many samples as possible. This could be formulated via regularization by subtracting an $\ell_0$ norm counting the number of selected samples from the reconstruction term. Unfortunately, this leads to an intractable combinatorial problem. Therefore, we propose two probabilistic relaxations of RAE, which are differentiable and alleviate the need for a combinatorial search. We prove that the solution to the PRAE problem is equivalent to the solution of RAE. We use synthetic data to show that PRAE can accurately remove outliers in a wide range of contamination levels. Finally, we demonstrate that using PRAE for anomaly detection leads to state-of-the-art results on various benchmark datasets.


title: Fixed-Parameter Algorithms for Longest Heapable Subsequence and Maximum Binary Tree

abstract: A heapable sequence is a sequence of numbers that can be arranged in a "min-heap data structure". Finding a longest heapable subsequence of a given sequence was proposed by Byers, Heeringa, Mitzenmacher, and Zervas (ANALCO 2011) as a generalization of the well-studied longest increasing subsequence problem and its complexity still remains open. An equivalent formulation of the longest heapable subsequence problem is that of finding a maximum-sized binary tree in a given permutation directed acyclic graph (permutation DAG). In this work, we study parameterized algorithms for both longest heapable subsequence as well as maximum-sized binary tree. We show the following results: 1. The longest heapable subsequence problem can be solved in $k^{O(\log{k})}n$ time, where $k$ is the number of distinct values in the input sequence. We introduce the "alphabet size" as a new parameter in the study of computational problems in permutation DAGs. Our result on longest heapable subsequence implies that the maximum-sized binary tree problem in a given permutation DAG is fixed-parameter tractable when parameterized by the alphabet size. 2. We show that the alphabet size with respect to a fixed topological ordering can be computed in polynomial time, admits a min-max relation, and has a polyhedral description. 3. We design a fixed-parameter algorithm with run-time $w^{O(w)}n$ for the maximum-sized binary tree problem in undirected graphs when parameterized by treewidth $w$. Our results make progress towards understanding the complexity of the longest heapable subsequence and maximum-sized binary tree in permutation DAGs from the perspective of parameterized algorithms. We believe that the parameter alphabet size that we introduce is likely to be useful in the context of optimization problems defined over permutation DAGs.


title: Energy spectra of secondaries in proton-proton interactions

abstract: We compare the predictions of AAfrag for the spectra of secondary photons, neutrinos, electrons, and positrons produced in proton-proton collisions to those of the parameterisations of Kamae et al., Kelner et al., and Kafexhiu et al. We find that the differences in the normalisation of the photon energy spectra reach 20$-$50% at intermediate values of the transferred energy fraction $x$, growing up to a factor of two for $x\rightarrow\,$1, while the differences in the neutrino spectra are even larger. We argue that LHCf results on the forward production of photons favor the use of the QGSJET-II-04m model on which AAfrag is based. The differences in the normalisation have important implications in the context of multi-messenger astronomy, in particular, for the prediction of neutrino fluxes based on gamma-ray flux measurements, or regarding the inference of the cosmic ray spectrum, based on gamma-ray data. We note also that the positron-electron ratio from hadronic interactions increases with energy towards the cutoff, an effect which is missed using the average electron-positron spectrum from Kelner et al. Finally, we describe the publicly available python package aafragpy, which provides the secondary spectra of photons, neutrinos, electrons, and positrons. This package complements the AAfrag results for protons with energies above 4 GeV with previous analytical parameterizations of particle spectra for lower energy protons.


title: DiVRsify: Break the Cycle and Develop VR for Everyone

abstract: Virtual reality technology is biased. It excludes approximately 95% the world's population by being primarily designed for male, western, educated, industrial, rich, and democratic populations. This bias may be due to the lack of diversity in virtual reality researchers, research participants, developers, and end users, fueling a noninclusive research, development, and usability cycle. The objective of this paper is to highlight the minimal virtual reality research involving understudied populations with respect to dimensions of diversity, such as gender, race, culture, ethnicity, age, disability, and neurodivergence. Specifically, we highlight numerous differences in virtual reality usability between underrepresented groups compared to commonly studied populations. These differences illustrate the lack of generalizability of prior virtual reality research. Lastly, we present a call to action with the aim that, over time, will break the cycle and enable virtual reality for everyone.


title: Theoretical study of early time superradiance for atom clouds and arrays

abstract: We explore conditions for Dicke superradiance in a cloud of atoms by examining the Taylor series expansion of the photon emission rate at $t= 0$. By defining superradiance as an increasing photon emission rate for $t\sim 0$, we have calculated the conditions for superradiance for a variety of cases. We investigate superradiance as defined for photon emission into all angles as well as directional superradiance where the photon emission is only detected in a particular direction. Although all of the examples are for two level atoms that are fully inverted at $t=0$, we also give equations for partially inverted two level atoms and for fully inverted multilevel atoms. We give an algorithm for efficiently evaluating these equations for atom arrays and determine superradiance conditions for large atom number.


title: Measurement of the Anisotropy Power Spectrum of the Radio Synchrotron Background

abstract: We present the first targeted measurement of the power spectrum of anisotropies of the radio synchrotron background, at 140 MHz where it is the overwhelmingly dominant photon background. This measurement is important for understanding the background level of radio sky brightness, which is dominated by steep-spectrum synchrotron radiation at frequencies below 0.5 GHz and has been measured to be significantly higher than that which can be produced by known classes of extragalactic sources and most models of Galactic halo emission. We determine the anisotropy power spectrum on scales ranging from 2 degrees to 0.2 arcminutes with LOFAR observations of two 18 square degree fields -- one centered on the Northern hemisphere coldest patch of radio sky where the Galactic contribution is smallest and one offset from that location by 15 degrees. We find that the anisotropy power is higher than that attributable to the distribution of point sources above 100 micro-Jy in flux. This level of radio anisotropy power indicates that if it results from point sources, those sources are likely at low fluxes and incredibly numerous, and likely clustered in a specific manner.


title: LHC bounds on MUED after Run 2

abstract: We present updated LHC limits on the minimal universal extra dimensions (MUED) model from the Run 2 searches. We scan the parameter space against a number of searches implemented in the public code \textsc{CheckMATE} and derive up-to-date limits on the MUED parameter space from 13 TeV searches. The strongest constraints come from a search dedicated to squarks and gluinos with one isolated lepton, jets and missing transverse energy. In the procedure we take into account initial state radiation and stress its importance in the MUED searches, which is not always appreciated.


title: Statistically study the optimal local sources for cosmic ray nuclei and electron

abstract: The local sources, such as Geminga SNR, may play important role for the anomaly of proton, electron and anisotropy in the past works. In fact, there exists twelve SNRs around solar system within $1$ kpc. One question is that can other SNRs also possibly contribute the spectra of nuclei and electron and explain the special structure of anisotropy? In this work, under the spatial-dependent propagation, we systematically study the contribution of all local SNRs within 1 kpc around solar to the spectra of nuclei and electron, as well as the energy dependence of anisotropy. As a result, only Geminga, Monogem, and Vela SNRs have quantitive contribution to the nuclei and electron spectra and anisotropy. Here, Geminga SNR is the sole optimal candidate and Monogem SNR is controversial due to the tension of anisotropy between model calculation and observations. The Vela SNR contributes a new spectral structure beyond TeV energy, hinted by HESS, VERITAS, DAMPE and CALET measurements. More interesting is that the electron anisotropy satisfies the Fermi-LAT limit below TeV energy, but rises greatly and reaches $10\%$ at several TeV. This new structure will shed new light to check our model. We hope that the new structure of electron spectrum and anisotropy can be observed by space-borne DAMPE and HERD and ground-based HAWC and LHAASO experiments in the near future.


title: Predicting Consumer Purchasing Decision in The Online Food Delivery Industry

abstract: This transformation of food delivery businesses to online platforms has gained high attention in recent years. This due to the availability of customizing ordering experiences, easy payment methods, fast delivery, and others. The competition between online food delivery providers has intensified to attain a wider range of customers. Hence, they should have a better understanding of their customers' needs and predict their purchasing decisions. Machine learning has a significant impact on companies' bottom line. They are used to construct models and strategies in industries that rely on big data and need a system to evaluate it fast and effectively. Predictive modeling is a type of machine learning that uses various regression algorithms, analytics, and statistics to estimate the probability of an occurrence. The incorporation of predictive models helps online food delivery providers to understand their customers. In this study, a dataset collected from 388 consumers in Bangalore, India was provided to predict their purchasing decisions. Four prediction models are considered: CART and C4.5 decision trees, random forest, and rule-based classifiers, and their accuracies in providing the correct class label are evaluated. The findings show that all models perform similarly, but the C4.5 outperforms them all with an accuracy of 91.67%.


title: Alfnoor: assessing the information content of Ariel's low resolution spectra with planetary population studies

abstract: The ARIEL Space Telescope will provide a large and diverse sample of exoplanet spectra, performing spectroscopic observations of about 1000 exoplanets in the wavelength range $0.5 \to 7.8 \; \mu m$. In this paper, we investigate the information content of ARIEL's Reconnaissance Survey low resolution transmission spectra. Among the goals of the ARIEL Reconnaissance Survey is also to identify planets without molecular features in their atmosphere. In this work, (1) we present a strategy that will allow to select candidate planets to be reobserved in a ARIEL's higher resolution Tier; (2) we propose a metric to preliminary classify exoplanets by their atmospheric composition without performing an atmospheric retrieval; (3) we introduce the possibility to find other methods to better exploit the data scientific content.


title: Adwords with Unknown Budgets and Beyond

abstract: In the classic Adwords problem introduced by Mehta et al.\ (2007), we have a bipartite graph between advertisers and queries. Each advertiser has a maximum budget that is known a priori. Queries are unknown a priori and arrive sequentially. When a query arrives, advertisers make bids and we (immediately and irrevocably) decide which (if any) Ad to display based on the bids and advertiser budgets. The winning advertiser for each query pays their bid up to their remaining budget. Our goal is to maximize total budget utilized without any foreknowledge of the arrival sequence (which could be adversarial). We consider the setting where the online algorithm does not know the advertisers' budgets a priori and the budget of an advertiser is revealed to the algorithm only when it is exceeded. A na\"ive greedy algorithm is 0.5 competitive for this setting and finding an algorithm with better performance remained an open problem. We show that no deterministic algorithm has competitive ratio better than 0.5 and give the first (randomized) algorithm with strictly better performance guarantee. We show that the competitive ratio of our algorithm is at least 0.522 but also strictly less than $(1-1/e)$. We present novel applications of budget oblivious algorithms in search ads and beyond. In particular, we show that our algorithm achieves the best possible performance guarantee for deterministic online matching in the presence of multi-channel traffic (Manshadi et al. (2022)).


title: Auto-correlation functions for unitary groups

abstract: We compute the auto-correlations functions of order $m\ge 1$ for the characteristic polynomials of random matrices from certain subgroups of the unitary groups $\U(2)$ and $\U(3)$ by applying branching rules. These subgroups can be understood as analogs of Sato--Tate groups of $\USp(4)$ in our previous paper. This computation yields symmetric polynomial identities with $m$-variables involving irreducible characters of $\U(m)$ for all $m \ge 1$ in an explicit, uniform way.


title: Temporal Graphs and Temporal Network Characteristics for Bio-Inspired Networks During Optimization

abstract: Temporal network analysis and time evolution of network characteristics are powerful tools in describing the changing topology of dynamic networks. This paper uses such approaches to better visualize and provide analytical measures for the changes in performance that we observed in Voronoi-type spatial coverage, particularly for the example of time evolving networks with a changing number of wireless sensors being deployed. Specifically, our analysis focuses on the role different combinations of impenetrable obstacles and environmental noise play in connectivity and overall network structure. It is shown how the use of (i) temporal network graphs, and (ii) network centrality and regularity measures illustrate the differences between various options developed for the balancing act of energy and time efficiency in network coverage. Lastly, we compare the outcome of these measures with the less abstract classification variables, such as percent area covered, and cumulative distance travelled.


title: Simulating Large PEPs Tensor Networks on Small Quantum Devices

abstract: We systematically map low-bond-dimension PEPs tensor networks to quantum circuits. By measuring and reusing qubits, we demonstrate that a simulation of an $N \times M$ square-lattice PEPs network, for arbitrary $M$, of bond dimension $2$ can be performed using $N+2$ qubits. We employ this approach to calculate the values of a long-range loop observable in the topological Wen plaquette model by mapping a $3\times 3$ PEPs tensor network to a 5-qubit quantum circuit and executing it on the Honeywell System Model H1-1 trapped-ion device. We find that, for this system size, the noisy observable values are sufficient for diagnosing topological vs. trivial order, as the Wen model is perturbed by a magnetic field term in the Hamiltonian. We provide an overview of the experimental procedure and its results. We then explain in greater detail our method for mapping 2D tensor networks to quantum circuits and its scaling properties. Our results serve as a proof-of-concept of the utility of the measure-and-reuse approach for simulating large two-dimensional quantum systems on small quantum devices.


title: An Ensemble-based Multi-Criteria Decision Making Method for COVID-19 Cough Classification

abstract: The objectives of this research are analysing the performance of the state-of-the-art machine learning techniques for classifying COVID-19 from cough sound and identifying the model(s) that consistently perform well across different cough datasets. Different performance evaluation metrics (such as precision, sensitivity, specificity, AUC, accuracy, etc.) make it difficult to select the best performance model. To address this issue, in this paper, we propose an ensemble-based multi-criteria decision making (MCDM) method for selecting top performance machine learning technique(s) for COVID-19 cough classification. We use four cough datasets, namely Cambridge, Coswara, Virufy, and NoCoCoDa to verify the proposed method. At first, our proposed method uses the audio features of cough samples and then applies machine learning (ML) techniques to classify them as COVID-19 or non-COVID-19. Then, we consider a multi-criteria decision-making (MCDM) method that combines ensemble technologies (i.e., soft and hard) to select the best model. In MCDM, we use the technique for order preference by similarity to ideal solution (TOPSIS) for ranking purposes, while entropy is applied to calculate evaluation criteria weights. In addition, we apply the feature reduction process through recursive feature elimination with cross-validation under different estimators. The results of our empirical evaluations show that the proposed method outperforms the state-of-the-art models.


title: Generation of Helical states -- breaking of symmetries, Curie's principle, and excited states

abstract: Following previous work of M.H. Garner, R. Hoffmann, S. Rettrup and G.C. Solomon, we discuss the generation of helical molecular orbitals (MOs) for linear chains of atoms. We first give a definition of helical MOs and we provide an index measuring how far a given helical states is from a perfect helical distribution. Structural properties of helical distribution for twisted $[n]$-cumulene and cumulene version of M\"obius systems are given. We then give some simple structural assumptions as well as symmetry requirements ensuring the existence of helical MOs. Considering molecules which do not admit helical MOs, we provide a first way to induce helical states by the breaking of symmetries. We also explore an alternative way using excited conformations of given molecules as well as different electronic multiplicities. Several examples are given.


title: Electron transport in folded bilayer-bilayer graphene/hexagonal boron nitride superlattices under high magnetic fields

abstract: Employing graphene as a template, we fabricate moir\'e superlattices by stacking bilayer or folded bilayer-bilayer graphene (BLG or fBBLG) and hexagonal boron nitride (hBN), i.e., hBN/BLG/hBN or hBN/fBBLG/hBN stacks, with a small twist angle between the graphene and one of the two hBN layers. Because of the modulation due to the hBN, higher-generation Dirac points can emerge with a narrow bandwidth and van Hove singularities. In the moir\'e superlattice devices, we can therefore access the higher-generation Dirac points by in-situ gate tuning. This study is based on our previous paper (Appl. Phys. Express 13, 035003 (2020)). Here we show more extended data by applying high magnetic fields up to ~24 T. We also comment on the temperature dependence of the resistivity and magnetoresistance with reference to the 'plain' BLG data for a comparative study.


title: ASH: A Modern Framework for Parallel Spatial Hashing in 3D Perception

abstract: We present ASH, a modern and high-performance framework for parallel spatial hashing on GPU. Compared to existing GPU hash map implementations, ASH achieves higher performance, supports richer functionality, and requires fewer lines of code (LoC) when used for implementing spatially varying operations from volumetric geometry reconstruction to differentiable appearance reconstruction. Unlike existing GPU hash maps, the ASH framework provides a versatile tensor interface, hiding low-level details from the users. In addition, by decoupling the internal hashing data structures and key-value data in buffers, we offer direct access to spatially varying data via indices, enabling seamless integration to modern libraries such as PyTorch. To achieve this, we 1) detach stored key-value data from the low-level hash map implementation; 2) bridge the pointer-first low level data structures to index-first high-level tensor interfaces via an index heap; 3) adapt both generic and non-generic integer-only hash map implementations as backends to operate on multi-dimensional keys. We first profile our hash map against state-of-the-art hash maps on synthetic data to show the performance gain from this architecture. We then show that ASH can consistently achieve higher performance on various large-scale 3D perception tasks with fewer LoC by showcasing several applications, including 1) point cloud voxelization, 2) retargetable volumetric scene reconstruction, 3) non-rigid point cloud registration and volumetric deformation, and 4) spatially varying geometry and appearance refinement. ASH and its example applications are open sourced in Open3D (http://www.open3d.org).


title: Optic Disc Segmentation using Disk-Centered Patch Augmentation

abstract: The optic disc is a crucial diagnostic feature in the eye since changes to its physiognomy is correlated with the severity of various ocular and cardiovascular diseases. While identifying the bulk of the optic disc in a color fundus image is straightforward, accurately segmenting its boundary at the pixel level is very challenging. In this work, we propose disc-centered patch augmentation (DCPA) -- a simple, yet novel training scheme for deep neural networks -- to address this problem. DCPA achieves state-of-the-art results on full-size images even when using small neural networks, specifically a U-Net with only 7 million parameters as opposed to the original 31 million. In DCPA, we restrict the training data to patches that fully contain the optic nerve. In addition, we also train the network using dynamic cost functions to increase its robustness. We tested DCPA-trained networks on five retinal datasets: DRISTI, DRIONS-DB, DRIVE, AV-WIDE, and CHASE-DB. The first two had available optic disc ground truth, and we manually estimated the ground truth for the latter three. Our approach achieved state-of-the-art F1 and IOU results on four datasets (95 % F1, 91 % IOU on DRISTI; 92 % F1, 84 % IOU on DRIVE; 83 % F1, 71 % IOU on AV-WIDE; 83 % F1, 71 % IOU on CHASEDB) and competitive results on the fifth (95 % F1, 91 % IOU on DRIONS-DB), confirming its generality. Our open-source code and ground-truth annotations are available at: https://github.com/saeidmotevali/fundusdisk


title: Belief propagation for permutations, rankings, and partial orders

abstract: Many datasets give partial information about an ordering or ranking by indicating which team won a game, which item a user prefers, or who infected whom. We define a continuous spin system whose Gibbs distribution is the posterior distribution on permutations, given a probabilistic model of these interactions. Using the cavity method we derive a belief propagation algorithm that computes the marginal distribution of each node's position. In addition, the Bethe free energy lets us approximate the number of linear extensions of a partial order and perform model selection between competing probabilistic models, such as the Bradley-Terry-Luce model of noisy comparisons and its cousins.

categories: cs.AI cond-mat.stat-mech cs.LG cs.SI stat.ML


title: Virtual elements on agglomerated finite elements to increase the critical time step in elastodynamic simulations

abstract: In this paper, we use the first-order virtual element method (VEM) to investigate the effect of shape quality of polyhedra in the estimation of the critical time step for explicit three-dimensional elastodynamic finite element (FE) simulations. Low-quality finite elements are common when meshing realistic complex components, and while tetrahedral meshing technology is generally robust, meshing algorithms cannot guarantee high-quality meshes for arbitrary geometries or for non-water-tight computer-aided design models. For reliable simulations on such meshes, we consider FE meshes with tetrahedral and prismatic elements that have badly-shaped elements$-$tetrahedra with dihedral angles close to $0^\circ$ and $180^\circ$, and slender prisms with triangular faces that have short edges$-$and agglomerate such `bad' elements with neighboring elements to form a larger polyhedral virtual element. On each element, the element-eigenvalue inequality is used to estimate the critical time step. For a suite of illustrative finite element meshes with $\epsilon$ being a mesh-coordinate parameter that leads to poor mesh quality, we show that adopting VEM on the agglomerated polyhedra yield critical time steps that are insensitive as $\epsilon \rightarrow 0$. The significant reduction in solution time on meshes with agglomerated virtual elements vis-$\`a$-vis tetrahedral meshes is demonstrated through explicit dynamics simulations on a tapered beam.


title: La conjecture de Mordell: origines, approches, g\'en\'eralisations

abstract: The Mordell conjecture: origins, approaches, generalizations -- The Mordell conjecture predicts that a diophantine equation defining a smooth projective curve of genus at least two has only finity many solutions in a given number field. The century that ran since its statement, in 1922, gave rise to several approaches, several proofs, and vast extensions most of which are still conjectural. This text is based on the oral presentation and aims at recalling this story. La conjecture de Mordell pr\'edit qu'une \'equation diophantienne d\'efinissant une courbe projective lisse de genre au moins deux n'a qu'un nombre fini de solutions dans un corps de nombres donn\'e. Le si\`ecle qui s'est \'ecoul\'e depuis son \'enonc\'e, en 1922, a vu plusieurs approches, plusieurs d\'emonstrations, ainsi que de vastes extensions dont la plupart sont encore conjecturales. Ce texte, qui reprend l'expos\'e oral, s'efforce de retracer cette histoire.


title: LEMON: Explainable Entity Matching

abstract: State-of-the-art entity matching (EM) methods are hard to interpret, and there is significant value in bringing explainable AI to EM. Unfortunately, most popular explainability methods do not work well out of the box for EM and need adaptation. In this paper, we identify three challenges of applying local post hoc feature attribution methods to entity matching: cross-record interaction effects, non-match explanations, and variation in sensitivity. We propose our novel model-agnostic and schema-flexible method LEMON that addresses all three challenges by (i) producing dual explanations to avoid cross-record interaction effects, (ii) introducing the novel concept of attribution potential to explain how two records could have matched, and (iii) automatically choosing explanation granularity to match the sensitivity of the matcher and record pair in question. Experiments on public datasets demonstrate that the proposed method is more faithful to the matcher and does a better job of helping users understand the decision boundary of the matcher than previous work. Furthermore, user studies show that the rate at which human subjects can construct counterfactual examples after seeing an explanation from our proposed method increases from 54% to 64% for matches and from 15% to 49% for non-matches compared to explanations from a standard adaptation of LIME.


title: Prediction of Carbon Nanostructure Mechanical Properties and Role of Defects Using Machine Learning

abstract: Carbon fiber and graphene-based nanostructures such as carbon nanotubes (CNTs) and defective structures have extraordinary potential as strong and lightweight materials. A longstanding bottleneck has been lack of understanding and implementation of atomic-scale engineering to harness the theoretical limits of modulus and tensile strength, of which only a fraction is routinely reached today. Here we demonstrate accurate and fast predictions of mechanical properties for CNTs and arbitrary 3D graphitic assemblies based on a training set of over 1000 stress-strain curves from cutting-edge reactive MD simulation and machine learning (ML). Several ML methods are compared and show that our newly proposed hierarchically structured graph neural networks with spatial information (HS-GNNs) achieve predictions in modulus and strength for any 3D nanostructure with only 5-10% error across a wide range of possible values. The reliability is sufficient for practical applications and a great improvement over off-the shelf ML methods with up to 50% deviation, as well as over earlier models for specific chemistry with 20% deviation. The algorithms allow more than 10 times faster mechanical property predictions than traditional molecular dynamics simulations, the identification of the role of defects and random 3D morphology, and high-throughput screening of 3D structures for enhanced mechanical properties. The algorithms can be scaled to morphologies up to 100 nm in size, expanded for chemically similar compounds, and trained to predict a broader range of properties.

categories: cond-mat.mtrl-sci cond-mat.dis-nn cond-mat.mes-hall physics.data-an


title: A Wideband Signal Recognition Dataset

abstract: Signal recognition is a spectrum sensing problem that jointly requires detection, localization in time and frequency, and classification. This is a step beyond most spectrum sensing work which involves signal detection to estimate "present" or "not present" detections for either a single channel or fixed sized channels or classification which assumes a signal is present. We define the signal recognition task, present the metrics of precision and recall to the RF domain, and review recent machine-learning based approaches to this problem. We introduce a new dataset that is useful for training neural networks to perform these tasks and show a training framework to train wideband signal recognizers.


title: Calibrating Concepts and Operations: Towards Symbolic Reasoning on Real Images

abstract: While neural symbolic methods demonstrate impressive performance in visual question answering on synthetic images, their performance suffers on real images. We identify that the long-tail distribution of visual concepts and unequal importance of reasoning steps in real data are the two key obstacles that limit the models' real-world potentials. To address these challenges, we propose a new paradigm, Calibrating Concepts and Operations (CCO), which enables neural symbolic models to capture underlying data characteristics and to reason with hierarchical importance. Specifically, we introduce an executor with learnable concept embedding magnitudes for handling distribution imbalance, and an operation calibrator for highlighting important operations and suppressing redundant ones. Our experiments show CCO substantially boosts the performance of neural symbolic methods on real images. By evaluating models on the real world dataset GQA, CCO helps the neural symbolic method NSCL outperforms its vanilla counterpart by 9.1% (from 47.0% to 56.1%); this result also largely reduces the performance gap between symbolic and non-symbolic methods. Additionally, we create a perturbed test set for better understanding and analyzing model performance on real images. Code is available at https://github.com/Lizw14/CaliCO.git .


title: Study of the process $e^+e^-\to \pi^+\pi^-\pi^0$ using initial state radiation with BABAR

abstract: The process $e^+e^-\to \pi^+\pi^-\pi^0\gamma$ is studied at a center-of-mass energy near the $\Upsilon(4S)$ resonance using a data sample of 469 fb$^{-1}$ collected with the BABAR detector at the PEP-II collider. We have performed a precise measurement of the $e^+e^-\to \pi^+\pi^-\pi^0$ cross section in the center-of-mass energy range from 0.62 to 3.5 GeV. In the energy regions of the $\omega$ and $\phi$ resonances, the cross section is measured with a systematic uncertainty of 1.3\%. The leading-order hadronic contribution to the muon magnetic anomaly calculated using the measured $e^+e^-\to \pi^+\pi^-\pi^0$ cross section from threshold to 2.0 GeV is $(45.86 \pm 0.14 \pm 0.58)\times 10^{-10}$. From the fit to the measured $3\pi$ mass spectrum we have determined the resonance parameters $\Gamma(\omega\to e^+e^-){\cal B}(\omega\to \pi^+\pi^-\pi^0)=(0.5698\pm0.0031\pm0.0082) \mbox{ keV}$, $\Gamma(\phi\to e^+e^-){\cal B}(\phi\to \pi^+\pi^-\pi^0)=(0.1841\pm0.0021\pm0.0080) \mbox{ keV}$, and ${\cal B}(\rho\to 3\pi)=(0.88\pm 0.23\pm 0.30)\times 10^{-4}$. The significance of the $\rho\to 3\pi$ signal is greater than $6\sigma$. For the $J/\psi$ resonance we have measured the product ${\Gamma(J/\psi\to e^+e^-){\cal B}(J/\psi\to 3\pi)}=(0.1248\pm0.0019\pm0.0026)\mbox{ keV}$.


title: Unpacking the Interdependent Systems of Discrimination: Ableist Bias in NLP Systems through an Intersectional Lens

abstract: Much of the world's population experiences some form of disability during their lifetime. Caution must be exercised while designing natural language processing (NLP) systems to prevent systems from inadvertently perpetuating ableist bias against people with disabilities, i.e., prejudice that favors those with typical abilities. We report on various analyses based on word predictions of a large-scale BERT language model. Statistically significant results demonstrate that people with disabilities can be disadvantaged. Findings also explore overlapping forms of discrimination related to interconnected gender and race identities.


title: The location of high-degree vertices in weighted recursive graphs with bounded random weights

abstract: We study the asymptotic growth rate of the label size of high-degree vertices in weighted recursive graphs (WRG) when the weights are i.i.d. almost surely bounded random variables, and as a result confirm a conjecture by Lodewijks and Ortgiese. WRGs are a generalisation of the random recursive tree (RRT) and directed acyclic graph model (DAG), in which vertices are assigned vertex-weights and where new vertices attach to $m\in\mathbb N$ predecessors, each selected independently with a probability proportional to the vertex-weight of the predecessor. Prior work established the asymptotic growth rate of the maximum degree of the WRG model and here we show that there exists a critical exponent $\mu_m$, such that the typical label size of the maximum degree vertex equals $n^{\mu_m(1+o(1))}$ almost surely as $n$, the size of the graph, tends to infinity. These results extend and improve on the asymptotic behaviour of the location of the maximum degree, formerly only known for the RRT model, to the more general weighted multigraph case of the WRG model. Moreover, for the Weighted Recursive Tree (WRT) model, that is, the WRG model with $m=1$, we prove the joint convergence of the rescaled degree and label of high-degree vertices under additional assumptions on the vertex-weight distribution, and also extend results on the growth rate of the maximum degree obtained by Eslava, Lodewijks, and Ortgiese.


title: Mask or Non-Mask? Robust Face Mask Detector via Triplet-Consistency Representation Learning

abstract: In the absence of vaccines or medicines to stop COVID-19, one of the effective methods to slow the spread of the coronavirus and reduce the overloading of healthcare is to wear a face mask. Nevertheless, to mandate the use of face masks or coverings in public areas, additional human resources are required, which is tedious and attention-intensive. To automate the monitoring process, one of the promising solutions is to leverage existing object detection models to detect the faces with or without masks. As such, security officers do not have to stare at the monitoring devices or crowds, and only have to deal with the alerts triggered by the detection of faces without masks. Existing object detection models usually focus on designing the CNN-based network architectures for extracting discriminative features. However, the size of training datasets of face mask detection is small, while the difference between faces with and without masks is subtle. Therefore, in this paper, we propose a face mask detection framework that uses the context attention module to enable the effective attention of the feed-forward convolution neural network by adapting their attention maps feature refinement. Moreover, we further propose an anchor-free detector with Triplet-Consistency Representation Learning by integrating the consistency loss and the triplet loss to deal with the small-scale training data and the similarity between masks and occlusions. Extensive experimental results show that our method outperforms the other state-of-the-art methods. The source code is released as a public download to improve public health at https://github.com/wei-1006/MaskFaceDetection.


title: Iron-rich Fe-O compounds with closest-packed layers at core pressures

abstract: Oxygen solubility in solid iron is extremely low, even at high pressures and temperatures. Thus far, no Fe-O compounds between Fe and FeO endmembers have been reported experimentally. We observed chemical reactions of Fe with FeO or Fe$_2$O$_3$ $in\ situ$ x-ray diffraction experiments at 220-260 GPa and 3,000-3,500 K. The refined diffraction patterns are consistent with a series of Fe$_n$O (n $>$ 1) compounds (e.g., Fe$_{25}$O$_{13}$ and Fe$_{28}$O$_{14}$) identified using the adaptive genetic algorithm. Like $\epsilon$-Fe in the hexagonal close-packed (hcp) structure, the structures of Fe$_n$O compounds consist of oxygen-only close-packed monolayers distributed between iron-only layers. $Ab\ initio$ calculations show systematic electronic properties of these compounds that have ramifications for the physical properties of Earth's inner core.


title: Intrinsic energy flow in laser-excited 3$d$ ferromagnets

abstract: Ultrafast magnetization dynamics are governed by energy flow between electronic, magnetic, and lattice degrees of freedom. A quantitative understanding of these dynamics must be based on a model that agrees with experimental results for all three subsystems. However, ultrafast dynamics of the lattice remain largely unexplored experimentally. Here, we combine femtosecond electron diffraction experiments of the lattice dynamics with energy-conserving atomistic spin dynamics (ASD) simulations and ab-initio calculations to study the intrinsic energy flow in the 3d ferromagnets cobalt (Co) and iron (Fe). The simulations yield a good description of experimental data, in particular an excellent description of our experimental results for the lattice dynamics. We find that the lattice dynamics are influenced significantly by the magnetization dynamics due to the energy cost of demagnetization. Our results highlight the role of the spin system as the dominant heat sink in the first hundreds of femtoseconds. Together with previous findings for nickel [Zahn et al., Phys. Rev. Research 3, 023032 (2021)], our work demonstrates that energy-conserving ASD simulations provide a general and consistent description of the laser-induced dynamics in all three elemental 3d ferromagnets.


title: On the uniform stability of recovering sine-type functions with asymptotically separated zeros

abstract: We obtain a uniform stability of recovering entire functions of a special form from their zeros. To this form, one can reduce the characteristic determinants of strongly regular differential operators and pencils of the first and the second orders, including differential systems with asymptotically separated eigenvalues whose characteristic numbers lie on a line containing the origin, and their non-local perturbations. We establish that the dependence of such functions on the sequences of their zeros possesses the Lipschitz property with respect to natural metrics on each ball of a finite radius. Results of this type can be used for studying the uniform stability of inverse spectral problems. In addition, general theorems on the asymptotics of zeros of functions of this class and on their equivalent representation via an infinite product are obtained, which give the corresponding results for many specific operators.


title: Consistent Explanations by Contrastive Learning

abstract: Post-hoc explanation methods, e.g., Grad-CAM, enable humans to inspect the spatial regions responsible for a particular network decision. However, it is shown that such explanations are not always consistent with human priors, such as consistency across image transformations. Given an interpretation algorithm, e.g., Grad-CAM, we introduce a novel training method to train the model to produce more consistent explanations. Since obtaining the ground truth for a desired model interpretation is not a well-defined task, we adopt ideas from contrastive self-supervised learning, and apply them to the interpretations of the model rather than its embeddings. We show that our method, Contrastive Grad-CAM Consistency (CGC), results in Grad-CAM interpretation heatmaps that are more consistent with human annotations while still achieving comparable classification accuracy. Moreover, our method acts as a regularizer and improves the accuracy on limited-data, fine-grained classification settings. In addition, because our method does not rely on annotations, it allows for the incorporation of unlabeled data into training, which enables better generalization of the model. Our code is available here: https://github.com/UCDvision/CGC


title: Do Self-Supervised and Supervised Methods Learn Similar Visual Representations?

abstract: Despite the success of a number of recent techniques for visual self-supervised deep learning, there has been limited investigation into the representations that are ultimately learned. By leveraging recent advances in the comparison of neural representations, we explore in this direction by comparing a contrastive self-supervised algorithm to supervision for simple image data in a common architecture. We find that the methods learn similar intermediate representations through dissimilar means, and that the representations diverge rapidly in the final few layers. We investigate this divergence, finding that these layers strongly fit to their distinct learning objectives. We also find that the contrastive objective implicitly fits the supervised objective in intermediate layers, but that the reverse is not true. Our work particularly highlights the importance of the learned intermediate representations, and raises critical questions for auxiliary task design.


title: Unsupervised Motion Representation Learning with Capsule Autoencoders

abstract: We propose the Motion Capsule Autoencoder (MCAE), which addresses a key challenge in the unsupervised learning of motion representations: transformation invariance. MCAE models motion in a two-level hierarchy. In the lower level, a spatio-temporal motion signal is divided into short, local, and semantic-agnostic snippets. In the higher level, the snippets are aggregated to form full-length semantic-aware segments. For both levels, we represent motion with a set of learned transformation invariant templates and the corresponding geometric transformations by using capsule autoencoders of a novel design. This leads to a robust and efficient encoding of viewpoint changes. MCAE is evaluated on a novel Trajectory20 motion dataset and various real-world skeleton-based human action datasets. Notably, it achieves better results than baselines on Trajectory20 with considerably fewer parameters and state-of-the-art performance on the unsupervised skeleton-based action recognition task.


title: A survey on datasets for fairness-aware machine learning

abstract: As decision-making increasingly relies on Machine Learning (ML) and (big) data, the issue of fairness in data-driven Artificial Intelligence (AI) systems is receiving increasing attention from both research and industry. A large variety of fairness-aware machine learning solutions have been proposed which involve fairness-related interventions in the data, learning algorithms and/or model outputs. However, a vital part of proposing new approaches is evaluating them empirically on benchmark datasets that represent realistic and diverse settings. Therefore, in this paper, we overview real-world datasets used for fairness-aware machine learning. We focus on tabular data as the most common data representation for fairness-aware machine learning. We start our analysis by identifying relationships between the different attributes, particularly w.r.t. protected attributes and class attribute, using a Bayesian network. For a deeper understanding of bias in the datasets, we investigate the interesting relationships using exploratory analysis.


title: A survey on active noise control techniques -- Part I: Linear systems

abstract: Active noise control (ANC) is an effective way for reducing the noise level in electroacoustic or electromechanical systems. Since its first introduction in 1936, this approach has been greatly developed. This paper focuses on discussing the development of ANC techniques over the past decade. Linear ANC algorithms, including the celebrated filtered-x least-mean-square (FxLMS)-based algorithms and distributed ANC algorithms, are investigated and evaluated. Nonlinear ANC (NLANC) techniques, such as functional link artificial neural network (FLANN)-based algorithms, are pursued in Part II. Furthermore, some novel methods and applications of ANC emerging in the past decade are summarized. Finally, future research challenges regarding the ANC technique are discussed.


title: Layer-wise and Dimension-wise Locally Adaptive Federated Learning

abstract: In the emerging paradigm of Federated Learning (FL), large amount of clients such as mobile devices are used to train possibly high-dimensional models on their respective data. Combining (dimension-wise) adaptive gradient methods (e.g. Adam, AMSGrad) with FL has been an active direction, which is shown to outperform traditional SGD based FL in many cases. In this paper, we focus on the problem of training federated deep neural networks, and propose a novel FL framework which further introduces layer-wise adaptivity to the local model updates. Our framework can be applied to locally adaptive FL methods including two recent algorithms, Mime and Fed-AMS. Theoretically, we provide a convergence analysis of our layer-wise FL methods, coined Fed-LAMB and Mime-LAMB, which matches the convergence rate of state-of-the-art results in FL and exhibits linear speedup in terms of the number of workers. Experimental results on various datasets and models, under both IID and non-IID local data settings, show that both Fed-LAMB and Mime-LAMB achieve faster convergence speed and better generalization performance, compared to the various recent adaptive FL methods.


title: Relative Contagiousness of Emerging Virus Variants: An Analysis of the Alpha, Delta, and Omicron SARS-CoV-2 Variants

abstract: We propose a simple dynamic model for estimating the relative contagiousness of two virus variants. Maximum likelihood estimation and inference is conveniently invariant to variation in the total number of cases over the sample period and can be expressed as a logistic regression. We apply the model to Danish SARS-CoV-2 variant data. We estimate the reproduction numbers of Alpha and Delta to be larger than that of the ancestral variant by a factor of 1.51 [CI 95%: 1.50, 1.53] and 3.28 [CI 95%: 3.01, 3.58], respectively. In a predominately vaccinated population, we estimate Omicron to be 3.15 [CI 95%: 2.83, 3.50] times more infectious than Delta. Forecasting the proportion of an emerging virus variant is straight forward and we proceed to show how the effective reproduction number for a new variant can be estimated without contemporary sequencing results. This is useful for assessing the state of the pandemic in real time as we illustrate empirically with the inferred effective reproduction number for the Alpha variant.


title: TEACh: Task-driven Embodied Agents that Chat

abstract: Robots operating in human spaces must be able to engage in natural language interaction with people, both understanding and executing instructions, and using conversation to resolve ambiguity and recover from mistakes. To study this, we introduce TEACh, a dataset of over 3,000 human--human, interactive dialogues to complete household tasks in simulation. A Commander with access to oracle information about a task communicates in natural language with a Follower. The Follower navigates through and interacts with the environment to complete tasks varying in complexity from "Make Coffee" to "Prepare Breakfast", asking questions and getting additional information from the Commander. We propose three benchmarks using TEACh to study embodied intelligence challenges, and we evaluate initial models' abilities in dialogue understanding, language grounding, and task execution.


title: A Cram\'er Distance perspective on Quantile Regression based Distributional Reinforcement Learning

abstract: Distributional reinforcement learning (DRL) extends the value-based approach by approximating the full distribution over future returns instead of the mean only, providing a richer signal that leads to improved performances. Quantile Regression (QR) based methods like QR-DQN project arbitrary distributions into a parametric subset of staircase distributions by minimizing the 1-Wasserstein distance. However, due to biases in the gradients, the quantile regression loss is used instead for training, guaranteeing the same minimizer and enjoying unbiased gradients. Non-crossing constraints on the quantiles have been shown to improve the performance of QR-DQN for uncertainty-based exploration strategies. The contribution of this work is in the setting of fixed quantile levels and is twofold. First, we prove that the Cram\'er distance yields a projection that coincides with the 1-Wasserstein one and that, under non-crossing constraints, the squared Cram\'er and the quantile regression losses yield collinear gradients, shedding light on the connection between these important elements of DRL. Second, we propose a low complexity algorithm to compute the Cram\'er distance.


title: Spin liquid in twisted homobilayers group-VI gichalcogenides

abstract: Twisted transition metal dichalcogenide (TMD) homobilayers have recently emerged as a powerful platform for studying correlated insulating states. In the strongly correlated limit, we construct an effective spin Hamiltonian on a honeycomb lattice that includes the Heisenberg interaction and nonsymmetric interactions such as a Dzyaloshinskii-Moriya interaction and a Kane-Mele coupling for the Mott-insulating phase at half-filling. For the twisted TMD homobilayers, the spin-orbit coupling in the Hubbard model, which is expected to induce the antisymmetric exchange couplings in the effective spin Hamiltonian, is a highly tunable and experimentally accessible quantity that can be tuned by an applied electric field. In this study, we investigate classical and quantum phase diagrams of the effective spin Hamiltonian using analytical and numerical methods. We show that the model exhibits a rich classical phase diagram including an antiferromagnetic (AFM) phase, a planar spiral ordered phase with high classical degeneracy, a $z$-AFM phase, a noncoplanar phase, a noncollinear phase, and a 120$^{\circ}$-AFM phase. In the quantum treatment, we calculate low-energy magnon excitation spectrum, ground state energy, and static spin structure factor using linear spin-wave theory and density matrix renormalization group methods to compose the quantum phase diagram of the effective spin Hamiltonian. Beyond the Heisenberg interaction, we find that the existence of these antisymmetric couplings is responsible for the quantum spin liquid, $z$-AFM, noncoplanar, and 120$^{\circ}$ phases. Twisted TMD homobilayers, therefore, offer rich platforms for realizing rich phases of matter such as quantum spin liquid, noncoplanar, and 120$^{\circ}$, resulting from the spin-orbit coupling.


title: Robust iteration methods for complex systems with an indefinite matrix term

abstract: Complex valued systems with an indefinite matrix term arise in important applications such as for certain time-harmonic partial differential equations such as the Maxwell's equation and for the Helmholtz equation. Complex systems with symmetric positive definite matrices can be solved readily by rewriting the complex matrix system in two-by-two block matrix form with real matrices which can be efficiently solved by iteration using the preconditioned square block (PRESB) preconditioning method and preferably accelerated by the Chebyshev method. The appearances of an indefinite matrix term causes however some difficulties. To handle this we propose different forms of matrix splitting methods, with or without any parameters involved. A matrix spectral analyses is presented followed by extensive numerical comparisons of various forms of the methods.


title: Evaluating the fairness of fine-tuning strategies in self-supervised learning

abstract: In this work we examine how fine-tuning impacts the fairness of contrastive Self-Supervised Learning (SSL) models. Our findings indicate that Batch Normalization (BN) statistics play a crucial role, and that updating only the BN statistics of a pre-trained SSL backbone improves its downstream fairness (36% worst subgroup, 25% mean subgroup gap). This procedure is competitive with supervised learning, while taking 4.4x less time to train and requiring only 0.35% as many parameters to be updated. Finally, inspired by recent work in supervised learning, we find that updating BN statistics and training residual skip connections (12.3% of the parameters) achieves parity with a fully fine-tuned model, while taking 1.33x less time to train.


title: Applying Differential Privacy to Tensor Completion

abstract: Tensor completion aims at filling the missing or unobserved entries based on partially observed tensors. However, utilization of the observed tensors often raises serious privacy concerns in many practical scenarios. To address this issue, we propose a solid and unified framework that contains several approaches for applying differential privacy to the two most widely used tensor decomposition methods: i) CANDECOMP/PARAFAC~(CP) and ii) Tucker decompositions. For each approach, we establish a rigorous privacy guarantee and meanwhile evaluate the privacy-accuracy trade-off. Experiments on synthetic and real-world datasets demonstrate that our proposal achieves high accuracy for tensor completion while ensuring strong privacy protections.


title: Gate-tunable Intrinsic Anomalous Hall Effect in Epitaxial MnBi2Te4 Films

abstract: Anomalous Hall effect (AHE) is an important transport signature revealing topological properties of magnetic materials and their spin textures. Recently, antiferromagnetic MnBi2Te4 has been demonstrated to be an intrinsic magnetic topological insulator that exhibits quantum AHE in exfoliated nanoflakes. However, its complicated AHE behaviors may offer an opportunity for the unexplored correlation between magnetism and band structure. Here, we show the Berry curvature dominated intrinsic AHE in wafer-scale MnBi2Te4 thin films. By utilizing a high-dielectric SrTiO3 as the back-gate, we unveil an ambipolar conduction and electron-hole carrier (n-p) transition in ~7 septuple layer MnBi2Te4. A quadratic relation between the saturated AHE resistance and longitudinal resistance suggests its intrinsic AHE mechanism. For ~3 septuple layer MnBi2Te4, however, the AHE reverses its sign from pristine negative to positive under the electric-gating. The first-principles calculations demonstrate that such behavior is due to the competing Berry curvature between polarized spin-minority-dominated surface states and spin-majority-dominated inner-bands. Our results shed light on the physical mechanism of the gate-tunable intrinsic AHE in MnBi2Te4 thin films and provide a feasible approach to engineering its AHE.


title: Validating Robotics Simulators on Real-World Impacts

abstract: A realistic simulation environment is an essential tool in every roboticist's toolkit, with uses ranging from planning and control to training policies with reinforcement learning. Despite the centrality of simulation in modern robotics, little work has been done to compare the performance of robotics simulators against real-world data, especially for scenarios involving dynamic motions with high speed impact events. Handling dynamic contact is the computational bottleneck for most simulations, and thus the modeling and algorithmic choices surrounding impacts and friction form the largest distinctions between popular tools. Here, we evaluate the ability of several simulators to reproduce real-world trajectories involving impacts. Using experimental data, we identify system-specific contact parameters of popular simulators Drake, MuJoCo, and Bullet, analyzing the effects of modeling choices around these parameters. For the simple example of a cube tossed onto a table, simulators capture inelastic impacts well while failing to capture elastic impacts. For the higher-dimensional case of a Cassie biped landing from a jump, the simulators capture the bulk motion well but the accuracy is limited by numerous model differences between the real robot and the simulators.


title: RLO-MPC: Robust Learning-Based Output Feedback MPC for Improving the Performance of Uncertain Systems in Iterative Tasks

abstract: In this work we address the problem of performing a repetitive task when we have uncertain observations and dynamics. We formulate this problem as an iterative infinite horizon optimal control problem with output feedback. Previously, this problem was solved for linear time-invariant (LTI) system for the case when noisy full-state measurements are available using a robust iterative learning control framework, which we refer to as robust learning-based model predictive control (RL-MPC). However, this work does not apply to the case when only noisy observations of part of the state are available. This limits the applicability of current approaches in practice: First, in practical applications we typically do not have access to the full state. Second, uncertainties in the observations, when not accounted for, can lead to instability and constraint violations. To overcome these limitations, we propose a combination of RL-MPC with robust output feedback model predictive control, named robust learning-based output feedback model predictive control (RLO-MPC). We show recursive feasibility and stability, and prove theoretical guarantees on the performance over iterations. We validate the proposed approach with a numerical example in simulation and a quadrotor stabilization task in experiments.


title: Self-supervised Secondary Landmark Detection via 3D Representation Learning

abstract: Recent technological developments have spurred great advances in the computerized tracking of joints and other landmarks in moving animals, including humans. Such tracking promises important advances in biology and biomedicine. Modern tracking models depend critically on labor-intensive annotated datasets of primary landmarks by non-expert humans. However, such annotation approaches can be costly and impractical for secondary landmarks, that is, ones that reflect fine-grained geometry of animals, and that are often specific to customized behavioral tasks. Due to visual and geometric ambiguity, nonexperts are often not qualified for secondary landmark annotation, which can require anatomical and zoological knowledge. These barriers significantly impede downstream behavioral studies because the learned tracking models exhibit limited generalizability. We hypothesize that there exists a shared representation between the primary and secondary landmarks because the range of motion of the secondary landmarks can be approximately spanned by that of the primary landmarks. We present a method to learn this spatial relationship of the primary and secondary landmarks in three dimensional space, which can, in turn, self-supervise the secondary landmark detector. This 3D representation learning is generic, and can therefore be applied to various multiview settings across diverse organisms, including macaques, flies, and humans.


title: Associahedra minimize $f$-vectors of secondary polytopes of planar point sets

abstract: Kupavskii, Volostnov, and Yarovikov have recently shown that any set of $n$ points in general position in the plane has at least as many (partial) triangulations as the convex $n$-gon. We generalize this in two directions: we show that regular triangulations are enough, and we extend the result to all regular subdivisions, graded by the dimension of their corresponding face in the secondary polytope


title: On Jacobians of geometrically reduced curves and their N\'eron models

abstract: We study the structure of Jacobians of geometrically reduced curves over arbitrary (i. e., not necessarily perfect) fields. We show that, while such a group scheme cannot in general be decomposed into an affine and an Abelian part as over perfect fields, several important structural results for these group schemes nevertheless have close analoga over non-perfect fields. We apply our results to prove two conjectures due to Bosch-L\"utkebohmert-Raynaud about the existence of N\'eron models and N\'eron lft-models over excellent Dedekind schemes in the special case of Jacobians of geometrically reduced curves. Finally, we prove some existence results for semi-factorial models and related objects for general geometrically integral curves in the local case.


title: Discovery of interpretable structural model errors by combining Bayesian sparse regression and data assimilation: A chaotic Kuramoto-Sivashinsky test case

abstract: Models of many engineering and natural systems are imperfect. The discrepancy between the mathematical representations of a true physical system and its imperfect model is called the model error. These model errors can lead to substantial differences between the numerical solutions of the model and the state of the system, particularly in those involving nonlinear, multi-scale phenomena. Thus, there is increasing interest in reducing model errors, particularly by leveraging the rapidly growing observational data to understand their physics and sources. Here, we introduce a framework named MEDIDA: Model Error Discovery with Interpretability and Data Assimilation. MEDIDA only requires a working numerical solver of the model and a small number of noise-free or noisy sporadic observations of the system. In MEDIDA, first the model error is estimated from differences between the observed states and model-predicted states (the latter are obtained from a number of one-time-step numerical integrations from the previous observed states). If observations are noisy, a data assimilation (DA) technique such as ensemble Kalman filter (EnKF) is employed to provide the analysis state of the system, which is then used to estimate the model error. Finally, an equation-discovery technique, here the relevance vector machine (RVM), a sparsity-promoting Bayesian method, is used to identify an interpretable, parsimonious, and closed-form representation of the model error. Using the chaotic Kuramoto-Sivashinsky (KS) system as the test case, we demonstrate the excellent performance of MEDIDA in discovering different types of structural/parametric model errors, representing different types of missing physics, using noise-free and noisy observations.

categories: physics.comp-ph cs.NA math.NA physics.flu-dyn stat.CO stat.ML


title: Self-Supervised Decomposition, Disentanglement and Prediction of Video Sequences while Interpreting Dynamics: A Koopman Perspective

abstract: Human interpretation of the world encompasses the use of symbols to categorize sensory inputs and compose them in a hierarchical manner. One of the long-term objectives of Computer Vision and Artificial Intelligence is to endow machines with the capacity of structuring and interpreting the world as we do. Towards this goal, recent methods have successfully been able to decompose and disentangle video sequences into their composing objects and dynamics, in a self-supervised fashion. However, there has been a scarce effort in giving interpretation to the dynamics of the scene. We propose a method to decompose a video into moving objects and their attributes, and model each object's dynamics with linear system identification tools, by means of a Koopman embedding. This allows interpretation, manipulation and extrapolation of the dynamics of the different objects by employing the Koopman operator K. We test our method in various synthetic datasets and successfully forecast challenging trajectories while interpreting them.


title: Spirality and Rectilinear Planarity Testing of Independent-Parallel SP-Graphs

abstract: We study the long-standing open problem of efficiently testing rectilinear planarity of series-parallel graphs (SP-graphs) in the variable embedding setting. A key ingredient behind the design of a linear-time testing algorithm for SP-graphs of vertex-degree at most three is that one can restrict the attention to a constant number of ``rectilinear shapes'' for each series or parallel component. To formally describe these shapes the notion of spirality can be used. This key ingredient no longer holds for SP-graphs with vertices of degree four, as we prove a logarithmic lower bound on the spirality of their components. The bound holds even for the independent-parallel SP-graphs, in which no two parallel components share a pole. Nonetheless, by studying the spirality properties of the independent-parallel SP-graphs, we are able to design a linear-time rectilinear planarity testing algorithm for this graph family.


title: Video Temporal Relationship Mining for Data-Efficient Person Re-identification

abstract: This paper is a technical report to our submission to the ICCV 2021 VIPriors Re-identification Challenge. In order to make full use of the visual inductive priors of the data, we treat the query and gallery images of the same identity as continuous frames in a video sequence. And we propose one novel post-processing strategy for video temporal relationship mining, which not only calculates the distance matrix between query and gallery images, but also the matrix between gallery images. The initial query image is used to retrieve the most similar image from the gallery, then the retrieved image is treated as a new query to retrieve its most similar image from the gallery. By iteratively searching for the closest image, we can achieve accurate image retrieval and finally obtain a robust retrieval sequence.


title: Were recently reported MHz events planet mass primordial black hole mergers?

abstract: A bulk acoustic wave cavity as high frequency gravitational wave antenna has recently detected two rare events at $5.5$MHz. Assuming that the detected events are due to gravitational waves, their characteristic strain amplitude lies at about $h_c\approx 2.5 \times 10^{-16}$. While a cosmological signal is out of the picture due to the large energy carried by the high frequency waves, the signal could be due to the merging of two planet mass primordial black holes ($\approx 4\times 10^{-4} M_\odot$) inside the Oort cloud at roughly $0.025$ pc ($5300$ AU) away. In this short note, we show that the probability of one such event to occur within this volume per year is around $1:10^{24}$, if such Saturn-like mass primordial black holes are $1\%$ of the dark matter. Thus, the detected signal is very unlikely to be due the merger of planet mass primordial black holes. Nevertheless, the stochastic background of saturn mass primordial black holes binaries might be seen by next generation gravitational wave detectors, such as DECIGO and BBO.


title: A Minimal Physics-Based Model on the Electrochemical Impedance Spectroscopy of Solid-State Electrolyte

abstract: Solid state batteries have emerged as a potential next-generation energy storage device due to safety and energy density advantages. Development of electrolyte is one of the most important topics in solid state batteries. Electrochemical Impedance Spectroscopy (EIS) is a popular measurement technique to obtain the conductivity and diagnose the electrolyte. Current interpretation mainly uses the semicircle part of the curves and discards other information revealed by EIS such as the slope of the curve at low frequency. What is worse, some features on the curve are not fully interpreted. To better understand the transport mechanism and interpret EIS curves, we introduce a continuous model to quantify the ion transport and current flow in the electrolyte. The produced EIS curves from the model are compared with experiment data to show good agreement.


title: Stochastic Contrastive Learning

abstract: While state-of-the-art contrastive Self-Supervised Learning (SSL) models produce results competitive with their supervised counterparts, they lack the ability to infer latent variables. In contrast, prescribed latent variable (LV) models enable attributing uncertainty, inducing task specific compression, and in general allow for more interpretable representations. In this work, we introduce LV approximations to large scale contrastive SSL models. We demonstrate that this addition improves downstream performance (resulting in 96.42% and 77.49% test top-1 fine-tuned performance on CIFAR10 and ImageNet respectively with a ResNet50) as well as producing highly compressed representations (588x reduction) that are useful for interpretability, classification and regression downstream tasks.


title: Channel Estimation with Reconfigurable Intelligent Surfaces -- A General Framework

abstract: Optimally extracting the advantages available from reconfigurable intelligent surfaces (RISs) in wireless communications systems requires estimation of the channels to and from the RIS. The process of determining these channels is complicated by the fact that the RIS is typically composed of passive elements without any data processing capabilities, and thus the channels must be estimated indirectly by a non-colocated device, typically a controlling base station. In this article, we examine channel estimation for RIS-based systems from a fundamental viewpoint. We study various possible channel models and the identifiability of the models as a function of the available pilot data and behavior of the RIS during training. In particular, we consider situations with and without line-of-sight propagation, single- and multiple-antenna configurations for the users and base station, correlated and sparse channel models, single-carrier and wideband OFDM scenarios, availability of direct links between the users and base station, exploitation of prior information, as well as a number of other special cases. We further conduct numerical comparisons of achievable performance for various channel models using the relevant Cramer-Rao bounds.


title: High-resolution solutions of nonlinear, advection-dominated problems using a generalized finite element method

abstract: Traditional finite element approaches are well-known to introduce spurious oscillations when applied to advection-dominated problems. We explore alleviation of this issue from the perspective of a generalized finite element formulation, which enables stabilization through an enrichment process. The presented work uses solution-tailored enrichments for the numerical solution of the one-dimensional, unsteady Burgers equation. Mainly, generalizable exponential and hyperbolic tangent enrichments effectively capture local, steep boundary layer/shock features. Results show natural alleviation of oscillations and return smooth numerical solutions over coarse grids. Additionally, significantly improved error levels are observed compared to Lagrangian finite element methods.


title: Design of multiplicative watermarking against covert attacks

abstract: This paper addresses the design of an active cyberattack detection architecture based on multiplicative watermarking, allowing for detection of covert attacks. We propose an optimal design problem, relying on the so-called output-to-output l2-gain, which characterizes the maximum gain between the residual output of a detection scheme and some performance output. Although optimal, this control problem is non-convex. Hence, we propose an algorithm to design the watermarking filters by solving the problem suboptimally via LMIs. We show that, against covert attacks, the output-to-output l2-gain is unbounded without watermarking, and we provide a sufficient condition for boundedness in the presence of watermarks.


title: 1D Supergravity FLRW Model of Starobinsky

abstract: We study two homogeneous supersymmetric extensions for the $f(R)$ modified gravity model of Starobinsky with the FLRW metric. The actions are defined in terms of a superfield $\mathcal{R}$ that contains the FLRW scalar curvature. One model has N=1 local supersymmetry, and its bosonic sector is the Starobinsky action; the other action has N=2, its bosonic sector contains, in additional to Starobinsky, a massive scalar field without self-interaction. As expected, the bosonic sectors of these models are consistent with cosmic inflation, as we show by solving numerically the classical dynamics. Inflation is driven by the $R^2$ term during the large curvature regime. In the N=2 case, the additional scalar field remains in a low energy state during inflation. Further, by means of an additional superfield, we write equivalent tensor-scalar-like actions from which we can give the Hamiltonian formulation.


title: The QICK (Quantum Instrumentation Control Kit): Readout and control for qubits and detectors

abstract: We introduce a Xilinx RFSoC-based qubit controller (called the Quantum Instrumentation Control Kit, or QICK for short) which supports the direct synthesis of control pulses with carrier frequencies of up to 6 GHz. The QICK can control multiple qubits or other quantum devices. The QICK consists of a digital board hosting an RFSoC (RF System-on-Chip) FPGA \cite{zcu111}, custom firmware and software and an optional companion custom-designed analog front-end board. We characterize the analog performance of the system, as well as its digital latency, important for quantum error correction and feedback protocols. We benchmark the controller by performing standard characterizations of a transmon qubit. We achieve an average Clifford gate fidelity of $\mathcal{F}_{avg}=99.93\%$. All of the schematics, firmware, and software are open-source \cite{QICKrepo}.


title: Natural language understanding for logical games

abstract: We developed a system able to automatically solve logical puzzles in natural language. Our solution is composed by a parser and an inference module. The parser translates the text into first order logic (FOL), while the MACE4 model finder is used to compute the models of the given FOL theory. We also empower our software agent with the capability to provide Yes/No answers to natural language questions related to each puzzle. Moreover, in line with Explainalbe Artificial Intelligence (XAI), the agent can back its answer, providing a graphical representation of the proof. The advantage of using reasoning for Natural Language Understanding (NLU) instead of Machine learning is that the user can obtain an explanation of the reasoning chain. We illustrate how the system performs on various types of natural language puzzles, including 382 knights and knaves puzzles. These features together with the overall performance rate of 80.89\% makes the proposed solution an improvement upon similar solvers for natural language understanding in the puzzles domain.


title: Nonadiabatic Fluctuations and the Charge-Density-Wave Transition in One-Dimensional Electron-Phonon Systems: a Dynamic Self-Consistent

abstract: The Peierls instability in one-dimensional electron-phonon systems is known to be qualitatively well described by the Mean-Field theory, however the related self-consistent problem so far has only been able to predict a partial suppression of the transition even with proper account of classical lattice fluctuations. Here the Hartree-Fock approximation scheme is extended to the full quantum regime, by mapping the momentum-frequency spectrum of order-parameter fluctuations onto a continuous two-parameter space. For the one-dimensional half-filled Su-Schrieffer-Heeger model the ratio $d=\Omega/2\pi T_c^0$, where $\Omega$ is the characteristic phonon frequency and $2\pi T_c^0$ the lowest finite phonon Matsubara frequency at the mean-field critical point $T_c^0$, provides a natural measure of the adiabaticity of lattice fluctuations. By integrating out finite-frequency phonons, it is found that a variation of $d$ from the classical regime $d=0$ continuously connects $T_c^0$ to a zero-temperature charge-density-wave transition setting up at a finite crossover $d=d_c$. This finite crossover decreases within the range $0\leq d \approx 1$ as the electron-phonon coupling strength increases but remaining small enough for weak-coupling considerations to still hold. Implications of $T_c$ supression on the Ginzburg criterion is discussed, and evidence is given of a possible coherent description of the charge-density-wave problem within the framework of a renormalized Mean-Field theory encompassing several aspects of the transition including its thermodynamics close to the quantum critical point.


title: Improving Punctuation Restoration for Speech Transcripts via External Data

abstract: Automatic Speech Recognition (ASR) systems generally do not produce punctuated transcripts. To make transcripts more readable and follow the expected input format for downstream language models, it is necessary to add punctuation marks. In this paper, we tackle the punctuation restoration problem specifically for the noisy text (e.g., phone conversation scenarios). To leverage the available written text datasets, we introduce a data sampling technique based on an n-gram language model to sample more training data that are similar to our in-domain data. Moreover, we propose a two-stage fine-tuning approach that utilizes the sampled external data as well as our in-domain dataset for models based on BERT. Extensive experiments show that the proposed approach outperforms the baseline with an improvement of 1:12% F1 score.


title: The global regularity of vortex patches revisited

abstract: We prove persistence of the regularity of the boundary of vortex patches for a large class of transport equations in the plane. The velocity field is given by convolution of the vorticity with an odd kernel, homogeneous of degree $-1$ and of class $C^2$ off the origin.


title: Computational Complexity of Deciding Provability in Linear Logic and its Fragments

abstract: Linear logic was conceived in 1987 by Girard and, in contrast to classical logic, restricts the usage of the structural inference rules of weakening and contraction. With this, atoms of the logic are no longer interpreted as truth, but as information or resources. This interpretation makes linear logic a useful tool for formalisation in mathematics and computer science. Linear logic has, for example, found applications in proof theory, quantum logic, and the theory of programming languages. A central problem of the logic is the question whether a given list of formulas is provable with the calculus. In the research regarding the complexity of this problem, some results were achieved, but other questions are still open. To present these questions and give new perspectives, this thesis consists of three main parts which build on each other: We present the syntax, proof theory, and various approaches to a semantics for linear logic. Here already, we will meet some open research questions. We present the current state of the complexity-theoretic characterization of the most important fragments of linear logic. Here, further research problems are presented and it becomes apparent that until now, the results have all made use of different approaches. We prove an original complexity characterization of a fragment of the logic and present ideas for a new, structural approach to the examination of provability in linear logic.


title: Early completion based on multiple dosages to accelerate maximum tolerated dose-finding

abstract: Background: Phase I trials desire to identify the maximum tolerated dose (MTD) early and proceed quickly to an expansion cohort or phase II trial for efficacy. We propose an early completion method based on multiple dosages to accelerate the identification of MTD for model-assisted designs. Methods: The early completion performs based on each dose-assignment probability for multiple dosages. The formulas of probabilities are simple to calculate. We evaluated the early completion for an actual trial. In addition, a simulation study performed the percentage of correct MTD selection and early completion. Results: In the actual trial, the early completion could perform, and the MTD estimation phase could be shortened. In the simulation study, the change in the percentage of correct MTD selection from non-early completion version was 2.2% at the maximum, indicating that there was almost no decrease. In addition, depending on the toxicity rate, the percentage of correct MTD selection improved compared to the non-early completion version. The early completion performed from 18.1% to 90.8%. Conclusion: We propose the early completion method with not only little reduction in accuracy but also improving the percentage of correct MTD selection. We conclude the early completion can perform unproblematically for model-assisted design.


title: Spin-Triplet Pairing Induced by Near-Neighbor Attraction in the Cuprate Chain

abstract: In quantum materials, the electronic interaction and the electron-phonon coupling are, in general, two essential ingredients, the combined impact of which may drive exotic phases. Recently, an anomalously strong electron-electron attraction, mediated by phonons, has been unveiled in one-dimensional copper-oxide chain Ba$_{2-x}$Sr$_x$CuO$_{3+\delta}$. Yet, it is unclear how this strong near-neighbor attraction $V$ influences the superconductivity pairing in the compound. Here we perform accurate many-body calculations to study the extended Hubbard model with on-site Coulomb repulsion $U>0$ and attraction $V<0$ that well describes the cuprate chain and likely other similar transition-metal materials with both strong correlations and lattice effects. We find a rich quantum phase diagram containing an intriguing Tomonaga-Luttinger liquid phase -- besides the spin density wave and various phase separation phases -- that can host dominant spin-triplet pairing correlations and divergent superconductive susceptibility. Upon doping, the spin-triplet superconducting regime can be further broadened in the parameter space and extends to larger $U$, offering a feasible mechanism to realize $p$-wave superconductivity in realistic cuprate chains.


title: Static Potential At Non-zero Temperatures From Fine Lattices

abstract: We report on a preliminary study of static quark anti-quark potential at non-zero temperature in $2+1$ flavor QCD using $96^3\times N_{\tau}$ lattices with lattice spacing $a=0.028$fm, physical strange quark mass and light quark masses corresponding to pion mass of about $300$ MeV. We use $N_\tau=32,~24,~20$ and $16$ that correspond to temperature range $T=220-441$ MeV. The in order to obtain the potential we calculate the Wilson line correlator in Coulomb gauge with additional HYP smearing to reduce the noise at large quark anti-quark separations. We apply $0$, $5$ and $10$ steps of HYP smearing to ensure that there is no physical effect from over-smearing. At the two highest temperatures we also consider a noise reduction technique that is based on an interpolation in the spatial separation between the static quark and anti-quark.


title: Fast full $N$-body simulations of generic modified gravity: derivative coupling models

abstract: We present MG-GLAM, a code developed for the very fast production of full $N$-body cosmological simulations in modified gravity (MG) models. We describe the implementation, numerical tests and first results of a large suite of cosmological simulations for two broad classes of MG models with derivative coupling terms -- the Vainshtein- and Kmouflage-type models -- which respectively features the Vainshtein and Kmouflage screening mechanism. Derived from the parallel particle-mesh code GLAM, MG-GLAM incorporates an efficient multigrid relaxation technique to solve the characteristic nonlinear partial differential equations of these models. For Kmouflage, we have proposed a new algorithm for the relaxation solver, and run the first simulations of the model to understand its cosmological behaviour. In a companion paper, we describe versions of this code developed for conformally-coupled MG models, including several variants of $f(R)$ gravity, the symmetron model and coupled quintessence. Altogether, MG-GLAM has so far implemented the prototypes for most MG models of interest, and is broad and versatile. The code is highly optimised, with a tremendous (over two orders of magnitude) speedup when comparing its running time with earlier $N$-body codes, while still giving accurate predictions of the matter power spectrum and dark matter halo abundance. MG-GLAM is ideal for the generation of large numbers of MG simulations that can be used in the construction of mock galaxy catalogues and accurate emulators for ongoing and future galaxy surveys.


title: Weight Vector Tuning and Asymptotic Analysis of Binary Linear Classifiers

abstract: Unlike its intercept, a linear classifier's weight vector cannot be tuned by a simple grid search. Hence, this paper proposes weight vector tuning of a generic binary linear classifier through the parameterization of a decomposition of the discriminant by a scalar which controls the trade-off between conflicting informative and noisy terms. By varying this parameter, the original weight vector is modified in a meaningful way. Applying this method to a number of linear classifiers under a variety of data dimensionality and sample size settings reveals that the classification performance loss due to non-optimal native hyperparameters can be compensated for by weight vector tuning. This yields computational savings as the proposed tuning method reduces to tuning a scalar compared to tuning the native hyperparameter, which may involve repeated weight vector generation along with its burden of optimization, dimensionality reduction, etc., depending on the classifier. It is also found that weight vector tuning significantly improves the performance of Linear Discriminant Analysis (LDA) under high estimation noise. Proceeding from this second finding, an asymptotic study of the misclassification probability of the parameterized LDA classifier in the growth regime where the data dimensionality and sample size are comparable is conducted. Using random matrix theory, the misclassification probability is shown to converge to a quantity that is a function of the true statistics of the data. Additionally, an estimator of the misclassification probability is derived. Finally, computationally efficient tuning of the parameter using this estimator is demonstrated on real data.


title: Conditional Deep Gaussian Processes: empirical Bayes hyperdata learning

abstract: It is desirable to combine the expressive power of deep learning with Gaussian Process (GP) in one expressive Bayesian learning model. Deep kernel learning showed success in adopting a deep network for feature extraction followed by a GP used as function model. Recently,it was suggested that, albeit training with marginal likelihood, the deterministic nature of feature extractor might lead to overfitting while the replacement with a Bayesian network seemed to cure it. Here, we propose the conditional Deep Gaussian Process (DGP) in which the intermediate GPs in hierarchical composition are supported by the hyperdata and the exposed GP remains zero mean. Motivated by the inducing points in sparse GP, the hyperdata also play the role of function supports, but are hyperparameters rather than random variables. We follow our previous moment matching approach to approximate the marginal prior for conditional DGP with a GP carrying an effective kernel. Thus, as in empirical Bayes, the hyperdata are learned by optimizing the approximate marginal likelihood which implicitly depends on the hyperdata via the kernel. We shall show the equivalence with the deep kernel learning in the limit of dense hyperdata in latent space. However, the conditional DGP and the corresponding approximate inference enjoy the benefit of being more Bayesian than deep kernel learning. Preliminary extrapolation results demonstrate expressive power from the depth of hierarchy by exploiting the exact covariance and hyperdata learning, in comparison with GP kernel composition, DGP variational inference and deep kernel learning. We also address the non-Gaussian aspect of our model as well as way of upgrading to a full Bayes inference.