title: Rephased CLuP

abstract: In \cite{Stojnicclupint19,Stojnicclupcmpl19,Stojnicclupplt19} we introduced CLuP, a \bl{\textbf{Random Duality Theory (RDT)}} based algorithmic mechanism that can be used for solving hard optimization problems. Due to their introductory nature, \cite{Stojnicclupint19,Stojnicclupcmpl19,Stojnicclupplt19} discuss the most fundamental CLuP concepts. On the other hand, in our companion paper \cite{Stojniccluplargesc20} we started the story of going into a bit deeper details that relate to many of other remarkable CLuP properties with some of them reaching well beyond the basic fundamentals. Namely, \cite{Stojniccluplargesc20} discusses how a somewhat silent RDT feature (its algorithmic power) can be utilized to ensure that CLuP can be run on very large problem instances as well. In particular, applying CLuP to the famous MIMO ML detection problem we showed in \cite{Stojniccluplargesc20} that its a large scale variant, $\text{CLuP}^{r_0}$, can handle with ease problems with \textbf{\emph{several thousands}} of unknowns with theoretically minimal complexity per iteration (only a single matrix-vector multiplication suffices). In this paper we revisit MIMO ML detection and discuss another remarkable phenomenon that emerges within the CLuP structure, namely the so-called \bl{\textbf{\emph{rephasing}}}. As MIMO ML enters the so-called low $\alpha$ regime (fat system matrix with ratio of the number of rows and columns, $\alpha$, going well below $1$) it becomes increasingly difficult even for the basic standard CLuP to handle it. However, the discovery of the rephasing ensures that CLuP remains on track and preserves its ability to achieve the ML performance. To demonstrate the power of the rephasing we also conducted quite a few numerical experiments, compared the results we obtained through them to the theoretical predictions, and observed an excellent agreement.


title: Elastic Interaction of Particles for Robotic Tactile Simulation

abstract: Tactile sensing plays an important role in robotic perception and manipulation. To overcome the real-world limitations of data collection, simulating tactile response in virtual environment comes as a desire direction of robotic research. Most existing works model the tactile sensor as a rigid multi-body, which is incapable of reflecting the elastic property of the tactile sensor as well as characterizing the fine-grained physical interaction between two objects. In this paper, we propose Elastic Interaction of Particles (EIP), a novel framework for tactile emulation. At its core, EIP models the tactile sensor as a group of coordinated particles, and the elastic theory is applied to regulate the deformation of particles during the contact process. The implementation of EIP is conducted from scratch, without resorting to any existing physics engine. Experiments to verify the effectiveness of our method have been carried out on two applications: robotic perception with tactile data and 3D geometric reconstruction by tactile-visual fusion. It is possible to open up a new vein for robotic tactile simulation, and contribute to various downstream robotic tasks.


title: Chiral excitation and effective bandwidth enhancement in tilted coupled optical waveguide lattices

abstract: Light escape from an optical waveguide side-coupled to a waveguide lattice provides a photonic analogue of the spontaneous emission process of an excited two-level atom in a one-dimensional array of cavities. According to the Fermi golden rule the decay process is prevented when the atomic resonance frequency falls in a stop band of the lattice, while time-reversal symmetry ensures that the spontaneously emitted photon has equal probability to propagate in opposite directions of the array. This scenario is drastically modified when the quantum emitter drifts along the lattice at a constant speed. In the waveguide optics analogue the atomic drift is emulated by the introduction of a slight geometric tilt of the waveguide axis from the lattice axis. In this setting light excitation in the array is chiral, i.e. light propagates in a preferred direction of the lattice, and coupling is allowed even though the waveguide is far detuned from the tight-binding lattice band.


title: Influence of some cardiovascular risk factors on the rela-tionship between age and blood pressure

abstract: Blood Pressure (BP) is a biological signal related to the cardiovascular system that inevitably is affected by ageing. Moreover, it is also influenced by the presence of cardiovascular risk factors. To evaluate how the relationship be-tween BP and age changes with the presence of risk factors in hypertensive and normotensive subjects, we analyzed 880 subjects with and without smoking, obe-sity, diabetes mellitus and dyslipidemia. A regression line fitted each BP/Age relation calculated separately for normotensive and hypertensive subjects with and without risk factors. For each of the four conditions the office and the 24-hour ambulatory BP monitoring (ABPM) were considered. In subjects with and without risk factors, the slopes of the Systolic BP/Age relation were higher in hypertensive than in normotensive subjects in both office and ABPM conditions. Moreover, the presence of risk factors modified the Systolic BP/Age relation in hypertensive subjects by using either office or ABPM measurements. Finally, we confirmed that the difference between the two modalities depends on age too.


title: Functional Imaging for Dose Painting in Radiotherapy

abstract: Dose painting has been developed to modulate the required dose in the target area without increasing the toxicity in healthy areas. Apart from determining the accurate location and size of tumors, quantitative functional imaging can be used to implement the dose painting. Functional imaging, such as multi-parameter MRI and PET CT, allows us to achieve biological dose escalation by increasing the dose in certain areas or voxels that are therapy-resistant in the gross tumor volume while reducing the dose in the less aggressive area or voxels. Functional imaging can serve as an indicator of therapeutic intervention in radiotherapy due to microscopic tissue properties. With such biological indicators, the personalized radiation dose can be tailored to a specific contour or a voxel using dose painting. In this review, we firstly discuss several quantitative functional imaging techniques including PET-CT and multi-parameter MRI. Furthermore, theoretical and experimental comparisons for dose painting by contours (DPBC) and dose painting by numbers (DPBN), along with outcome analysis after dose painting are provided. Finally, we conclude major challenges and future directions in this field through which we hope to inspire exciting developments and fruitful research avenues.


title: Kinematics of slip-induced rotation for uniaxial shock or ramp compression

abstract: When a metallic specimen is plastically deformed, its underlying crystal structure must often rotate in order to comply with its macroscopic boundary conditions. There is growing interest within the dynamic compression community in exploiting x-ray diffraction measurements of lattice rotation to infer which combinations of plasticity mechanisms are operative in uniaxially shock- or ramp-compressed crystals, thus informing materials science at the greatest extremes of pressure and strain rate. However, it is not widely appreciated that several of the existing models linking rotation to slip activity are fundamentally inapplicable to a planar compression scenario. We present molecular dynamics simulations of single crystals suffering true uniaxial strain, and show that the Schmid and Taylor analyses used in traditional materials science fail to predict the ensuing lattice rotation. We propose a simple alternative framework based on the elastoplastic decomposition that successfully recovers the observed rotation for these single crystals, and can further be used to identify the operative slip systems and the amount of activity upon them in the idealized cases of single and double slip.


title: Control and optimal stopping Mean Field Games: a linear programming approach

abstract: We develop the linear programming approach to mean-field games in a general setting. This relaxed control approach allows to prove existence results under weak assumptions, and lends itself well to numerical implementation. We consider mean-field game problems where the representative agent chooses both the optimal control and the optimal time to exit the game, where the instantaneous reward function and the coefficients of the state process may depend on the distribution of the other agents. Furthermore, we establish the equivalence between mean-field games equilibria obtained by the linear programming approach and the ones obtained via the controlled/stopped martingale approach, another relaxation method used in a few previous papers in the case when there is only control.


title: Accurate 3D Hand Pose Estimation for Whole-Body 3D Human Mesh Estimation

abstract: Whole-body 3D human mesh estimation aims to reconstruct the 3D human body, hands, and face simultaneously. Although several methods have been proposed, accurate prediction of 3D hands, which consist of 3D wrist and fingers, still remains challenging due to two reasons. First, the human kinematic chain has not been carefully considered when predicting the 3D wrists. Second, previous works utilize body features for the 3D fingers, where the body feature barely contains finger information. To resolve the limitations, we present Hand4Whole, which has two strong points over previous works. First, we design Pose2Pose, a module that utilizes joint features for 3D joint rotations. Using Pose2Pose, Hand4Whole utilizes hand MCP joint features to predict 3D wrists as MCP joints largely contribute to 3D wrist rotations in the human kinematic chain. Second, Hand4Whole discards the body feature when predicting 3D finger rotations. Our Hand4Whole is trained in an end-to-end manner and produces much better 3D hand results than previous whole-body 3D human mesh estimation methods. The codes are available here at https://github.com/mks0601/Hand4Whole_RELEASE.


title: From hidden metal-insulator transition to Planckian-like dissipation by tuning disorder in a nickelate

abstract: Heavily oxygen deficient NdNiO$_3$ (NNO) films, which are insulating due to electron localization, contain pristine regions that undergo a hidden metal-insulator transition. Increasing oxygen content increases the connectivity of the metallic regions and the metal-insulator transition is first revealed, upon reaching the percolation threshold, by the presence of hysteresis. Only upon further oxygenation is the global metallic state (with a change in the resistivity slope) eventually achieved. It is shown that sufficient oxygenation leads to linear temperature dependence of resistivity in the metallic state, with a scattering rate directly proportional to temperature. Despite the known difficulties to establish the proportionality constant, the experiments are consistent with a relationship 1/$\tau$= $\alpha k_B T/\hbar$, with $\alpha$ not far from unity. These results could provide experimental support for recent theoretical predictions of disorder in a two-fluid model as a possible origin of Planckian dissipation.


title: Studying Taxonomy Enrichment on Diachronic WordNet Versions

abstract: Ontologies, taxonomies, and thesauri are used in many NLP tasks. However, most studies are focused on the creation of these lexical resources rather than the maintenance of the existing ones. Thus, we address the problem of taxonomy enrichment. We explore the possibilities of taxonomy extension in a resource-poor setting and present methods which are applicable to a large number of languages. We create novel English and Russian datasets for training and evaluating taxonomy enrichment models and describe a technique of creating such datasets for other languages.


title: Primordial Deuterium after LUNA: concordances and error budget

abstract: The accurate evaluation of the nuclear reaction rates and corresponding uncertainties is an essential requisite for a precise determination of light nuclide primordial abundances. The recent measurement of the D(p,gamma)3He radiative capture cross section by the LUNA collaboration, with its order 3% error, represents an important step in improving the theoretical prediction for Deuterium produced in the early universe. In view of this recent result, we present in this paper a full analysis of its abundance, which includes a new critical study of the impact of the other two main processes for Deuterium burning, namely the deuteron-deuteron transfer reactions, D(d,p)3H and D(d,n)3He. In particular, emphasis is given to the statistical method of analysis of experimental data, to a quantitative study of the theoretical uncertainties, and a comparison with similar studies presented in the recent literature. We then discuss the impact of our study on the concordance of the primordial nucleosynthesis stage with the Planck experiment results on the baryon density Omegab h2 and the effective number of neutrino parameter Neff, as function of the assumed value of the 4He mass fraction Yp. While after the LUNA results, the value of Deuterium is quite precisely fixed, and points to a value of the baryon density in excellent agreement with the Planck result, a combined analysis also including Helium leads to two possible scenarios with different predictions for Omegab h2 and Neff. We argue that new experimental results on the systematics and the determination of Yp would be of great importance in assessing the overall concordance of the standard cosmological model.


title: Exploring Alternatives to Softmax Function

abstract: Softmax function is widely used in artificial neural networks for multiclass classification, multilabel classification, attention mechanisms, etc. However, its efficacy is often questioned in literature. The log-softmax loss has been shown to belong to a more generic class of loss functions, called spherical family, and its member log-Taylor softmax loss is arguably the best alternative in this class. In another approach which tries to enhance the discriminative nature of the softmax function, soft-margin softmax (SM-softmax) has been proposed to be the most suitable alternative. In this work, we investigate Taylor softmax, SM-softmax and our proposed SM-Taylor softmax, an amalgamation of the earlier two functions, as alternatives to softmax function. Furthermore, we explore the effect of expanding Taylor softmax up to ten terms (original work proposed expanding only to two terms) along with the ramifications of considering Taylor softmax to be a finite or infinite series during backpropagation. Our experiments for the image classification task on different datasets reveal that there is always a configuration of the SM-Taylor softmax function that outperforms the normal softmax function and its other alternatives.


title: Theoretical investigation of quantum capacitance in the functionalized MoS$_2$-monolayer

abstract: In this work, we investigated the electronic structure and the quantum capacitance of the functionalized MoS$_2$ monolayer. The functionalizations have been done by using different ad-atom adsorption on Mo$S_2$ monolayer. Density functional theory calculations are performed to obtain an accurate electronic structure of ad-atom doped MoS$_2$ monolayer with a varying degree of doping concentration. The quantum capacitance of the systems was subsequently estimated. A marked quantum capacitance above 200 $\mu$F/cm$^2$ has been observed. Our calculations show that the quantum capacitance of MoS$_2$ monolayer is significantly enhanced with substitutional doping of Mo with transition metal ad-atoms. The microscopic origin of such enhancement in quantum capacitance in this system has been analyzed. Our DFT-based calculation shows that generation of new electronic states at the proximity of the band-edge and the shift of Fermi level caused by the ad-atom adsorption results in a very high quantum capacitance in the system.


title: Decision Support for the Quickest Detection of Critical COVID-19 Phases

abstract: During the course of an epidemic, one of the most challenging tasks for authorities is to decide what kind of restrictive measures to introduce and when these should be enforced. In order to take informed decisions in a fully rational manner, the onset of a critical regime, characterized by an exponential growth of the contagion, must be identified as quickly as possible. Providing rigorous quantitative tools to detect such an onset represents an important contribution from the scientific community to proactively support the political decision makers. In this paper, leveraging the quickest detection theory, we propose a mathematical model of the COVID-19 pandemic evolution and develop decision tools to rapidly detect the passage from a controlled regime to a critical one. A new sequential test -- referred to as MAST (mean-agnostic sequential test) -- is presented, and demonstrated on publicly available COVID-19 infection data from different countries. Then, the performance of MAST is investigated for the second pandemic wave, showing an effective trade-off between average decision delay $\Delta$ and risk $R$, where $R$ is inversely proportional to the time required to declare the need to take unnecessary restrictive measures. Ideally, the decision mechanism should react as quick as possible for a given level of risk. We find that all the countries share the same behaviour in terms of quickest detection, specifically the risk scales exponentially with the delay, $R \sim \exp{(-\omega \Delta)}$, where $\omega$ depends on the specific nation. For a reasonably small risk level, say, one possibility in ten thousand (i.e., unmotivated implementation of countermeasures every 27 years, on the average), the proposed algorithm detects the onset of the critical regime with delay between a few days to three weeks, much earlier than when the exponential growth becomes evident.


title: Quantum Measurement of Space-Time Events

abstract: The phase space of a relativistic system can be identified with the future tube of complexified Minkowski space. As well as a complex structure and a symplectic structure, the future tube, seen as an eight-dimensional real manifold, is endowed with a natural positive-definite Riemannian metric that accommodates the underlying geometry of the indefinite Minkowski space metric, together with its symmetry group. A unitary representation of the 15-parameter group of conformal transformations can then be constructed that acts upon the Hilbert space of square-integrable holomorphic functions on the future tube. These structures are enough to allow one to put forward a quantum theory of phase-space events. In particular, a theory of quantum measurement can be formulated in a relativistic setting, based on the use of positive operator valued measures, for the detection of phase-space events, hence allowing one to assign probabilities to the outcomes of joint space-time and four-momentum measurements in a manifestly covariant framework. This leads to a localization theorem for phase-space events in relativistic quantum theory, determined by the associated Compton wavelength.


title: Exploring Contrastive Learning in Human Activity Recognition for Healthcare

abstract: Human Activity Recognition (HAR) constitutes one of the most important tasks for wearable and mobile sensing given its implications in human well-being and health monitoring. Motivated by the limitations of labeled datasets in HAR, particularly when employed in healthcare-related applications, this work explores the adoption and adaptation of SimCLR, a contrastive learning technique for visual representations, to HAR. The use of contrastive learning objectives causes the representations of corresponding views to be more similar, and those of non-corresponding views to be more different. After an extensive evaluation exploring 64 combinations of different signal transformations for augmenting the data, we observed significant performance differences owing to the order and the function thereof. In particular, preliminary results indicated an improvement over supervised and unsupervised learning methods when using fine-tuning and random rotation for augmentation, however, future work should explore under which conditions SimCLR is beneficial for HAR systems and other healthcare-related applications.


title: Topological defects in solids with odd elasticity

abstract: Crystallography typically studies collections of point particles whose interaction forces are the gradient of a potential. Lifting this assumption generically gives rise in the continuum limit to a form of elasticity with additional moduli known as odd elasticity. We show that such odd elastic moduli modify the strain induced by topological defects and their interactions, even reversing the stability of, otherwise, bound dislocation pairs. Beyond continuum theory, isolated dislocations can self propel via microscopic work cycles active at their cores that compete with conventional Peach-Koehler forces caused, for example, by an ambient torque density. We perform molecular dynamics simulations isolating active plastic processes and discuss their experimental relevance to solids composed of spinning particles, vortex-like objects, and robotic metamaterials.


title: Diffusion regime of electron-electron collisions in weakly ionized plasmas

abstract: We consider weakly ionized plasma where frequent elastic scattering of electrons on neutrals change the individual acts and the rate of electron-electron collisions significantly. In this case, the kinetics of electron thermalization is very different from that in fully ionized plasma. The colliding electrons diffuse because of fast scattering on neutrals. We demonstrate how a proper account of this diffusion enables one to estimate the characteristic time of electron thermalization. We also present a rigorous derivation of the kinetic equation for electrons by using Bogolyubov method based on Liouville equations for multi-particle distribution functions.


title: APAN: Asynchronous Propagation Attention Network for Real-time Temporal Graph Embedding

abstract: Limited by the time complexity of querying k-hop neighbors in a graph database, most graph algorithms cannot be deployed online and execute millisecond-level inference. This problem dramatically limits the potential of applying graph algorithms in certain areas, such as financial fraud detection. Therefore, we propose Asynchronous Propagation Attention Network, an asynchronous continuous time dynamic graph algorithm for real-time temporal graph embedding. Traditional graph models usually execute two serial operations: first graph computation and then model inference. We decouple model inference and graph computation step so that the heavy graph query operations will not damage the speed of model inference. Extensive experiments demonstrate that the proposed method can achieve competitive performance and 8.7 times inference speed improvement in the meantime.


title: Microalgae-based bioremediation of water contaminated by pesticides in peri-urban agricultural areas

abstract: The present study evaluated the capacity of a semi-closed, tubular horizontal photobioreactor (PBR) to remove pesticides from agricultural run-off. The study was carried out in July to study its efficiency under the best conditions (highest solar irradiation). A total of 51 pesticides, including 10 transformation products, were selected and investigated based on their consumption rate and environmental relevance. Sixteen of them were detected in the agricultural run-off, and the estimated removal efficiencies ranged from negative values, obtained for 3 compounds, namely terbutryn, diuron, and imidacloprid, to 100%, achieved for 10 compounds. The acidic herbicide MCPA was removed by 88% on average, and the insecticides 2,4-D and diazinon showed variable removals, between 100% and negative values. The environmental risk associated with the compounds still present in the effluent of the PBR was evaluated using hazard quotients (HQs), calculated using the average and highest measured concentrations of the compounds. HQ values > 10 (meaning high risk) were obtained for imidacloprid (21), between 1 and 10 (meaning moderate risk) for 2,4-D (2.8), diazinon (4.6) and terbutryn (1.5), and < 1 (meaning low risk) for the remaining compounds diuron, linuron, and MCPA. The PBR treatment yielded variable removals depending on the compound, similar to conventional wastewater treatment plants. This study provides new data on the capacity of icroalgae-based treatment systems to eliminate a wide range of priority pesticides under real/environmental conditions.


title: Poincar\'e inequalities and compact embeddings from Sobolev type spaces into weighted $L^q$ spaces on metric spaces

abstract: We study compactness and boundedness of embeddings from Sobolev type spaces on metric spaces into $L^q$ spaces with respect to another measure. The considered Sobolev spaces can be of fractional order and some statements allow also nondoubling measures. Our results are formulated in a general form, using sequences of covering families and local Poincar\'e type inequalities. We show how to construct such suitable coverings and Poincar\'e inequalities. For locally doubling measures, we prove a self-improvement property for two-weighted Poincar\'e inequalities, which applies also to lower-dimensional measures. We simultaneously treat various Sobolev spaces, such as the Newtonian, fractional Haj\l asz and Poincar\'e type spaces, for rather general measures and sets, including fractals and domains with fractal boundaries. By considering lower-dimensional measures on the boundaries of such domains, we obtain trace embeddings for the above spaces. In the case of Newtonian spaces we exactly characterize when embeddings into $L^q$ spaces with respect to another measure are compact. Our tools are illustrated by concrete examples. For measures satisfying suitable dimension conditions, we recover several classical embedding theorems on domains and fractal sets in ${\bf R}^n$.


title: A new way to test the WIMP dark matter models

abstract: In this paper, we investigate the possibility of testing the weakly interacting massive particle (WIMP) dark matter (DM) models by applying the simplest phenomenological model which introduces an interaction term between dark energy (DE) and WIMP DM, i.e., $Q = 3\gamma_{DM} H\rho_{DM}$. In general, the coupling strength $\gamma_{DE}$ is close to $0$ as the interaction between DE and WIMP DM is very weak, thus the effect of $\gamma_ {DE}$ on the evolution of $Y$ associated with DM energy density can be safely neglected. Meanwhile, our numerical calculation also indicates that $x_f\approx20$ is associated with DM freeze-out temperature, which is the same as the vanishing interaction scenario. As for DM relic density, it will be magnified by $\frac{2-3\gamma_{DM}}{2}[{2\pi g_* m_{DM}^3}/{(45 s_0 x_f^3})]^{\gamma_{DM}}$ times, which provides a new way to test WIMP DM models. As an example, we analyze the case in which WIMP DM is a scalar DM. (SGL+SNe+Hz) and (CMB+BAO+SNe) cosmological observations will give $\gamma_{DM}=0.134^{+0.17}_{-0.069}$ and $\gamma_{DM}=-0.0008\pm0.0016$, respectively. After further considering the constraints from DM direct detection experiment, DM indirect detection experiment, and DM relic density, we find that the allowed parameter space of the scalar DM model will be completely excluded for the former cosmological observations, while it will increase for the latter ones. Those two cosmological observations lead to an almost paradoxical conclusion. Therefore, one could expect more stringent constraints on the WMIP DM models, with the accumulation of more accurate cosmological observations in the near future.


title: Topological Hochschild homology and Zeta-values

abstract: Using work of Antieau and Bhatt-Morrow-Scholze, we define a filtration on topological Hochschild homology and its variants $TP$ and $TC^-$ of quasi-lci rings with bounded torsion, which recovers the BMS-filtration after $p$-adic completion. Then we compute the graded pieces of this filtration in terms of Hodge completed derived de Rham cohomology relative to the base ring $\mathbb{Z}$. We denote the cofiber of the canonical map from $\mathrm{gr}^{n}TC^-(-)$ to $\mathrm{gr}^{n}TP(-)$ by $L\Omega^{<n}_{-/\mathbb{S}}[2n]$. Let $\mathcal{X}$ be a regular connected scheme of dimension $d$ proper over $\mathrm{Spec}(\mathbb{Z})$ and let $n\in\mathbb{Z}$ be an arbitrary integer. Together with Weil-\'etale cohomology with compact support $R\Gamma_{W,c}(\mathcal{X},\mathbb{Z}(n))$, the complex $L\Omega^{<n}_{\mathcal{X}/\mathbb{S}}$ is expected to give the Zeta-value $\pm\zeta^*(\mathcal{X},n)$ on the nose. Combining the results proven here with a theorem recently proven in joint work with Flach, we obtain a formula relating $L\Omega^{<n}_{\mathcal{X}/\mathbb{S}}$, $L\Omega^{<d-n}_{\mathcal{X}/\mathbb{S}}$, Weil-\'etale cohomology of the archimedean fiber $\mathcal{X}_{\infty}$ with Tate twists $n$ and $d-n$, the Bloch conductor $A(\mathcal{X})$ and the special values of the archimedean Euler factor of the Zeta-function $\zeta(\mathcal{X},s)$ at $s=n$ and $s=d-n$. This formula is a shadow of the functional equation of Zeta-functions.


title: Sparse linear regression -- CLuP achieves the ideal \emph{exact} ML

abstract: In this paper we revisit one of the classical statistical problems, the so-called sparse maximum-likelihood (ML) linear regression. As a way of attacking this type of regression, we present a novel CLuP mechanism that to a degree relies on the \bl{\textbf{Random Duality Theory (RDT)}} based algorithmic machinery that we recently introduced in \cite{Stojnicclupint19,Stojnicclupcmpl19,Stojnicclupplt19,Stojniccluplargesc20,Stojniccluprephased20}. After the initial success that the CLuP exhibited in achieving the exact ML performance while maintaining excellent computational complexity related properties in MIMO ML detection in \cite{Stojnicclupint19,Stojnicclupcmpl19,Stojnicclupplt19}, one would naturally expect that a similar type of success can be achieved in other ML considerations. The results that we present here confirm that such an expectation is indeed reasonable. In particular, within the sparse regression context, the introduced CLuP mechanism indeed turns out to be able to \bl{\textbf{\emph{achieve the ideal ML performance}}}. Moreover, it can substantially outperform some of the most prominent earlier state of the art algorithmic concepts, among them even the variants of the famous LASSO and SOCP from \cite{StojnicPrDepSocp10,StojnicGenLasso10,StojnicGenSocp10}. Also, our recent results presented in \cite{Stojniccluplargesc20,Stojniccluprephased20} showed that the CLuP has excellent \bl{\textbf{\emph{large-scale}}} and the so-called \bl{\textbf{\emph{rephasing}}} abilities. Since such large-scale algorithmic features are possibly even more desirable within the sparse regression context we here also demonstrate that the basic CLuP ideas can be reformulated to enable solving with a relative ease the regression problems with \bl{\textbf{\emph{several thousands}}} of unknowns.


title: Conformance Checking of Mixed-paradigm Process Models

abstract: Mixed-paradigm process models integrate strengths of procedural and declarative representations like Petri nets and Declare. They are specifically interesting for process mining because they allow capturing complex behaviour in a compact way. A key research challenge for the proliferation of mixed-paradigm models for process mining is the lack of corresponding conformance checking techniques. In this paper, we address this problem by devising the first approach that works with intertwined state spaces of mixed-paradigm models. More specifically, our approach uses an alignment-based replay to explore the state space and compute trace fitness in a procedural way. In every state, the declarative constraints are separately updated, such that violations disable the corresponding activities. Our technique provides for an efficient replay towards an optimal alignment by respecting all orthogonal Declare constraints. We have implemented our technique in ProM and demonstrate its performance in an evaluation with real-world event logs.


title: MoGaze: A Dataset of Full-Body Motions that Includes Workspace Geometry and Eye-Gaze

abstract: As robots become more present in open human environments, it will become crucial for robotic systems to understand and predict human motion. Such capabilities depend heavily on the quality and availability of motion capture data. However, existing datasets of full-body motion rarely include 1) long sequences of manipulation tasks, 2) the 3D model of the workspace geometry, and 3) eye-gaze, which are all important when a robot needs to predict the movements of humans in close proximity. Hence, in this paper, we present a novel dataset of full-body motion for everyday manipulation tasks, which includes the above. The motion data was captured using a traditional motion capture system based on reflective markers. We additionally captured eye-gaze using a wearable pupil-tracking device. As we show in experiments, the dataset can be used for the design and evaluation of full-body motion prediction algorithms. Furthermore, our experiments show eye-gaze as a powerful predictor of human intent. The dataset includes 180 min of motion capture data with 1627 pick and place actions being performed. It is available at https://humans-to-robots-motion.github.io/mogaze and is planned to be extended to collaborative tasks with two humans in the near future.


title: Formation and dynamics of water clouds on temperate sub-Neptunes: The example of K2-18b

abstract: Hubble (HST) spectroscopic transit observations of the temperate sub-Neptune K2-18b were interpreted as the presence of water vapour with potential water clouds. 1D modelling studies also predict the formation of water clouds at some conditions. However, such models cannot predict the cloud cover, driven by atmospheric dynamics and thermal contrasts, and thus their real impact on spectra. The main goal of this study is to understand the formation, distribution and observational consequences of water clouds on K2-18b and other temperate sub-Neptunes. We simulated the atmospheric dynamics, water cloud formation and spectra of K2-18b for H2-dominated atmosphere using a 3D GCM. We analysed the impact of atmospheric composition (with metallicity from 1*solar to 1000*solar), concentration of cloud condensation nuclei and planetary rotation rate. Assuming that K2-18b has a synchronous rotation, we show that the atmospheric circulation in the upper atmosphere essentially corresponds to a symmetric day-to-night circulation. This regime preferentially leads to cloud formation at the substellar point or at the terminator. Clouds form for metallicity >100*solar with relatively large particles. For 100-300*solar metallicity, the cloud fraction at the terminators is small with a limited impact on transit spectra. For 1000*solar metallicity, very thick clouds form at the terminator. The cloud distribution appears very sensitive to the concentration of CCN and to the planetary rotation rate. Fitting HST transit data with our simulated spectra suggests a metallicity of ~100-300*solar. In addition, we found that the cloud fraction at the terminator can be highly variable, leading to a potential variability in transit spectra. This effect could be common on cloudy exoplanets and could be detectable with multiple transit observations.


title: ML4H Abstract Track 2020

abstract: A collection of the accepted abstracts for the Machine Learning for Health (ML4H) workshop at NeurIPS 2020. This index is not complete, as some accepted abstracts chose to opt-out of inclusion.


title: Conditional canonical correlation estimation based on covariates with random forests

abstract: Investigating the relationships between two sets of variables helps to understand their interactions and can be done with canonical correlation analysis (CCA). However, the correlation between the two sets can sometimes depend on a third set of covariates, often subject-related ones such as age, gender, or other clinical measures. In this case, applying CCA to the whole population is not optimal and methods to estimate conditional CCA, given the covariates, can be useful. We propose a new method called Random Forest with Canonical Correlation Analysis (RFCCA) to estimate the conditional canonical correlations between two sets of variables given subject-related covariates. The individual trees in the forest are built with a splitting rule specifically designed to partition the data to maximize the canonical correlation heterogeneity between child nodes. We also propose a significance test to detect the global effect of the covariates on the relationship between two sets of variables. The performance of the proposed method and the global significance test is evaluated through simulation studies that show it provides accurate canonical correlation estimations and well-controlled Type-1 error. We also show an application of the proposed method with EEG data.


title: Towards a kinetic theory of a dark soliton gas in one-dimensional superfluids

abstract: Soliton hydrodynamics is an appealing tool to describe strong turbulence in low-dimensional systems. Strong turbulence in quasi-one dimensional spuerfluids, such as Bose-Einstein condensates, involves the dynamics of dark solitons and, therefore, the description of a statistical ensemble of dark-solitons, i.e. soliton gases, is necessary. In this work, we propose a phase-space (kinetic) description of dark-soliton gases, introducing a kinetic equation that is formally similar to the Vlasov equation in plasma physics. We show that the proposed kinetic theory can capture the dynamical features of soliton gases and show that it sustains an acoustic mode, a fact that we corroborate with the help of direct numerical simulations. Our findings motivate the investigation of the microscopic structure of out-of-equilibrium and turbulent regimes in low-dimensional superfluids.


title: Planar 3D Transfer Learning for End to End Unimodal MRI Unbalanced Data Segmentation

abstract: We present a novel approach of 2D to 3D transfer learning based on mapping pre-trained 2D convolutional neural network weights into planar 3D kernels. The method is validated by the proposed planar 3D res-u-net network with encoder transferred from the 2D VGG-16, which is applied for a single-stage unbalanced 3D image data segmentation. In particular, we evaluate the method on the MICCAI 2016 MS lesion segmentation challenge dataset utilizing solely fluid-attenuated inversion recovery (FLAIR) sequence without brain extraction for training and inference to simulate real medical praxis. The planar 3D res-u-net network performed the best both in sensitivity and Dice score amongst end to end methods processing raw MRI scans and achieved comparable Dice score to a state-of-the-art unimodal not end to end approach. Complete source code was released under the open-source license, and this paper complies with the Machine learning reproducibility checklist. By implementing practical transfer learning for 3D data representation, we could segment heavily unbalanced data without selective sampling and achieved more reliable results using less training data in a single modality. From a medical perspective, the unimodal approach gives an advantage in real praxis as it does not require co-registration nor additional scanning time during an examination. Although modern medical imaging methods capture high-resolution 3D anatomy scans suitable for computer-aided detection system processing, deployment of automatic systems for interpretation of radiology imaging is still rather theoretical in many medical areas. Our work aims to bridge the gap by offering a solution for partial research questions.


title: Beta-CoRM: A Bayesian Approach for $n$-gram Profiles Analysis

abstract: $n$-gram profiles have been successfully and widely used where long sequences of potentially differing lengths are analysed for clustering or classification. Mostly, machine learning algorithms have been used for this purpose but, despite their superb predictive performance, these methods cannot discover hidden structure or provide a full probabilistic representation of the data. That is why in this paper we centre our attention on a novel class of Bayesian generative models designed for $n$-gram profiles used as binary attributes. The flexibility of our modelling allows us to consider a straightforward approach to feature selection in this generative model. Furthermore, we derive a slice sampling algorithm for a fast inferential procedure which is applied to both synthetic and real data scenarios and shows that feature selection can improve classification accuracy.


title: Comparing Normalization Methods for Limited Batch Size Segmentation Neural Networks

abstract: The widespread use of Batch Normalization has enabled training deeper neural networks with more stable and faster results. However, the Batch Normalization works best using large batch size during training and as the state-of-the-art segmentation convolutional neural network architectures are very memory demanding, large batch size is often impossible to achieve on current hardware. We evaluate the alternative normalization methods proposed to solve this issue on a problem of binary spine segmentation from 3D CT scan. Our results show the effectiveness of Instance Normalization in the limited batch size neural network training environment. Out of all the compared methods the Instance Normalization achieved the highest result with Dice coefficient = 0.96 which is comparable to our previous results achieved by deeper network with longer training time. We also show that the Instance Normalization implementation used in this experiment is computational time efficient when compared to the network without any normalization method.


title: The Magellan-TESS Survey I: Survey Description and Mid-Survey Results

abstract: $Kepler$ revealed that roughly one-third of Sun-like stars host planets orbiting within 100 days and between the size of Earth and Neptune. How do these planets form, what are they made of, and do they represent a continuous population or multiple populations? To help address these questions, we began the Magellan-TESS Survey (MTS), which uses Magellan II/PFS to obtain radial velocity (RV) masses of 30 TESS-detected exoplanets and develops an analysis framework that connects observed planet distributions to underlying populations. In the past, small planet RV measurements have been challenging to obtain due to host star faintness and low RV semi-amplitudes, and challenging to interpret due to the potential biases in target selection and observation planning decisions. The MTS attempts to minimize these biases by focusing on bright TESS targets and employing a quantitative selection function and observing strategy. In this paper, we (1) describe our motivation and survey strategy, (2) present our first catalog of planet density constraints for 27 TESS Objects of Interest (TOIs; 22 in our population analysis sample, 12 that are members of the same systems), and (3) employ a hierarchical Bayesian model to produce preliminary constraints on the mass-radius (M-R) relation. We find that the biases causing previous M-R relations to predict fairly high masses at $1~R_\oplus$ have been reduced. This work can inform more detailed studies of individual systems and offer a framework that can be applied to future RV surveys with the goal of population inferences.


title: Positivity of anticanonical divisors in algebraic fibre spaces

abstract: Let $f:X\rightarrow Y$ be an algebraic fibre space between normal projective varieties and $F$ be a general fibre of $f$. We prove an Iitaka-type inequality $\kappa(X,-K_X)\leq \kappa(F,-K_F)+\kappa(Y,-K_Y)$ under some mild conditions. We also obtain some more results relates the positivity of $-K_X$ and $-K_Y$.


title: Fractional perimeters on the sphere

abstract: This note treats several problems for the fractional perimeter or $s$-perimeter on the sphere. The spherical fractional isoperimetric inequality is established. It turns out that the equality cases are exactly the spherical caps. Furthermore, the convergence of fractional perimeters to the surface area as $s \nearrow 1$ is proven. It is shown that their limit as $s \searrow -\infty$ can be expressed in terms of the volume.


title: Chemical modelling of dust-gas chemistry within AGB outflows III. Photoprocessing of the ice and return to the ISM

abstract: To explain the properties of dust in the interstellar medium (ISM), the presence of a refractory organic mantle is necessary. The outflows of AGB stars are among the main contributors of stellar dust to the ISM. We present the first study of the refractory organic contribution of AGB stars to the ISM. Based on laboratory experiments, we included a new reaction in our extended chemical kinetics model: the photoprocessing of volatile complex ices into inert refractory organic material. The refractory organic feedback of AGB outflows to the ISM is estimated using observationally motivated parent species and grids of models of C-rich and O-rich outflows. Refractory organic material is mainly inherited from the gas phase through accretion onto the dust and subsequent photoprocessing. Grain-surface chemistry, initiated by photodissociation of ices, produces only a minor part and takes place in a sub-monolayer regime in almost all outflows. The formation of refractory organic material increases with outflow density and depends on the initial gas-phase composition. While O-rich dust is negligibly covered by refractory organics, C-rich dust has an average coverage of $3-9\%$, but can be as high as $8-22\%$. Although C-rich dust does not enter the ISM bare, its average coverage is too low to influence its evolution in the ISM or significantly contribute to the coverage of interstellar dust. This study opens up questions on the coverage of other dust-producing environments. It highlights the need for an improved understanding of dust formation and for models specific to density structures within the outflow.


title: Using Synthetic Audio to Improve The Recognition of Out-Of-Vocabulary Words in End-To-End ASR Systems

abstract: Today, many state-of-the-art automatic speech recognition (ASR) systems apply all-neural models that map audio to word sequences trained end-to-end along one global optimisation criterion in a fully data driven fashion. These models allow high precision ASR for domains and words represented in the training material but have difficulties recognising words that are rarely or not at all represented during training, i.e. trending words and new named entities. In this paper, we use a text-to-speech (TTS) engine to provide synthetic audio for out-of-vocabulary (OOV) words. We aim to boost the recognition accuracy of a recurrent neural network transducer (RNN-T) on OOV words by using the extra audio-text pairs, while maintaining the performance on the non-OOV words. Different regularisation techniques are explored and the best performance is achieved by fine-tuning the RNN-T on both original training data and extra synthetic data with elastic weight consolidation (EWC) applied on the encoder. This yields a 57% relative word error rate (WER) reduction on utterances containing OOV words without any degradation on the whole test set.


title: The H-tautological ring

abstract: We extend the theory of tautological classes on moduli spaces of stable curves to the more general setting of moduli spaces of admissible Galois covers of curves, introducing the so-called H-tautological ring. The main new feature is the existence of restriction-corestriction morphisms remembering intermediate quotients of Galois covers, which are a rich source of new classes. In particular, our new framework includes classes of Harris-Mumford admissible covers on moduli spaces of curves, which are known in some (and speculatively many more) examples to lie outside the usual tautological ring. We give additive generators for the H-tautological ring and show that their intersections may be algorithmically computed, building on work of Schmitt-van Zelm. As an application, we give a method for computing integrals of Harris-Mumford loci against tautological classes of complementary dimension, recovering and giving a mild generalization of a recent quasi-modularity result of the author for covers of elliptic curves.


title: Logarithmic Regret for Reinforcement Learning with Linear Function Approximation

abstract: Reinforcement learning (RL) with linear function approximation has received increasing attention recently. However, existing work has focused on obtaining $\sqrt{T}$-type regret bound, where $T$ is the number of interactions with the MDP. In this paper, we show that logarithmic regret is attainable under two recently proposed linear MDP assumptions provided that there exists a positive sub-optimality gap for the optimal action-value function. More specifically, under the linear MDP assumption (Jin et al. 2019), the LSVI-UCB algorithm can achieve $\tilde{O}(d^{3}H^5/\text{gap}_{\text{min}}\cdot \log(T))$ regret; and under the linear mixture MDP assumption (Ayoub et al. 2020), the UCRL-VTR algorithm can achieve $\tilde{O}(d^{2}H^5/\text{gap}_{\text{min}}\cdot \log^3(T))$ regret, where $d$ is the dimension of feature mapping, $H$ is the length of episode, $\text{gap}_{\text{min}}$ is the minimal sub-optimality gap, and $\tilde O$ hides all logarithmic terms except $\log(T)$. To the best of our knowledge, these are the first logarithmic regret bounds for RL with linear function approximation. We also establish gap-dependent lower bounds for the two linear MDP models.


title: A Closed-Form Solution to Local Non-Rigid Structure-from-Motion

abstract: A recent trend in Non-Rigid Structure-from-Motion (NRSfM) is to express local, differential constraints between pairs of images, from which the surface normal at any point can be obtained by solving a system of polynomial equations. The systems of equations derived in previous work, however, are of high degree, having up to five real solutions, thus requiring a computationally expensive strategy to select a unique solution. Furthermore, they suffer from degeneracies that make the resulting estimates unreliable, without any mechanism to identify this situation. In this paper, we show that, under widely applicable assumptions, we can derive a new system of equation in terms of the surface normals whose two solutions can be obtained in closed-form and can easily be disambiguated locally. Our formalism further allows us to assess how reliable the estimated local normals are and, hence, to discard them if they are not. Our experiments show that our reconstructions, obtained from two or more views, are significantly more accurate than those of state-of-the-art methods, while also being faster.


title: Variational principle and boundary terms in gravity \`a la Palatini

abstract: A general $f(\mathcal{R})$ gravitational theory is considered within the Palatini formalism. By applying the variational principle and the usual conditions on the boundary, we show explicitly that a surface term remains such that as in their metric-compatible counterparts, an additional surface term has to be added in the gravitational action, which plays a fundamental role when calculating the entropy of the black hole.


title: New approach to describe two coupled spins in a variable magnetic field

abstract: We propose a method to describe the evolution of two spins coupled by hyperfine interaction in an external time-dependent magnetic field. We apply the approach to the case of hyperfine interaction with axial symmetry, which can be solved exactly in a constant, appropriately oriented magnetic field. In order to treat the nonstationary dynamical problem, we modify the time-dependent Schr\"odinger equation through a change of representation that, by exploiting an instantaneous (adiabatic) basis makes the time-dependent Hamiltonian diagonal at any time instant. The solution of the transformed time-dependent Schr\"odinger in the form of chronologically ordered exponents with transparent pre-exponential coefficients is reported. This solution is highly simplified when an adiabatically varying magnetic field perturbs the system. The approach here proposed may be used for the perturbative treatment of other dynamical problems with no exact solution.


title: Direct Transcription for Dynamic Optimization: A Tutorial with a Case Study on Dual-Patient Ventilation During the COVID-19 Pandemic

abstract: A variety of optimal control, estimation, system identification and design problems can be formulated as functional optimization problems with differential equality and inequality constraints. Since these problems are infinite-dimensional and often do not have a known analytical solution, one has to resort to numerical methods to compute an approximate solution. This paper uses a unifying notation to outline some of the techniques used in the transcription step of simultaneous direct methods (which discretize-then-optimize) for solving continuous-time dynamic optimization problems. We focus on collocation, integrated residual and Runge-Kutta schemes. These transcription methods are then applied to a simulation case study to answer a question that arose during the COVID-19 pandemic, namely: If there are not enough ventilators, is it possible to ventilate more than one patient on a single ventilator? The results suggest that it is possible, in principle, to estimate individual patient parameters sufficiently accurately, using a relatively small number of flow rate measurements, without needing to disconnect a patient from the system or needing more than one flow rate sensor. We also show that it is possible to ensure that two different patients can indeed receive their desired tidal volume, by modifying the resistance experienced by the air flow to each patient and controlling the ventilator pressure.


title: Fourier coefficients of restrictions of eigenfunctions

abstract: Let $\{e_j\}$ be an orthonormal basis of Laplace eigenfunctions of a compact Riemannian manifold $(M,g)$. Let $H \subset M$ be a submanifold and let $\{\psi_k\}$ be an orthonormal basis of Laplace eigenfunctions of $H$ with the induced metric. We obtain joint asymptotics for the Fourier coefficients \[ \langle \gamma_H e_j, \psi_k \rangle_{L^2(H)} = \int_H e_j \overline \psi_k \, dV_H, \] of restrictions $\gamma_H e_j$ of $e_j$ to $H$. In particular, we obtain asymptotics for the sums of the norm-squares of the Fourier coefficients over the joint spectrum $\{(\mu_k, \lambda_j)\}_{j,k - 0}^{\infty}$ of the (square roots of the) Laplacian $\Delta_M$ on $M$ and the Laplacian $\Delta_H$ on $H$ in a family of suitably `thick' regions in $\mathbb R^2$. Thick regions include (1) the truncated cone $\mu_k/\lambda_j \in [a,b] \subset (0,1)$ and $\lambda_j \leq \lambda$, and (2) the slowly thickening strip $|\mu_k - c\lambda_j| \leq w(\lambda)$ and $\lambda_j \leq \lambda$, where $w(\lambda)$ is monotonic and $1 \ll w(\lambda) \lesssim \lambda^{1 - 1/n}$. Key tools for obtaining these asymptotics include the composition calculus of Fourier integral operators and a new multidimensional Tauberian theorem.


title: RobustPointSet: A Dataset for Benchmarking Robustness of Point Cloud Classifiers

abstract: The 3D deep learning community has seen significant strides in pointcloud processing over the last few years. However, the datasets on which deep models have been trained have largely remained the same. Most datasets comprise clean, clutter-free pointclouds canonicalized for pose. Models trained on these datasets fail in uninterpretible and unintuitive ways when presented with data that contains transformations "unseen" at train time. While data augmentation enables models to be robust to "previously seen" input transformations, 1) we show that this does not work for unseen transformations during inference, and 2) data augmentation makes it difficult to analyze a model's inherent robustness to transformations. To this end, we create a publicly available dataset for robustness analysis of point cloud classification models (independent of data augmentation) to input transformations, called RobustPointSet. Our experiments indicate that despite all the progress in the point cloud classification, there is no single architecture that consistently performs better -- several fail drastically -- when evaluated on transformed test sets. We also find that robustness to unseen transformations cannot be brought about merely by extensive data augmentation. RobustPointSet can be accessed through https://github.com/AutodeskAILab/RobustPointSet.


title: Giant anomalous Hall effect from spin-chirality scattering in a chiral magnet

abstract: The electrical Hall effect can be significantly enhanced through the interplay of the conduction electrons with magnetism, which is known as the anomalous Hall effect (AHE). Whereas the mechanism related to band topology has been intensively studied towards energy efficient electronics, those related to electron scattering have received limited attention. Here we report the observation of giant AHE of electron-scattering origin in a chiral magnet MnGe thin film. The Hall conductivity and Hall angle respectively reach 40,000 {\Omega}-1cm-1 and 18 % in the ferromagnetic region, exceeding the conventional limits of AHE of intrinsic and extrinsic origins, respectively. A possible origin of the large AHE is attributed to a new type of skew-scattering via thermally-excited spin-clusters with scalar spin chirality, which is corroborated by the temperature-magnetic-field profile of the AHE being sensitive to the film-thickness or magneto-crystalline anisotropy. Our results may open up a new platform to explore giant AHE responses in various systems, including frustrated magnets and thin-film heterostructures.


title: Three-dimensional bi-functional refractive index and fluorescence microscopy (BRIEF)

abstract: Fluorescence microscopy is a powerful tool for imaging biological samples with molecular specificity. In contrast, phase microscopy provides label-free measurement of the sample's refractive index (RI), which is an intrinsic optical property that quantitatively relates to cell morphology, mass, and stiffness. Conventional imaging techniques measure either the labeled fluorescence (functional) information or the label-free RI (structural) information, though it may be valuable to have both. For example, biological tissues have heterogeneous RI distributions, causing sample-induced scattering that degrades the fluorescence image quality. When both fluorescence and 3D RI are measured, one can use the RI information to digitally correct multiple-scattering effects in the fluorescence image. Here, we develop a new computational multi-modal imaging method based on epi-mode microscopy that reconstructs both 3D fluorescence and 3D RI from a single dataset. We acquire dozens of fluorescence images, each 'illuminated' by a single fluorophore, then solve an inverse problem with a multiple-scattering forward model. We experimentally demonstrate our method for epi-mode 3D RI imaging and digital correction of multiple-scattering effects in fluorescence images.


title: A minimal power-spectrum-based moment expansion for CMB B-mode searches

abstract: The characterization and modeling of polarized foregrounds has become a critical issue in the quest for primordial $B$-modes. A typical method to proceed is to factorize and parametrize the spectral properties of foregrounds and their scale dependence (i.e. assuming that foreground spectra are well described everywhere by their sky average). Since in reality foreground properties vary across the Galaxy, this assumption leads to inaccuracies in the model that manifest themselves as biases in the final cosmological parameters (in this case the tensor-to-scalar ratio $r$). This is particularly relevant for surveys over large fractions of the sky, such as the Simons Observatory (SO), where the spectra should be modeled over a distribution of parameter values. Here we propose a method based on the existing ``moment expansion'' approach to address this issue in a power-spectrum-based analysis that is directly applicable in ground-based multi-frequency data. Additionally, the method uses only a small set of parameters with simple physical interpretation, minimizing the impact of foreground uncertainties on the final $B$-mode constraints. We validate the method using SO-like simulated observations, recovering an unbiased estimate of the tensor-to-scalar ratio $r$ with standard deviation $\sigma(r)\simeq0.003$, compatible with official forecasts. When applying the method to the public BICEP2/Keck data, we find an upper bound $r<0.06$ ($95\%\,{\rm C.L.}$), compatible with the result found by BICEP2/Keck when parametrizing spectral index variations through a scale-independent frequency decorrelation parameter. We also discuss the formal similarities between the power spectrum-based moment expansion and methods used in the analysis of CMB lensing.


title: Conjecturing-Based Discovery of Patterns in Data

abstract: We propose the use of a conjecturing machine that suggests feature relationships in the form of bounds involving nonlinear terms for numerical features and boolean expressions for categorical features. The proposed Conjecturing framework recovers known nonlinear and boolean relationships among features from data. In both settings, true underlying relationships are revealed. We then compare the method to a previously-proposed framework for symbolic regression on the ability to recover equations that are satisfied among features in a dataset. The framework is then applied to patient-level data regarding COVID-19 outcomes to suggest possible risk factors that are confirmed in the medical literature.


title: Thermodynamics of 3D Kitaev quantum spin liquids via tensor networks

abstract: We study the 3D Kitaev and Kitaev-Heisenberg models respectively on the hyperhoneycomb and hyperoctagon lattices, both at zero and finite-temperature, in the thermodynamic limit. Our analysis relies on advanced tensor network (TN) simulations based on graph Projected Entangled-Pair States (gPEPS). We map out the TN phase diagrams of the models and characterize their underlying gapped and gapless phases both at zero and finite temperature. In particular, we demonstrate how cooling down the hyperhoneycomb system from high-temperature leads to fractionalization of spins to itinerant Majorana fermions and gauge fields that occurs in two separate temperature regimes, leaving their fingerprint on specific heat as a double-peak feature as well as on other quantities such as the thermal entropy, spin-spin correlations and bond entropy. Using the Majorana representation of the Kitaev model, we further show that the low-temperature thermal transition to the Kitaev quantum spin liquid (QSL) phase is associated with the non-trivial Majorana band topology and the presence of Weyl nodes, which manifests itself via non-vanishing Chern number and finite thermal Hall conductivity. Beyond the pure Kitaev limit, we study the 3D Kitaev-Heisenberg (KH) model on the hyperoctagon lattice and extract the full phase diagram for different Heisenberg couplings. We further explore the thermodynamic properties of the magnetically-ordered regions in the KH model and show that, in contrast to the QSL phase, here the thermal phase transition follows the standard Landau symmetry-breaking theory.


title: Reliable LC-MS/MS-based method for trace level determination of 50 medium to highly polar pesticide residues in sediments and ecological risk assessment

abstract: The occurrence of polar pesticides in sediments has not been extensively investigated because of their relatively poor hydrophobicity and apparently less persistence in the environment. However, their continuous release into the aquatic systems calls for the evaluation of their potential accumulation in sediments and the role of this matrix as a potential source of these compounds. Considering this, a method based on pressurized liquid extraction (PLE), extract clean-up by solid phase extraction (SPE) and analyte determination by liquid chromatography coupled to tandem mass spectrometry (LC-MS/MS) was developed and validated to analyze 50 relevant (frequently used and/or regulated or found in water) medium to highly polar pesticides in sediments. The method showed good performance regarding accuracy (relative recoveries between 76% and 124%), precision (relative standard deviation values <20%), sensitivity (LODs in the low ng/g for most compounds), linearity (coefficients of determination >0.99), and matrix effects (negligible for all analytes). The use of an isotope dilution approach for quantification ensures results reliability. As a part of the validation process, the method was applied to the analysis of the target pesticides in sediments from the Llobregat River (NE Spain) showing the presence of five of them, namely, terbutryn, dichlorvos, terbuthylazine, diazinon, and irgarol. All 5 pesticides, due to both the concentrations found and their physical-chemical characteristics, demonstrate high potential for bioaccumulation and risk to the aquatic organisms. Additional multidisciplinary studies that investigate pesticides occurrence in the different aquatic compartments and evaluate the potential risks for aquatic ecosystems are required to assess the environmental impact and significance of the presence of pesticides in sediments.


title: The Interconnectivity Vector: A Finite-Dimensional Vector Representation of Persistent Homology

abstract: Persistent Homology (PH) is a useful tool to study the underlying structure of a data set. Persistence Diagrams (PDs), which are 2D multisets of points, are a concise summary of the information found by studying the PH of a data set. However, PDs are difficult to incorporate into a typical machine learning workflow. To that end, two main methods for representing PDs have been developed: kernel methods and vectorization methods. In this paper we propose a new finite-dimensional vector, called the interconnectivity vector, representation of a PD adapted from Bag-of-Words (BoW). This new representation is constructed to demonstrate the connections between the homological features of a data set. This initial definition of the interconnectivity vector proves to be unstable, but we introduce a stabilized version of the vector and prove its stability with respect to small perturbations in the inputs. We evaluate both versions of the presented vectorization on several data sets and show their high discriminative power.


title: Classical Shadows With Noise

abstract: The classical shadows protocol, recently introduced by Huang, Kueng, and Preskill [Nat. Phys. 16, 1050 (2020)], is a quantum-classical protocol to estimate properties of an unknown quantum state. Unlike full quantum state tomography, the protocol can be implemented on near-term quantum hardware and requires few quantum measurements to make many predictions with a high success probability. In this paper, we study the effects of noise on the classical shadows protocol. In particular, we consider the scenario in which the quantum circuits involved in the protocol are subject to various known noise channels and derive an analytical upper bound for the sample complexity in terms of a shadow seminorm for both local and global noise. Additionally, by modifying the classical post-processing step of the noiseless protocol, we define a new estimator that remains unbiased in the presence of noise. As applications, we show that our results can be used to prove rigorous sample complexity upper bounds in the cases of depolarizing noise and amplitude damping.


title: Magnetization of the intergalactic medium in the IllustrisTNG simulations: the importance of extended, outflow-driven bubbles

abstract: We study the effects of galaxy formation physics on the magnetization of the intergalactic medium (IGM) using the IllustrisTNG simulations. We demonstrate that large-scale regions affected by the outflows from galaxies and clusters contain magnetic fields that are several orders of magnitude stronger than in unaffected regions with the same electron density. Moreover, like magnetic fields amplified inside galaxies, these magnetic fields do not depend on the primordial seed, i.e. the adopted initial conditions for magnetic field strength. We study the volume filling fraction of these strong field regions and their occurrence in random lines of sight. As a first application, we use these results to put bounds on the photon-axion conversion from spectral distortion of the CMB. As photon-axion coupling grows with energy, stronger constraints could potentially be obtained using data on the propagation of gamma-ray photons through the IGM. Finally, we also briefly discuss potential applications of our results to the Faraday Rotation measurements.


title: Damping of kinetic transport equation with diffuse boundary condition

abstract: We prove that exponential moments of a fluctuation of the pure transport equation decay pointwisely almost as fast as $t^{-3}$ when the domain is any general strictly convex subset of $\mathbb{R}^3$ with the smooth boundary of the diffuse boundary condition. We prove the theorem by establishing a novel $L^1$-$L^\infty$ framework via stochastic cycles.


title: Tolerance and Prediction Intervals for Non-normal Models

abstract: A prediction interval covers a future observation from a random process in repeated sampling, and is typically constructed by identifying a pivotal quantity that is also an ancillary statistic. Analogously, a tolerance interval covers a population percentile in repeated sampling and is often based on a pivotal quantity. One approach we consider in non-normal models leverages a link function resulting in a pivotal quantity that is approximately normally distributed. In settings where this normal approximation does not hold we consider a second approach for tolerance and prediction based on a confidence interval for the mean. These methods are intuitive, simple to implement, have proper operating characteristics, and are computationally efficient compared to Bayesian, re-sampling, and machine learning methods. This is demonstrated in the context of multi-site clinical trial recruitment with staggered site initiation, real-world time on treatment, and end-of-study success for a clinical endpoint.


title: Power counting in chiral effective field theory and nuclear binding

abstract: Chiral effective field theory ($\chi$EFT), as originally proposed by Weinberg, promises a theoretical connection between low-energy nuclear interactions and quantum chromodynamics (QCD). However, the important property of renormalization-group (RG) invariance is not fulfilled in current implementations and its consequences for predicting atomic nuclei beyond two- and three-nucleon systems has remained unknown. In this work we present a first and systematic study of recent RG-invariant formulations of $\chi$EFT and their predictions for the binding energies and other observables of selected nuclear systems with mass-numbers up to $A =16$. Specifically, we have carried out ab initio no-core shell-model and coupled cluster calculations of the ground-state energy of $^3$H, $^{3,4}$He, $^{6}$Li, and $^{16}$O using several recent power-counting (PC) schemes at leading order (LO) and next-to-leading order (NLO), where the subleading interactions are treated in perturbation theory. Our calculations indicate that RG-invariant and realistic predictions can be obtained for nuclei with mass number $A \leq 4$. We find, however, that $^{16}$O is either unbound with respect to the four $\alpha$-particle threshold, or deformed, or both. Similarly, we find that the $^{6}$Li ground-state resides above the $\alpha$-deuteron separation threshold. These results are in stark contrast with experimental data and point to either necessary fine-tuning of all relevant counterterms, or that current state-of-the-art RG-invariant PC schemes at LO in $\chi$EFT lack necessary diagrams -- such as three-nucleon forces -- to realistically describe nuclei with mass number $A>4$.


title: Cavity optomechanics assisted by optical coherent feedback

abstract: We consider a wide family of optical coherent feedback loops acting on an optomechanical system operating in the linearized regime. We assess the efficacy of such loops in improving key operations, such as cooling, steady-state squeezing and entanglement, as well as optical to mechanical state transfer. We find that mechanical sideband cooling can be enhanced through passive, interferometric coherent feedback, achieving lower steady-state occupancies and considerably speeding up the cooling process; we also quantify the detrimental effect of non-zero delay times on the cooling performance. Steady state entanglement generation in the blue sideband can also be assisted by passive interferometric feedback, which allows one to stabilise otherwise unstable systems, though active feedback (including squeezing elements) does not help to this aim. We show that active feedback loops only allow for the generation of optical, but not mechanical squeezing. Finally, we prove that passive feedback can assist state transfer at transient times for red-sideband driven systems in the strong coupling regime.


title: Scattering Transform Based Image Clustering using Projection onto Orthogonal Complement

abstract: In the last few years, large improvements in image clustering have been driven by the recent advances in deep learning. However, due to the architectural complexity of deep neural networks, there is no mathematical theory that explains the success of deep clustering techniques. In this work we introduce Projected-Scattering Spectral Clustering (PSSC), a state-of-the-art, stable, and fast algorithm for image clustering, which is also mathematically interpretable. PSSC includes a novel method to exploit the geometric structure of the scattering transform of small images. This method is inspired by the observation that, in the scattering transform domain, the subspaces formed by the eigenvectors corresponding to the few largest eigenvalues of the data matrices of individual classes are nearly shared among different classes. Therefore, projecting out those shared subspaces reduces the intra-class variability, substantially increasing the clustering performance. We call this method Projection onto Orthogonal Complement (POC). Our experiments demonstrate that PSSC obtains the best results among all shallow clustering algorithms. Moreover, it achieves comparable clustering performance to that of recent state-of-the-art clustering techniques, while reducing the execution time by more than one order of magnitude. In the spirit of reproducible research, we publish a high quality code repository along with the paper.


title: Steering droplets on substrates using moving steps in wettability

abstract: Droplets move on substrates with a spatio-temporal wettability pattern as generated, for example, on light-switchable surfaces. To study such cases, we implement the boundary-element method to solve the governing Stokes equations for the fluid flow field inside and on the surface of a droplet and supplement it by the Cox-Voinov law for the dynamics of the contact line. Our approach reproduces the relaxation of an axisymmetric droplet in experiments, which we initiate by instantaneously switching the uniform wettability of a substrate quantified by the equilibrium contact angle. In a step profile of wettability the droplet moves towards higher wettability. Using a feedback loop to keep the distance or offset between step and droplet center constant, induces a constant velocity with which the droplet surfes on the wettability step. We analyze the velocity in terms of droplet offset and step width for typical wetting parameters. Moving instead the wettability step with constant speed, we determine the maximally possible droplet velocities under various conditions. The observed droplet speeds agree with the values from the feedback study for the same positive droplet offset.


title: The Zero Resource Speech Benchmark 2021: Metrics and baselines for unsupervised spoken language modeling

abstract: We introduce a new unsupervised task, spoken language modeling: the learning of linguistic representations from raw audio signals without any labels, along with the Zero Resource Speech Benchmark 2021: a suite of 4 black-box, zero-shot metrics probing for the quality of the learned models at 4 linguistic levels: phonetics, lexicon, syntax and semantics. We present the results and analyses of a composite baseline made of the concatenation of three unsupervised systems: self-supervised contrastive representation learning (CPC), clustering (k-means) and language modeling (LSTM or BERT). The language models learn on the basis of the pseudo-text derived from clustering the learned representations. This simple pipeline shows better than chance performance on all four metrics, demonstrating the feasibility of spoken language modeling from raw speech. It also yields worse performance compared to text-based 'topline' systems trained on the same data, delineating the space to be explored by more sophisticated end-to-end models.


title: Joint statistics of work and entropy production along quantum trajectories

abstract: In thermodynamics, entropy production and work quantify irreversibility and the consumption of useful energy, respectively, when a system is driven out of equilibrium. For quantum systems, these quantities can be identified at the stochastic level by unravelling the system's evolution in terms of quantum jump trajectories. We here derive a general formula for computing the joint statistics of work and entropy production in Markovian driven quantum systems, whose instantaneous steady-states are of Gibbs form. If the driven system remains close to the instantaneous Gibbs state at all times, we show that the corresponding two-variable cumulant generating function implies a joint detailed fluctuation theorem so long as detailed balance is satisfied. As a corollary, we derive a modified fluctuation-dissipation relation (FDR) for the entropy production alone, applicable to transitions between arbitrary steady-states, and for systems that violate detailed balance. This FDR contains a term arising from genuinely quantum fluctuations, and extends an analogous relation from classical thermodynamics to the quantum regime.


title: UHECR mass composition at highest energies from anisotropy of their arrival directions

abstract: We propose a new method for the estimation of ultra-high energy cosmic ray (UHECR) mass composition from a distribution of their arrival directions. The method employs a test statistic (TS) based on a characteristic deflection of UHECR events with respect to the distribution of luminous matter in the local Universe. Making realistic simulations of the mock UHECR sets, we show that this TS is robust to the presence of galactic and non-extreme extra-galactic magnetic fields and sensitive to the mass composition of events in a set. This allows one to constrain the UHECR mass composition by comparing the TS distribution of a composition model in question with the data TS, and to discriminate between different composition models. While the statistical power of the method depends somewhat on the MF parameters, this dependence decreases with the growth of statistics. The method shows good performance even at GZK energies where the estimation of UHCER mass composition with traditional methods is complicated by a low statistics.


title: When invariable cross-sections change: the Electron-Ion Collider case

abstract: In everyday research, it is tacitly assumed that the scattering cross-sections have fixed values for the given particle species, centre-of-mass energy, and particle polarizations. However, this assumption has been called into question after several observations of suppression of high-energy bremsstrahlung. This process will play a major role in experiments at the future Electron-Ion Collider, and we show here how variations of the bremsstrahlung cross-section can be profoundly studied there using the lateral beam displacements. In particular, we predict very strong increase of the observed cross-sections for large beam separations. We also discuss the relation of these elusive effects to other quantum phenomena occurring over macroscopic distances. In this context, spectacular and possibly useful properties of the coherent bremsstrahlung at the EIC are also evaluated.


title: GEECORR: A SAS macro for regression models of correlated binary responses and within-cluster correlation using generalized estimating equations

abstract: A SAS macro, GEECORR, has been developed for the analysis of correlated binary data based on the Prentice (1988) estimating equations method that extends the Liang and Zeger (1986) generalized estimating equations (GEE) method to include additional estimating equations for the pairwise correlation between binary variates. This extension allows for flexible modeling of both the marginal mean and within-cluster correlation as a function of their respective covariate risk factors. This paper provides an overview of the extended estimating equations method, describes the features and capabilities of the GEECORR macro, and applies the GEECORR macro to three different datasets. In addition, this paper describes the more detailed fitting algorithm proposed by Prentice (1988), of which a variation has been implemented in the GEECORR macro. We provide a small simulation study to demonstrate the efficiency of the detailed method for estimating correlation parameters.


title: Simulating an Object-Oriented Financial System in a Functional Language

abstract: This paper summarises a successful application of functional programming within a commercial environment. We report on experience at Accenture's Financial Services Solution Centre in London with simulating an object-oriented financial system in order to assist analysis and design. The work was part of a large IT project for an international investment bank and provides a pragmatic case study.


title: Power Market Tool (POMATO) for the Analysis of Zonal Electricity Markets

abstract: The proposed open-source Power Market Tool (POMATO) aims to enable research on interconnected modern and future electricity markets in the context of the physical transmission system and its secure operation. POMATO has been designed to study capacity allocation and congestion management (CACM) policies of European zonal electricity markets, especially flow-based market coupling (FBMC). For this purpose, POMATO implements methods for the analysis of simultaneous zonal market clearing, nodal (N-k secure) power flow computation for capacity allocation, and multi-stage market clearing with adaptive grid representation and redispatch. The computationally demanding N-k secure power flow is enabled via an efficient constraint reduction algorithm. POMATO provides an integrated environment for data read-in, pre- and post-processing and interactive result visualization. Comprehensive data sets of European electricity systems compiled from Open Power System Data and Matpower Cases are part of the distribution. POMATO is implemented in Python and Julia, leveraging Python's easily maintainable data processing and user interaction features and Julia's well readable algebraic modeling language, superior computational performance and interfaces to open-source and commercial solvers.


title: Urgency-aware Optimal Routing in Repeated Games through Artificial Currencies

abstract: When people choose routes minimizing their individual delay, the aggregate congestion can be much higher compared to that experienced by a centrally-imposed routing. Yet centralized routing is incompatible with the presence of self-interested agents. How can we reconcile the two? In this paper we address this question within a repeated game framework and propose a fair incentive mechanism based on artificial currencies that routes selfish agents in a system-optimal fashion, while accounting for their temporal preferences. We instantiate the framework in a parallel-network whereby agents commute repeatedly (e.g., daily) from a common start node to the end node. Thereafter, we focus on the specific two-arcs case whereby, based on an artificial currency, the agents are charged when traveling on the first, fast arc, whilst they are rewarded when traveling on the second, slower arc. We assume the agents to be rational and model their choices through a game where each agent aims at minimizing a combination of today's discomfort, weighted by their urgency, and the average discomfort encountered for the rest of the period (e.g., a week). We show that, if prices of artificial currencies are judiciously chosen, the routing pattern converges to a system-optimal solution, while accommodating the agents' urgency. We complement our study through numerical simulations. Our results show that it is possible to achieve a system-optimal solution whilst reducing the agents' perceived discomfort by 14-20% when compared to a centralized optimal but urgency-unaware policy.


title: Envy-Free Allocations Respecting Social Networks

abstract: Finding an envy-free allocation of indivisible resources to agents is a central task in many multiagent systems. Often, non-trivial envy-free allocations do not exist, and, when they do, finding them can be computationally hard. Classical envy-freeness requires that every agent likes the resources allocated to it at least as much as the resources allocated to any other agent. In many situations this assumption can be relaxed since agents often do not even know each other. We enrich the envy-freeness concept by taking into account (directed) social networks of the agents. Thus, we require that every agent likes its own allocation at least as much as those of all its (out)neighbors. This leads to a "more local" concept of envy-freeness. We also consider a "strong" variant where every agent must like its own allocation more than those of all its (out)neighbors. We analyze the classical and the parameterized complexity of finding allocations that are complete and, at the same time, envy-free with respect to one of the variants of our new concept. To this end, we study different restrictions of the agents' preferences and of the social network structure. We identify cases that become easier (from $\Sigma^\textrm{p}_2$-hard or NP-hard to polynomial-time solvability) and cases that become harder (from polynomial-time solvability to NP-hard) when comparing classical envy-freeness with our graph envy-freeness. Furthermore, we spot cases where graph envy-freeness is easier to decide than strong graph envy-freeness, and vice versa. On the route to one of our fixed-parameter tractability results, we also establish a connection to a directed and colored variant of the classical SUBGRAPH ISOMORPHISM problem, thereby extending a known fixed-parameter tractability result for the latter.


title: Abiotic Stress Prediction from RGB-T Images of Banana Plantlets

abstract: Prediction of stress conditions is important for monitoring plant growth stages, disease detection, and assessment of crop yields. Multi-modal data, acquired from a variety of sensors, offers diverse perspectives and is expected to benefit the prediction process. We present several methods and strategies for abiotic stress prediction in banana plantlets, on a dataset acquired during a two and a half weeks period, of plantlets subject to four separate water and fertilizer treatments. The dataset consists of RGB and thermal images, taken once daily of each plant. Results are encouraging, in the sense that neural networks exhibit high prediction rates (over $90\%$ amongst four classes), in cases where there are hardly any noticeable features distinguishing the treatments, much higher than field experts can supply.


title: Universality and thermoelectric transport properties of quantum dot systems

abstract: We discuss the temperature-dependent thermoelectric transport properties of semiconductor nanostructures comprising a quantum dot coupled to quantum wires: the thermal dependence of the electrical conductance, thermal conductance, and thermopower. We explore the universality of the thermoelectric properties in the temperature range associated with the Kondo crossover. In this thermal range, general arguments indicate that any equilibrium property's temperature dependence should be a universal function of the ratio $T^{*}=T/T_{K}$, where $T_{K}$ is the Kondo temperature. Considering the particle-hole symmetric, spin-degenerate Anderson model, the zero-bias electrical conductance has already been shown to map linearly onto a universal conductance through a quantum dot embedded or side-coupled to a quantum wire. Employing rigorous renormalization-group arguments, we calculate universal thermoelectric transport coefficients that allow us to extend this result to the thermopower and the thermal conductance. We present numerical renormalization-group results to illustrate the physics in our findings. Applying the universal thermoelectric coefficients to recent experimental results of the electrical conductance and thermo-voltages versus $V_{gate}$, at different temperatures in the Kondo regime, we calculate all the thermoelectric properties and obtain simple analytical fitting functions that can be used to predict the experimental results of these properties. However, we cannot check all of them, due to the lack of available experimental results over a broad temperature range.


title: Martingale Wasserstein inequality for probability measures in the convex order

abstract: It was shown by the authors that two one-dimensional probability measures in the convex order admit a martingale coupling with respect to which the integral of $\vert x-y\vert$ is smaller than twice their $\mathcal W_1$-distance (Wasserstein distance with index $1$). We showed that replacing $\vert x-y\vert$ and $\mathcal W_1$ respectively with $\vert x-y\vert^\rho$ and $\mathcal W_\rho^\rho$ does not lead to a finite multiplicative constant. We show here that a finite constant is recovered when replacing $\mathcal W_\rho^\rho$ with the product of $\mathcal W_\rho$ times the centred $\rho$-th moment of the second marginal to the power $\rho-1$. Then we study the generalisation of this new stability inequality to higher dimension.


title: Yet it moves: Learning from Generic Motions to Generate IMU data from YouTube videos

abstract: Human activity recognition (HAR) using wearable sensors has benefited much less from recent advances in Machine Learning than fields such as computer vision and natural language processing. This is to a large extent due to the lack of large scale repositories of labeled training data. In our research we aim to facilitate the use of online videos, which exists in ample quantity for most activities and are much easier to label than sensor data, to simulate labeled wearable motion sensor data. In previous work we already demonstrate some preliminary results in this direction focusing on very simple, activity specific simulation models and a single sensor modality (acceleration norm)\cite{10.1145/3341162.3345590}. In this paper we show how we can train a regression model on generic motions for both accelerometer and gyro signals and then apply it to videos of the target activities to generate synthetic IMU data (acceleration and gyro norms) that can be used to train and/or improve HAR models. We demonstrate that systems trained on simulated data generated by our regression model can come to within around 10% of the mean F1 score of a system trained on real sensor data. Furthermore we show that by either including a small amount of real sensor data for model calibration or simply leveraging the fact that (in general) we can easily generate much more simulated data from video than we can collect in terms of real sensor data the advantage of real sensor data can be eventually equalized.


title: $\Delta$-Machine Learning for Potential Energy Surfaces: A PIP approach to bring a DFT-based PES to CCSD(T) Level of Theory

abstract: ``$\Delta$-machine learning" refers to a machine learning approach to bring a property such as a potential energy surface (PES) based on low-level (LL) density functional theory (DFT) energies and gradients to close to a coupled cluster (CC) level of accuracy. Here we present such an approach that uses the permutationally invariant polynomial (PIP) method to fit high-dimensional PESs. The approach is represented by a simple equation, in obvious notation $V_{LL{\rightarrow}CC}=V_{LL}+\Delta{V_{CC-LL}}$, and demonstrated for \ce{CH4}, \ce{H3O+}, and $trans$ and $cis$-$N$-methyl acetamide (NMA), \ce{CH3CONHCH3}. For these molecules, the LL PES, $V_{LL}$, is a PIP fit to DFT/B3LYP/6-31+G(d) energies and gradients, and $\Delta{V_{CC-LL}}$ is a precise PIP fit obtained using a low-order PIP basis set and based on a relatively small number of CCSD(T) energies. For \ce{CH4} these are new calculations adopting an aug-cc-pVDZ basis, for \ce{H3O+} previous CCSD(T)-F12/aug-cc-pVQZ energies are used, while for NMA new CCSD(T)-F12/aug-cc-pVDZ calculations are performed. With as few as 200 CCSD(T) energies, the new PESs are in excellent agreement with benchmark CCSD(T) results for the small molecules, and for 12-atom NMA training is done with 4696 CCSD(T) energies.


title: High Fidelity Interactive Video Segmentation Using Tensor Decomposition Boundary Loss Convolutional Tessellations and Context Aware Skip Connections

abstract: We provide a high fidelity deep learning algorithm (HyperSeg) for interactive video segmentation tasks using a convolutional network with context-aware skip connections, and compressed, hypercolumn image features combined with a convolutional tessellation procedure. In order to maintain high output fidelity, our model crucially processes and renders all image features in high resolution, without utilizing downsampling or pooling procedures. We maintain this consistent, high grade fidelity efficiently in our model chiefly through two means: (1) We use a statistically-principled tensor decomposition procedure to modulate the number of hypercolumn features and (2) We render these features in their native resolution using a convolutional tessellation technique. For improved pixel level segmentation results, we introduce a boundary loss function; for improved temporal coherence in video data, we include temporal image information in our model. Through experiments, we demonstrate the improved accuracy of our model against baseline models for interactive segmentation tasks using high resolution video data. We also introduce a benchmark video segmentation dataset, the VFX Segmentation Dataset, which contains over 27,046 high resolution video frames, including greenscreen and various composited scenes with corresponding, hand crafted, pixel level segmentations. Our work presents an extension to improvement to state of the art segmentation fidelity with high resolution data and can be used across a broad range of application domains, including VFX pipelines and medical imaging disciplines.


title: Interpretable Visual Reasoning via Induced Symbolic Space

abstract: We study the problem of concept induction in visual reasoning, i.e., identifying concepts and their hierarchical relationships from question-answer pairs associated with images; and achieve an interpretable model via working on the induced symbolic concept space. To this end, we first design a new framework named object-centric compositional attention model (OCCAM) to perform the visual reasoning task with object-level visual features. Then, we come up with a method to induce concepts of objects and relations using clues from the attention patterns between objects' visual features and question words. Finally, we achieve a higher level of interpretability by imposing OCCAM on the objects represented in the induced symbolic concept space. Our model design makes this an easy adaption via first predicting the concepts of objects and relations and then projecting the predicted concepts back to the visual feature space so the compositional reasoning module can process normally. Experiments on the CLEVR and GQA datasets demonstrate: 1) our OCCAM achieves a new state of the art without human-annotated functional programs; 2) our induced concepts are both accurate and sufficient as OCCAM achieves an on-par performance on objects represented either in visual features or in the induced symbolic concept space.


title: HSTCosmicrays: A Python Package for Analyzing Cosmic Rays in HST Calibration Data

abstract: HSTCosmicrays is a python-based pipeline designed to find and characterize cosmic rays found in dark frames (exposures taken with the shutter closed). Dark exposures are obtained routinely by all the Hubble Space Telescope (HST) instruments for calibration. The main processing pipeline runs locally or in the cloud on AWS. To date, we have characterized more than 1.2 billion cosmic rays in ~76,000 dark frames obtained with CCDs from the four active instruments ACS/HRC, ACS/WFC, STIS, WFC3/UVIS, and the legacy instrument WFPC2.


title: Disjoint cycles with length constraints in digraphs of large connectivity or minimum degree

abstract: A conjecture by Lichiardopol states that for every $k \ge 1$ there exists an integer $g(k)$ such that every digraph of minimum out-degree at least $g(k)$ contains $k$ vertex-disjoint directed cycles of pairwise distinct lengths. Motivated by Lichiardopol's conjecture, we study the existence of vertex-disjoint directed cycles satisfying length constraints in digraphs of large connectivity or large minimum degree. Our main result is that for every $k \in \mathbb{N}$, there exists $s(k) \in \mathbb{N}$ such that every strongly $s(k)$-connected digraph contains $k$ vertex-disjoint directed cycles of pairwise distinct lengths. In contrast, for every $k \in \mathbb{N}$ we construct a strongly $k$-connected digraph containing no two vertex- or arc-disjoint directed cycles of the same length. It is an open problem whether $g(3)$ exists. Here we prove the existence of an integer $K$ such that every digraph of minimum out- and in-degree at least $K$ contains $3$ vertex-disjoint directed cycles of pairwise distinct lengths.