title: Towards a Real-Time Facial Analysis System

abstract: Facial analysis is an active research area in computer vision, with many practical applications. Most of the existing studies focus on addressing one specific task and maximizing its performance. For a complete facial analysis system, one needs to solve these tasks efficiently to ensure a smooth experience. In this work, we present a system-level design of a real-time facial analysis system. With a collection of deep neural networks for object detection, classification, and regression, the system recognizes age, gender, facial expression, and facial similarity for each person that appears in the camera view. We investigate the parallelization and interplay of individual tasks. Results on common off-the-shelf architecture show that the system's accuracy is comparable to the state-of-the-art methods, and the recognition speed satisfies real-time requirements. Moreover, we propose a multitask network for jointly predicting the first three attributes, i.e., age, gender, and facial expression. Source code and trained models are available at https://github.com/mahehu/TUT-live-age-estimator.


title: Distributions on partitions arising from Hilbert schemes and hook lengths

abstract: Recent works at the interface of algebraic combinatorics, algebraic geometry, number theory, and topology have provided new integer-valued invariants on integer partitions. It is natural to consider the distribution of partitions when sorted by these invariants in congruence classes. We consider the prominent situations which arise from extensions of the Nekrasov-Okounkov hook product formula, and from Betti numbers of various Hilbert schemes of $n$ points on $\mathbb{C}^2.$ For the Hilbert schemes, we prove that homology is equidistributed as $n\to \infty.$ For $t$-hooks, we prove distributions which are often not equidistributed. The cases where $t\in \{2, 3\}$ stand out, as there are congruence classes where such counts are zero. To obtain these distributions, we obtain analytic results which are of independent interest. We determine the asymptotics, near roots of unity, of the ubiquitous infinite products $$ F_1(\xi; q):=\prod_{n=1}^{\infty}\left(1-\xi q^n\right), \ \ \ F_2(\xi; q):=\prod_{n=1}^{\infty}\left(1-(\xi q)^n\right) \ \ \ {\text {and}}\ \ \ F_3(\xi; q):=\prod_{n=1}^{\infty}\left(1-\xi^{-1}(\xi q)^n\right). $$


title: Change of Corner Charge and Adiabatic Current Distribution in Two Dimensional Insulators with Inversion Symmetry

abstract: We discuss the change of the corner charge for noninteracting two dimensional insulators with inversion symmetry undergoing adiabatic evolution. We show that the change of the corner charge is accounted for by the adiabatic current flowing along the edges of the system. The study of systems with quasi-1D geometry is necessary to derive the analytical expression for the adiabatic current. This fact suggests that the change of the corner charge is neither a purely bulk nor edge effect, but rather a mixed one. The derived adiabatic current was examined and shows good agreement with the numerical calculation of Benalcazar-Bernevig-Hughes model.


title: The Ratios Conjecture and upper bounds for negative moments of $L$-functions over function fields

abstract: We prove special cases of the Ratios Conjecture for the family of quadratic Dirichlet $L$--functions over function fields. More specifically, we study the average of $L(1/2+\alpha,\chi_D)/L(1/2+\beta,\chi_D)$, when $D$ varies over monic, square-free polynomials of degree $2g+1$ over $\mathbb{F}_q[x]$, as $g \to \infty$, and we obtain an asymptotic formula when $\Re \beta \gg g^{-1/2+\varepsilon}$. We also study averages of products of $2$ over $2$ and $3$ over $3$ $L$--functions, and obtain asymptotic formulas when the shifts in the denominator have real part bigger than $g^{-1/4+\varepsilon}$ and $g^{-1/6+\varepsilon}$ respectively. The main ingredient in the proof is obtaining upper bounds for negative moments of $L$--functions. The upper bounds we obtain are expected to be almost sharp in the ranges described above. As an application, we recover the asymptotic formula for the one-level density of zeros in the family with the support of the Fourier transform in $(-2,2)$.


title: Grammatical Profiling for Semantic Change Detection

abstract: Semantics, morphology and syntax are strongly interdependent. However, the majority of computational methods for semantic change detection use distributional word representations which encode mostly semantics. We investigate an alternative method, grammatical profiling, based entirely on changes in the morphosyntactic behaviour of words. We demonstrate that it can be used for semantic change detection and even outperforms some distributional semantic methods. We present an in-depth qualitative and quantitative analysis of the predictions made by our grammatical profiling system, showing that they are plausible and interpretable.


title: Frequency-based Ultrasonic Backscatter Modulation for Passive Sensing Applications

abstract: Ultrasonic backscatter communication has gained popularity in recent years where piezoceramic resonators are used as acoustic antennas. Currently, backscatter communication revolves around the amplitude modulation of the echo signal by the sensor, which can be modeled as a variable shunt impedance. Amplitude based sensing is prone to high levels of noise, motion artifacts, and has low efficiency with respect to power usage and bandwidth. To overcome these shortcomings, we present here, a frequency-based sensing method for ultrasonic backscatter communication. This system exhibits a frequency shift in the ultrasonic sensor's parallel resonance when its shunt capacitance is varied, similar to an inductive near field link. The concept is simulated using an equivalent end-to-end model in SPICE that matches well with the experimental observation. To monitor the resonance frequency shift in the experiments a variety of methods are employed including ringdown measurements, chirp spectroscopy, bode analysis and phase locked loop. All the methods provde substantial proof for feasibility of frequency-based sensing in ultrasonic backscatter communication enabling passive sensor motes for sensing applications.


title: SubseasonalClimateUSA: A Dataset for Subseasonal Forecasting and Benchmarking

abstract: Subseasonal forecasting of the weather two to six weeks in advance is critical for resource allocation and advance disaster notice but poses many challenges for the forecasting community. At this forecast horizon, physics-based dynamical models have limited skill, and the targets for prediction depend in a complex manner on both local weather variables and global climate variables. Recently, machine learning methods have shown promise in advancing the state of the art but only at the cost of complex data curation, integrating expert knowledge with aggregation across multiple relevant data sources, file formats, and temporal and spatial resolutions. To streamline this process and accelerate future development, we introduce SubseasonalClimateUSA, a curated dataset for training and benchmarking subseasonal forecasting models in the United States. We use this dataset to benchmark a diverse suite of models, including operational dynamical models, classical meteorological baselines, and ten state-of-the-art machine learning and deep learning-based methods from the literature. Overall, our benchmarks suggest simple and effective ways to extend the accuracy of current operational models. SubseasonalClimateUSA is regularly updated and accessible via the https://github.com/microsoft/subseasonal_data/ Python package.


title: ARROCH: Augmented Reality for Robots Collaborating with a Human

abstract: Human-robot collaboration frequently requires extensive communication, e.g., using natural language and gestures. Augmented reality (AR) has provided an alternative way of bridging the communication gap between robots and people. However, most current AR-based human-robot communication methods are unidirectional, focusing on how the human adapts to robot behaviors, and are limited to single-robot domains. In this paper, we develop AR for Robots Collaborating with a Human (ARROCH), a novel algorithm and system that supports bidirectional, multi-turn, human-multi-robot communication in indoor multi-room environments. The human can see through obstacles to observe the robots' current states and intentions, and provide feedback, while the robots' behaviors are then adjusted toward human-multi-robot teamwork. Experiments have been conducted with real robots and human participants using collaborative delivery tasks. Results show that ARROCH outperformed a standard non-AR approach in both user experience and teamwork efficiency. In addition, we have developed a novel simulation environment using Unity (for AR and human simulation) and Gazebo (for robot simulation). Results in simulation demonstrate ARROCH's superiority over AR-based baselines in human-robot collaboration.


title: Chiral string theories as an interpolation between strings and particles

abstract: A new set of boundary conditions for string propagators is proposed in this paper. The boundary conditions are parametrized by a complex number $\lambda$. Under these new boundary conditions, the left-moving and right-moving modes are treated unequally. Thus, we called them chiral string theories. If $\lambda = -1$, the spectrum of such theory truncates to a finite number, and therefore it becomes a different description of supergravity. We found the spectrum of chiral string theories by requiring that the vertex operators are conformally invariant. In addition, we also calculate the amplitudes for arbitrary $\lambda$. The amplitudes are expressed as a product of open string amplitudes which are similar to the KLT relation. The unitarity of these theories are investigated. However, we found out that except for $\lambda = \pm 1$, all other theories are not unitary; i.e., only the supergravity and ordinary strings are unitary. Although most of the chiral strings are not physical, they still serve as a valuable tool in studying the relation between particle theories and string theories.


title: Homogeneous Polynomials: Harmonic Means and Completely Partitioned Weighted Geometric Means

abstract: We provide two new characterizations of bounded orthogonally additive polynomials from a uniformly complete vector lattice into a convex bornological space using harmonic means and completely partitioned weighted geometric means. Our result involving completely partitioned weighted geometric means generalizes a recent theorem on bounded orthogonally additive polynomials by Z.A. Kusraeva as well as parts of related theorems by G. Buskes and the author.


title: The Compton Spectrometer and Imager Project for MeV Astronomy

abstract: The Compton Spectrometer and Imager (COSI) is a 0.2-5 MeV Compton telescope capable of imaging, spectroscopy, and polarimetry of astrophysical sources. Such capabilities are made possible by COSI's germanium cross-strip detectors, which provide high efficiency, high resolution spectroscopy and precise 3D positioning of photon interactions. Science goals for COSI include studies of 0.511 MeV emission from antimatter annihilation in the Galaxy, mapping radioactive elements from nucleosynthesis, determining emission mechanisms and source geometries with polarization, and detecting and localizing multimessenger sources. The instantaneous field of view (FOV) for the germanium detectors is >25% of the sky, and they are surrounded on the sides and bottom by active shields, providing background rejection as well as allowing for detection of gamma-ray bursts or other gamma-ray flares over >50% of the sky. We have completed a Phase A concept study to consider COSI as a Small Explorer (SMEX) satellite mission, and here we discuss the advances COSI-SMEX provides for astrophysics in the MeV bandpass.


title: Digital Signal Processing Using Deep Neural Networks

abstract: Currently there is great interest in the utility of deep neural networks (DNNs) for the physical layer of radio frequency (RF) communications. In this manuscript, we describe a custom DNN specially designed to solve problems in the RF domain. Our model leverages the mechanisms of feature extraction and attention through the combination of an autoencoder convolutional network with a transformer network, to accomplish several important communications network and digital signals processing (DSP) tasks. We also present a new open dataset and physical data augmentation model that enables training of DNNs that can perform automatic modulation classification, infer and correct transmission channel effects, and directly demodulate baseband RF signals.


title: Ferromagnetic Double Perovskite Semiconductors with Tunable Properties

abstract: We successfully dope the magnetically silent double perovskite semiconductor Sr2GaSbO6 to induce ferromagnetism and tune its band gap, with Ga3+ partially substituted by the magnetic trivalent cation Mn3+, in a rigid cation ordering with Sb5+. Our new ferromagnetic semiconducting Sr2Ga1-xMnxSbO6 double perovskite, which crystallizes in tetragonal symmetry (space group I4/m) and has tunable ferromagnetic ordering temperature and band gap, suggests that magnetic ion doping of double perovskites is a productive avenue towards obtaining materials for application in next-generation oxide-based spintronic devices.


title: The Population of Interstellar Objects Detectable with the LSST and Accessible for $\textit{In Situ}$ Rendezvous with Various Mission Designs

abstract: The recently discovered population of interstellar objects presents us with the opportunity to characterize material from extrasolar planetary and stellar systems up close. The forthcoming Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) will provide an unprecedented increase in sensitivity to these objects compared to the capabilities of currently operational observational facilities. We generate a synthetic population of `Oumuamua-like objects drawn from their galactic kinematics, and identify the distribution of impact parameters, eccentricities, hyperbolic velocities and sky locations of objects detectable with the LSST, assuming no cometary activity. This population is characterized by a clustering of trajectories in the direction of the solar apex and anti-apex, centered at orbital inclinations of $\sim90^\circ$. We identify the ecliptic or solar apex as the optimal sky locations to search for future interstellar objects as a function of survey limiting magnitude. Moreover, we identify the trajectories of detectable objects that will be reachable for \textit{in-situ} rendezvous with a dedicated mission with the capabilities of the forthcoming \textit{Comet Interceptor} or proposed \textit{Bridge} concept. By scaling our fractional population statistics with the inferred spatial number density, we estimate that the LSST will detect of order $\sim 15$ interstellar objects over the course of its $\sim10$ year observational campaign. Furthermore, we find that there should be $\sim1-3$ and $\sim0.0007-0.001$ reachable targets for missions with propulsion capabilities comparable to \textit{Bridge} and \textit{Comet Interceptor}, respectively. These numbers are lower limits, and will be readily updateable when the number density and size frequency distribution of interstellar objects are better constrained.

categories: astro-ph.EP astro-ph.GA astro-ph.IM astro-ph.SR


title: Anomalous elasticity of cellular tissue vertex model

abstract: Vertex Models, as used to describe cellular tissue, have an energy controlled by deviations of each cell area and perimeter from target values. The constrained nonlinear relation between area and perimeter leads to new mechanical response. Here we provide a mean-field treatment of a highly simplified model: a uniform network of regular polygons with no topological rearrangements. Since all polygons deform in the same way, we only need to analyze the ground states and the response to deformations of a single polygon (cell). The model exhibits the known transition between a fluid/compatible state, where the cell can accommodate both target area and perimeter, and a rigid/incompatible state. %The rigid solid-like state has a single gapped ground state. We calculate and measure the mechanical resistance to various deformation protocols and discover that at the onset of rigidity, where a single zero-energy ground-state exists, %We show that in the incompatible state, where a single frustrated ground-state exists, linear elasticity fails to describe the mechanical response to even infinitesimal deformations. In particular we identify a breakdown of reciprocity expressed via different moduli for compressive and tensile loads, implying non-analyticity of the energy functional. We give a pictorial representation in configuration space that reveals that the complex elastic response of the Vertex Model arises from the presence of two distinct sets of reference states (associated with target area and target perimeter).


title: Non-intrusive Balancing Transformation of Highly Stiff Systems with Lightly-damped Impulse Response

abstract: Balanced truncation (BT) is a model reduction method that utilizes a coordinate transformation to retain eigen-directions that are highly observable and reachable. To address realizability and scalability of BT applied to highly stiff and lightly-damped systems, a non-intrusive data-driven method is developed for balancing discrete-time systems via the eigensystem realization algorithm (ERA). The advantage of ERA for balancing transformation makes full-state outputs tractable. Further, ERA enables balancing despite stiffness, by eliminating computation of balancing modes and adjoint simulations. As a demonstrative example, we create balanced ROMs for a one-dimensional reactive flow with pressure forcing, where the stiffness introduced by the chemical source term is extreme (condition number $10^{13}$), preventing analytical implementation of BT. We investigate the performance of ROMs in prediction of dynamics with unseen forcing inputs and demonstrate stability and accuracy of balanced ROMs in truly predictive scenarios whereas without ERA, POD-Galerkin and Least-squares Petrov-Galerkin projections fail to represent the true dynamics. We show that after the initial transients under unit impulse forcing, the system undergoes lightly-damped oscillations, which magnifies the influence of sampling properties on predictive performance of the balanced ROMs. We propose an output domain decomposition approach and couple it with tangential interpolation to resolve sharp gradients at reduced computational costs.


title: Canonical structures of $A$ and $B$ forms

abstract: In their seminal paper (Phys. Rev.121, 920 (1961)) Sudarshan, Mathews and Rau investigated properties of the dynamical $A$ and $B$ maps acting on $n$ dimensional quantum systems. Nature of the dynamical maps in open quantum system evolutions has attracted great deal of attention in the later years. However, the novel paper on the $A$ and $B$ dynamical maps has not received its due attention. In this tutorial article we review the properties of $A$ and $B$ forms associated with the dynamics of finite dimensional quantum systems. In particular we investigate a canonical structure associated with the $A$ form and establish its equivalence with the associated $B$ form. We show that the canonical structure of the $A$ form captures the completely positive (not completely positive) nature of the dynamics in a succinct manner. This feature is illustrated through physical examples of qubit channels.


title: RETRONLU: Retrieval Augmented Task-Oriented Semantic Parsing

abstract: While large pre-trained language models accumulate a lot of knowledge in their parameters, it has been demonstrated that augmenting it with non-parametric retrieval-based memory has a number of benefits from accuracy improvements to data efficiency for knowledge-focused tasks, such as question answering. In this paper, we are applying retrieval-based modeling ideas to the problem of multi-domain task-oriented semantic parsing for conversational assistants. Our approach, RetroNLU, extends a sequence-to-sequence model architecture with a retrieval component, used to fetch existing similar examples and provide them as an additional input to the model. In particular, we analyze two settings, where we augment an input with (a) retrieved nearest neighbor utterances (utterance-nn), and (b) ground-truth semantic parses of nearest neighbor utterances (semparse-nn). Our technique outperforms the baseline method by 1.5% absolute macro-F1, especially at the low resource setting, matching the baseline model accuracy with only 40% of the data. Furthermore, we analyze the nearest neighbor retrieval component's quality, model sensitivity and break down the performance for semantic parses of different utterance complexity.


title: Gravitational Collapse in Massive Gravity on de Sitter Spacetime

abstract: We analyze the evolution of a homogenous and pressureless ball of dust (or "star") in ghost-free massive gravity on de Sitter spacetime. We find that gravitational collapse does not take place for all parameters of the massive gravity theory. For parameters where it does occur, we find the expression for the location of the apparent horizon where it crosses the surface of the star, indicating the location of the apparent horizon of the vacuum solution at that moment. We determine the Ricci curvature at the boundary of the star and extract the finite correction to the curvature of the apparent horizon due to the graviton mass. Finally, we argue that our collapsing solutions cannot be matched to a static, spherically symmetric vacuum solution at the star's surface, providing further evidence that physical black hole solutions in massive gravity are likely time-dependent.


title: Social, Environmental, and Technical: Factors at Play in the Current Use and Future Design of Small-Group Captioning

abstract: Real-time captioning is a critical accessibility tool for many d/Deaf and hard of hearing (DHH) people. While the vast majority of captioning work has focused on formal settings and technical innovations, in contrast, we investigate captioning for informal, interactive small-group conversations, which have a high degree of spontaneity and foster dynamic social interactions. This paper reports on semi-structured interviews and design probe activities we conducted with 15 DHH participants to understand their use of existing real-time captioning services and future design preferences for both in-person and remote small-group communication. We found that our participants' experiences of captioned small-group conversations are shaped by social, environmental, and technical considerations (e.g., interlocutors' pre-established relationships, the type of captioning displays available, and how far captions lag behind speech). When considering future captioning tools, participants were interested in greater feedback on non-speech elements of conversation (e.g., speaker identity, speech rate, volume) both for their personal use and to guide hearing interlocutors toward more accessible communication. We contribute a qualitative account of DHH people's real-time captioning experiences during small-group conversation and future design considerations to better support the groups being captioned, both in person and online.


title: N=(0,4) Black String Chains

abstract: We construct black string solutions in Type IIA supergravity arising from intersecting D2-D4-D6-NS5 branes in the presence of fractional D4-branes. The fractional D4-branes arise from D6-branes wrapping (collapsing) two-cycles in a Calabi--Yau two-fold. In the near horizon limit these solutions give rise to AdS$_3$ geometries preserving $\mathcal{N}=(0,4)$ supersymmetry and fall within the recent classification of \cite{Lozano:2019emq}. We interpret our solutions as describing chains of black strings stacked on top of each other along an interval. We construct 2d quiver CFTs dual to our solutions that reproduce the Bekenstein-Hawking entropy microscopically.


title: Back to the Formula -- LHC Edition

abstract: While neural networks offer an attractive way to numerically encode functions, actual formulas remain the language of theoretical particle physics. We show how symbolic regression trained on matrix-element information provides, for instance, optimal LHC observables in an easily interpretable form. We introduce the method using the effect of a dimension-6 coefficient on associated ZH production. We then validate it for the known case of CP-violation in weak-boson-fusion Higgs production, including detector effects.


title: What Would it Take to get Biomedical QA Systems into Practice?

abstract: Medical question answering (QA) systems have the potential to answer clinicians uncertainties about treatment and diagnosis on demand, informed by the latest evidence. However, despite the significant progress in general QA made by the NLP community, medical QA systems are still not widely used in clinical environments. One likely reason for this is that clinicians may not readily trust QA system outputs, in part because transparency, trustworthiness, and provenance have not been key considerations in the design of such models. In this paper we discuss a set of criteria that, if met, we argue would likely increase the utility of biomedical QA systems, which may in turn lead to adoption of such systems in practice. We assess existing models, tasks, and datasets with respect to these criteria, highlighting shortcomings of previously proposed approaches and pointing toward what might be more usable QA systems.


title: Improving the Silicon Interactions of GFN-xTB

abstract: A general-purpose Density Functional Tight Binding method, the GFN-xTB model is gaining increased popularity in accurate simulations that are out of scope for conventional ab initio formalisms. We show that in its original GFN1-xTB parametrization, organosilicon compounds are described poorly. This issue is addressed by re-fitting the model's silicon parameters to a data set of ten thousand reference compounds, geometry-optimized with the revPBE functional. The resulting GFN1-xTB-Si parametrization shows improved accuracy in the prediction of system energies, nuclear forces and geometries and should be considered for all applications of the GFN-xTB Hamiltonian to systems that contain silicon.


title: Attacks on Visualization-Based Malware Detection: Balancing Effectiveness and Executability

abstract: With the rapid development of machine learning for image classification, researchers have found new applications of visualization techniques in malware detection. By converting binary code into images, researchers have shown satisfactory results in applying machine learning to extract features that are difficult to discover manually. Such visualization-based malware detection methods can capture malware patterns from many different malware families and improve malware detection speed. On the other hand, recent research has also shown adversarial attacks against such visualization-based malware detection. Attackers can generate adversarial examples by perturbing the malware binary in non-reachable regions, such as padding at the end of the binary. Alternatively, attackers can perturb the malware image embedding and then verify the executability of the malware post-transformation. One major limitation of the first attack scenario is that a simple pre-processing step can remove the perturbations before classification. For the second attack scenario, it is hard to maintain the original malware's executability and functionality. In this work, we provide literature review on existing malware visualization techniques and attacks against them. We summarize the limitation of the previous work, and design a new adversarial example attack against visualization-based malware detection that can evade pre-processing filtering and maintain the original malware functionality. We test our attack on a public malware dataset and achieve a 98% success rate.


title: Magnetic properties and signatures of moment ordering in triangular lattice antiferromagnet KCeO$_2$

abstract: The magnetic ground state and the crystalline electric field level scheme of the triangular lattice antiferromagnet KCeO$_2$ are investigated. Below $T_N =$ 300 mK, KCeO$_2$ develops signatures of magnetic order in specific heat measurements and low energy inelastic neutron scattering data. Trivalent Ce$^{3+}$ ions in the $D_{3d}$ local environment of this compound exhibit large splittings among the lowest three $4f^1$ Kramers doublets defining for the free ion the $J = 5/2$ sextet and a ground state doublet with dipole character, consistent with recent theoretical predictions in M. S. Eldeeb et al. Phys. Rev. Materials 4, 124001 (2020). An unexplained, additional local mode appears, and potential origins of this anomalous mode are discussed.


title: A new look at the anthropogenic global warming consensus: an econometric forecast based on the ARIMA model of paleoclimate series

abstract: This paper aims to project a climate change scenario using a stochastic paleotemperature time series model and compare it with the prevailing consensus. The ARIMA - Autoregressive Integrated Moving Average Process model was used for this purpose. The results show that the parameter estimates of the model were below what is established by the anthropogenic current and governmental organs, such as the IPCC (UN), considering a 100-year scenario, which suggests a period of temperature reduction and a probable cooling. Thus, we hope with this study to contribute to the discussion by adding a statistical element of paleoclimate in counterpoint to the current scientific consensus and place the debate in a long-term historical dimension, in line with other existing research on the topic.


title: Non-perturbative field theoretical aspects of graphene and related systems

abstract: In this article, we review the dynamics of charge carriers in graphene and related 2D systems from a quantum field theoretical point of view. By allowing the electromagnetic fields to propagate throughout space and constraining fermions to move on a 2D manifold, the effective theory of such systems becomes a non-local version of quantum electrodynamics (QED) dubbed in literature pseudo or reduced QED. We review some aspects of the theory assuming the coupling arbitrary in strength. In particular, we focus on the chiral symmetry breaking scenarios and the analytical structure of the fermion propagator in vacuum and under the influence of external agents like a heat bath, in the presence of a Chern-Simons term, anisotropy and in curved space. We briefly discuss the major advances and some new results on this field.


title: On the degree of a finite cover which fibers over circle

abstract: We give a lower bound for the degree of a finite cover of a hyperbolic 3-manifold which fibers over the circle, in terms of volume, the diameter of the manifold and other new invariants.


title: Precise Masses and Orbits for Nine Radial Velocity Exoplanets

abstract: Radial velocity (RV) surveys have discovered hundreds of exoplanetary systems but suffer from a fundamental degeneracy between planet mass $M_p$ and orbital inclination $i$. In this paper we break this degeneracy by combining RVs with complementary absolute astrometry taken from the Gaia EDR3 version of the cross-calibrated Hipparcos-Gaia Catalog of Accelerations (HGCA). We use the Markov Chain Monte Carlo orbit code $\tt orvara$ to simultaneously fit literature RVs and absolute astrometry from the HGCA. We constrain the orbits, masses, and inclinations of nine single and massive RV companions orbiting nearby G and K stars. We confirm the planetary nature of six companions: HD 29021 b ($4.47_{-0.65}^{+0.67}\,M_{\rm Jup}$), HD 81040 b ($7.24_{-0.37}^{+1.0}\,M_{\rm Jup}$), HD 87883 b ($6.31_{-0.32}^{+0.31}\,M_{\rm Jup}$), HD 98649 b ($9.7_{-1.9}^{+2.3}\,M_{\rm Jup}$), HD 106252 b ($10.00_{-0.73}^{+0.78}\,M_{\rm Jup}$), and HD 171238 b ($8.8_{-1.3}^{+3.6}\,M_{\rm Jup}$). We place one companion, HD 196067 b ($12.5_{-1.8}^{+2.5}\,M_{\rm Jup}$) on the planet-brown dwarf boundary, and two companions in the low mass brown dwarf regime: HD 106515 Ab ($18.9_{-1.4}^{+1.5}\,M_{\rm Jup}$), and HD 221420 b (${20.6}_{-1.6}^{+2.0}\,M_{\rm Jup}$). The brown dwarf HD 221420 b, with a semi-major axis of ${9.99}_{-0.70}^{+0.74}$ AU, a period of ${27.7}_{-2.5}^{+3.0}$ years, and an eccentricity of $0.162_{-0.030}^{+0.035}$ represents a promising target for high-contrast imaging. The RV orbits of HD 87883 b, HD 98649 b, HD 171238 b, and HD 196067 b are not fully constrained yet because of insufficient RV data. We find two possible inclinations for each of these orbits due to difficulty in separating prograde from retrograde orbits, but we expect this will change decisively with future Gaia data releases.


title: Global well-posedness for the nonlinear generalized parabolic Anderson model equation

abstract: We study the global existence of the singular nonlinear parabolic Anderson model equation on $2$-dimensional tours $\mathbb{T}^2$. The method is based on paracontrolled distribution and renormalization. After split the original nonlinear parabolic Anderson model equation into two simple equations, we prove the global well-posedness by some a priori estimates and smooth approximations. Furthermore, we prove the uniqueness of the solution by using classical energy estimates.


title: Packing of elastic rings with friction

abstract: We study the deformations of elastic filaments confined within slowly-shrinking circular boundaries, under contact forces with friction. We perform computations with a spring-lattice model that deforms like a thin inextensible filament of uniform bending stiffness. Early in the deformation, two lobes of the filament make contact. If the friction coefficient is small enough, one lobe slides inside the other; otherwise, the lobes move together or one lobe bifurcates the other. There follows a sequence of deformations that is a mixture of spiraling and bifurcations, primarily the former with small friction and the latter with large friction. With zero friction, a simple model predicts that the maximum curvature and the total elastic energy scale as the wall radius to the -3/2 and -2 powers respectively. With nonzero friction, the elastic energy follows a similar scaling but with a prefactor up to 8 times larger, due to delayering and bending with a range of small curvatures. For friction coefficients as large as 1, the deformations are qualitatively similar with and without friction at the outer wall. Above 1, the wall friction case becomes dominated by buckling near the wall.


title: Noncommutative Ergodic Optimization and Unique Ergodicity

abstract: We extend the theory of ergodic optimization and maximizing measures to the non-commutative field of C*-dynamical systems. We then employ this ergodic optimization machinery to provide an alternate characterization of unique erogdicity of C*-dynamical systems when the resident group action satisfies certain Choquet-theoretic assumptions.


title: Stability region and critical delay

abstract: The location of roots of the characteristic equation of a linear delay differential equation (DDE) determines the stability of the linear DDE. However, by its transcendency, there is no general criterion on the contained parameters for the stability. Here we mainly concentrate on the study of a simple transcendental equation $(*)$ $z + a - w \mathrm{e}^{-\tau z} = 0$ with coefficients of real $a$ and complex $w$ and a delay parameter $\tau > 0$ to tackle this transcendency brought by delay. The consideration is twofold: (i) to give the stability region in the parameter space for Eq.~$(*)$ by using the critical delay and (ii) to compare this with a graphical method (so-called the method of D-partitions) by combining with the delay sequence obtained by conditions for purely imaginary roots. By (i), we obtain another proof of Hayes' and Sakata's results, which reveals the nature of imaginary $w$ case in Eq.~$(*)$. By (ii), we propose a method combining the analytic one and geometric one. This combination is important because it will be helpful in studying characteristic equations having higher-dimensional parameters.


title: On $p$-integrality of instanton numbers

abstract: We show integrality of instanton numbers in several key examples of mirror symmetry. Our methods are essentially elementary, they are based on our previous work in the series of papers called Dwork crystals I, II and III.


title: Variability in Proto-Planetary Nebulae: VIII. A New Sample of Southern Hemisphere Objects

abstract: As part of our continuing study of light variability in proto-planetary nebulae (PPNe), we present the results from a long-term study of nine southern hemisphere objects. We have monitored their light variations over a nine-year interval from 2010-2018. These were supplemented by data from the ASAS-SN and ASAS-3 surveys, leading to combined light curves from 2000 to 2020. Pulsation periods were found in seven of the objects, although the three shortest must be regarded as tentative. The periods range from 24 to 73 days. When compared with the results of previous studies of the light variations in PPNe, we find that they show the same trends of shorter period and smaller light variations with higher temperatures. Luminosities were calculated based on the spectral energy distributions, reddening, and Gaia distances, and these confirm the identification of all but one as post-AGB objects. Three of the stars possess long-period variations of 5 to 19 years. These are most likely due to the periodic obscuration of the star by a disk, suggesting the presence of a binary companion and a circumbinary disk.


title: Exploring Coevolutionary Dynamics of Competitive Arms-Races Between Infinitely Diverse Heterogenous Adaptive Automated Trader-Agents

abstract: We report on a series of experiments in which we study the coevolutionary "arms-race" dynamics among groups of agents that engage in adaptive automated trading in an accurate model of contemporary financial markets. At any one time, every trader in the market is trying to make as much profit as possible given the current distribution of different other trading strategies that it finds itself pitched against in the market; but the distribution of trading strategies and their observable behaviors is constantly changing, and changes in any one trader are driven to some extent by the changes in all the others. Prior studies of coevolutionary dynamics in markets have concentrated on systems where traders can choose one of a small number of fixed pure strategies, and can change their choice occasionally, thereby giving a market with a discrete phase-space, made up of a finite set of possible system states. Here we present first results from two independent sets of experiments, where we use minimal-intelligence trading-agents but in which the space of possible strategies is continuous and hence infinite. Our work reveals that by taking only a small step in the direction of increased realism we move immediately into high-dimensional phase-spaces, which then present difficulties in visualising and understanding the coevolutionary dynamics unfolding within the system. We conclude that further research is required to establish better analytic tools for monitoring activity and progress in co-adapting markets. We have released relevant Python code as open-source on GitHub, to enable others to continue this work.


title: GAP2WSS: A Genetic Algorithm based on the Pareto Principle for Web Service Selection

abstract: Despite all the progress in Web service selection, the need for an approach with a better optimality and performance still remains. This paper presents a genetic algorithm by adopting the Pareto principle that is called GAP2WSS for selecting a Web service for each task of a composite Web service from a pool of candidate Web services. In contrast to the existing approaches, all global QoS constraints, interservice constraints, and transactional constraints are considered simultaneously. At first, all candidate Web services are scored and ranked per each task using the proposed mechanism. Then, the top 20 percent of the candidate Web services of each task are considered as the candidate Web services of the corresponding task to reduce the problem search space. Finally, the Web service selection problem is solved by focusing only on these 20 percent candidate Web services of each task using a genetic algorithm. Empirical studies demonstrate this approach leads to a higher efficiency and efficacy as compared with the case that all the candidate Web services are considered in solving the problem.


title: Fairness without Imputation: A Decision Tree Approach for Fair Prediction with Missing Values

abstract: We investigate the fairness concerns of training a machine learning model using data with missing values. Even though there are a number of fairness intervention methods in the literature, most of them require a complete training set as input. In practice, data can have missing values, and data missing patterns can depend on group attributes (e.g. gender or race). Simply applying off-the-shelf fair learning algorithms to an imputed dataset may lead to an unfair model. In this paper, we first theoretically analyze different sources of discrimination risks when training with an imputed dataset. Then, we propose an integrated approach based on decision trees that does not require a separate process of imputation and learning. Instead, we train a tree with missing incorporated as attribute (MIA), which does not require explicit imputation, and we optimize a fairness-regularized objective function. We demonstrate that our approach outperforms existing fairness intervention methods applied to an imputed dataset, through several experiments on real-world datasets.


title: Beyond Discriminant Patterns: On the Robustness of Decision Rule Ensembles

abstract: Local decision rules are commonly understood to be more explainable, due to the local nature of the patterns involved. With numerical optimization methods such as gradient boosting, ensembles of local decision rules can gain good predictive performance on data involving global structure. Meanwhile, machine learning models are being increasingly used to solve problems in high-stake domains including healthcare and finance. Here, there is an emerging consensus regarding the need for practitioners to understand whether and how those models could perform robustly in the deployment environments, in the presence of distributional shifts. Past research on local decision rules has focused mainly on maximizing discriminant patterns, without due consideration of robustness against distributional shifts. In order to fill this gap, we propose a new method to learn and ensemble local decision rules, that are robust both in the training and deployment environments. Specifically, we propose to leverage causal knowledge by regarding the distributional shifts in subpopulations and deployment environments as the results of interventions on the underlying system. We propose two regularization terms based on causal knowledge to search for optimal and stable rules. Experiments on both synthetic and benchmark datasets show that our method is effective and robust against distributional shifts in multiple environments.


title: Transcoding Billions of Unicode Characters per Second with SIMD Instructions

abstract: In software, text is often represented using Unicode formats (UTF-8 and UTF-16). We frequently have to convert text from one format to the other, a process called transcoding. Popular transcoding functions are slower than state-of-the-art disks and networks. These transcoding functions make little use of the single-instruction-multiple-data (SIMD) instructions available on commodity processors. By designing transcoding algorithms for SIMD instructions, we multiply the speed of transcoding on current systems (x64 and ARM). To ensure reproducibility, we make our software freely available as an open source library.


title: Non-vanishing of symmetric cube $L$-functions

abstract: We prove that there are infinitely many Maass--Hecke cuspforms over the field $\mathbb{Q}[\sqrt{-3}]$ such that the corresponding symmetric cube $L$-series does not vanish at the center of the critical strip. This is done by using a result of Ginzburg, Jiang and Rallis which shows that the symmetric cube non-vanishing happens if and only if a certain triple product integral involving the cusp form and the cubic theta function on $\mathbb{Q}[\sqrt{-3}]$ does not vanish. We use spectral theory and the properties of the cubic theta function to show that the non-vanishing of this triple product occurs for infinitely many cusp forms. We also formulate a conjecture about the meaning of the absolute value squared of the triple product which is reminiscent of Watson's identity.


title: ICEV dismantling or recycling on a challenging environment

abstract: Nowadays Sustainability is a huge issue. Sustainability deals with the need for the protection of the natural environment and ecosystems health and requires innovation and commitment with the future. This manuscript uses the infinite servers with Poisson arrivals queue system, modelling Internal Combustion Engine Vehicles (ICEV), normally cars but not only, which turn idle when conventional energy becomes scarce, or a new status quo is required. In such a case, they are recycled, becoming either EV-Electric Vehicles or HEV-Hybrid Electric Vehicles or FCEV-Fuel Cell Electric Vehicles, or are dismantled (DV-Dismantled Vehicles). Our model shows that when the rhythm ICEV become EV, HEV, FCEV and DV is greater than the rate at which they get idle the system tends to balance. In a cost-benefit analysis perspective, there are minimum benefits above which, both dismantling and recycling, are interesting. Additionally, the most interesting is the one for which the minimum benefit is the least.


title: Classification with Nearest Disjoint Centroids

abstract: In this paper, we develop a new classification method based on nearest centroid, and it is called the nearest disjoint centroid classifier. Our method differs from the nearest centroid classifier in the following two aspects: (1) the centroids are defined based on disjoint subsets of features instead of all the features, and (2) the distance is induced by the dimensionality-normalized norm instead of the Euclidean norm. We provide a few theoretical results regarding our method. In addition, we propose a simple algorithm based on adapted k-means clustering that can find the disjoint subsets of features used in our method, and extend the algorithm to perform feature selection. We evaluate and compare the performance of our method to other classification methods on both simulated data and real-world gene expression datasets. The results demonstrate that our method is able to outperform other competing classifiers by having smaller misclassification rates and/or using fewer features in various settings and situations.


title: ALMA Imaging of a Galactic Molecular Outflow in NGC4945

abstract: We present the ALMA detection of molecular outflowing gas in the central regions of NGC4945, one of the nearest starbursts and also one of the nearest hosts of an active galactic nucleus (AGN). We detect four outflow plumes in CO (3-2) at ~0.3" resolution that appear to correspond to molecular gas located near the edges of the known ionized outflow cone and its (unobserved) counterpart behind the disk. The fastest and brightest of these plumes has emission reaching observed line-of-sight projected velocities of over 450 km/s beyond systemic, equivalent to an estimated physical outflow velocity v>600 km/s for the fastest emission. Most of these plumes have corresponding emission in HCN or HCO+ (4-3). We discuss a kinematic model for the outflow emission where the molecular gas has the geometry of the ionized gas cone and shares the rotation velocity of the galaxy when ejected. We use this model to explain the velocities we observe, constrain the physical speed of the ejected material, and account for the fraction of outflowing gas that is not detected due to confusion with the galaxy disk. We estimate a total molecular mass outflow rate dMmol/dt~20 Msun/yr flowing through a surface within 100 pc of the disk midplane, likely driven by a combination of the central starburst and AGN.


title: Active ploughing through a compressible viscoelastic fluid: Unjamming and emergent nonreciprocity

abstract: A dilute suspension of active Brownian particles in a dense compressible viscoelastic fluid, forms a natural setting to study the emergence of nonreciprocity during a dynamical phase transition. At these densities, the transport of active particles is strongly influenced by the passive medium and shows a dynamical jamming transition as a function of activity and medium density. In the process, the compressible medium is actively churned up -for low activity, the active particle gets self-trapped in a spherical cavity of its own making, while for large activity, the active particle ploughs through the medium, either accompanied by a moving anisotropic wake, or leaving a porous trail. A hydrodynamic approach makes it evident that the active particle generates a long range density wake which breaks fore-aft symmetry, consistent with the simulations. Accounting for the back reaction of the compressible medium leads to (i) dynamical jamming of the active particle, and (ii) a dynamical non-reciprocal attraction between two active particles moving along the same direction, with the trailing particle catching up with the leading one in finite time. We emphasize that these nonreciprocal effects appear only when the active particles are moving and so manifest in the vicinity of the jamming-unjamming transition.


title: Multiple almost summing operators

abstract: In this paper, we explore the concept of multilinear operators that are multiple almost summing and present a new concept of type and cotype of multilinear operators and investigate the conditions for this new concept to recover the original concept of type and type for multilinear operators. We also show that these classes are Banach multi-ideals and establish the coherence and compatibility of these classes with the generated homogeneous polynomials.


title: On the ideals of ultragraph Leavitt path algebras

abstract: In this article, we provide an explicit description of a set of generators for any ideal of an ultragraph Leavitt path algebra. We provide several additional consequences of this description, including information about generating sets for graded ideals, the graded uniqueness and Cuntz-Krieger theorems, the semiprimeness, and the semiprimitivity of ultragraph Leavitt path algebras, a complete characterization of the prime and primitive ideals of an ultragraph Leavitt path algebra. We also show that every primitive ideal of an ultragraph Leavitt path algebra is exactly the annihilator of a Chen simple module. Consequently, we prove Exel's Effros-Hahn conjecture on primitive ideals in the ultragraph Leavitt path algebra setting (a conclusion that is also new in the context of Leavitt path algebras of graphs).


title: Evaluating Debiasing Techniques for Intersectional Biases

abstract: Bias is pervasive in NLP models, motivating the development of automatic debiasing techniques. Evaluation of NLP debiasing methods has largely been limited to binary attributes in isolation, e.g., debiasing with respect to binary gender or race, however many corpora involve multiple such attributes, possibly with higher cardinality. In this paper we argue that a truly fair model must consider `gerrymandering' groups which comprise not only single attributes, but also intersectional groups. We evaluate a form of bias-constrained model which is new to NLP, as well an extension of the iterative nullspace projection technique which can handle multiple protected attributes.


title: Selecting Datasets for Evaluating an Enhanced Deep Learning Framework

abstract: A framework was developed to address limitations associated with existing techniques for analysing sequences. This work deals with the steps followed to select suitable datasets characterised by discrete irregular sequential patterns. To identify, select, explore and evaluate which datasets from various sources extracted from more than 400 research articles, an interquartile range method for outlier calculation and a qualitative Billauer's algorithm was adapted to provide periodical peak detection in such datasets. The developed framework was then tested using the most appropriate datasets. The research concluded that the financial market-daily currency exchange domain is the most suitable kind of data set for the evaluation of the designed deep learning framework, as it provides high levels of discrete irregular patterns.


title: Geometric Fabrics: Generalizing Classical Mechanics to Capture the Physics of Behavior

abstract: Classical mechanical systems are central to controller design in energy shaping methods of geometric control. However, their expressivity is limited by position-only metrics and the intimate link between metric and geometry. Recent work on Riemannian Motion Policies (RMPs) has shown that shedding these restrictions results in powerful design tools, but at the expense of theoretical stability guarantees. In this work, we generalize classical mechanics to what we call geometric fabrics, whose expressivity and theory enable the design of systems that outperform RMPs in practice. Geometric fabrics strictly generalize classical mechanics forming a new physics of behavior by first generalizing them to Finsler geometries and then explicitly bending them to shape their behavior while maintaining stability. We develop the theory of fabrics and present both a collection of controlled experiments examining their theoretical properties and a set of robot system experiments showing improved performance over a well-engineered and hardened implementation of RMPs, our current state-of-the-art in controller design.


title: Fairness-aware Class Imbalanced Learning

abstract: Class imbalance is a common challenge in many NLP tasks, and has clear connections to bias, in that bias in training data often leads to higher accuracy for majority groups at the expense of minority groups. However there has traditionally been a disconnect between research on class-imbalanced learning and mitigating bias, and only recently have the two been looked at through a common lens. In this work we evaluate long-tail learning methods for tweet sentiment and occupation classification, and extend a margin-loss based approach with methods to enforce fairness. We empirically show through controlled experiments that the proposed approaches help mitigate both class imbalance and demographic biases.


title: Robust Visual Teach and Repeat for UGVs Using 3D Semantic Maps

abstract: We propose a Visual Teach and Repeat (VTR) algorithm using semantic landmarks extracted from environmental objects for ground robots with fixed mount monocular cameras. The proposed algorithm is robust to changes in the starting pose of the camera/robot, where a pose is defined as the planar position plus the orientation around the vertical axis. VTR consists of a teach phase in which a robot moves in a prescribed path, and a repeat phase in which the robot tries to repeat the same path starting from the same or a different pose. Most available VTR algorithms are pose dependent and cannot perform well in the repeat phase when starting from an initial pose far from that of the teach phase. To achieve more robust pose independency, the key is to generate a 3D semantic map of the environment containing the camera trajectory and the positions of surrounding objects during the teach phase. For specific implementation, we use ORB-SLAM to collect the camera poses and the 3D point clouds of the environment, and YOLOv3 to detect objects in the environment. We then combine the two outputs to build the semantic map. In the repeat phase, we relocalize the robot based on the detected objects and the stored semantic map. The robot is then able to move toward the teach path, and repeat it in both forward and backward directions. We have tested the proposed algorithm in different scenarios and compared it with two most relevant recent studies. Also, we compared our algorithm with two image-based relocalization methods. One is purely based on ORB-SLAM and the other combines Superglue and RANSAC. The results show that our algorithm is much more robust with respect to pose variations as well as environmental alterations. Our code and data are available at the following Github page: https://github.com/mmahdavian/semantic_visual_teach_repeat.


title: Thermodynamics of an Ising-like XXZ chain in a longitudinal magnetic field in the framework of the Quantum Transfer Matrix approach

abstract: Taking the Ising chain as a reference model we have derived a perturbative expression for the free energy density of the Heisenberg-Ising chain with strong easy-axis anisotropy. All calculations are performed on the ground of the Quantum Transfer Matrix approach. The obtained result agrees with the direct high-temperature expansion. It also agrees with the low-temperature cluster expansion in the special subregime when quantum fluctuations are weak against thermodynamical ones.


title: Adding Negation to Lambda Mu

abstract: We present $\cal L$, an extension of Parigot's $\lambda\mu$-calculus by adding negation as a type constructor, together with syntactic constructs that represent negation introduction and elimination. We will define a notion of reduction that extends $\lambda\mu$'s reduction system with two new reduction rules, and show that the system satisfies subject reduction. Using Aczel's generalisation of Tait and Martin-L\"of's notion of parallel reduction, we show that this extended reduction is confluent. Although the notion of type assignment has its limitations with respect to representation of proofs in natural deduction with implication and negation, we will show that all propositions that can be shown in there have a witness in $\cal L$. Using Girard's approach of reducibility candidates, we show that all typeable terms are strongly normalisable, and conclude the paper by showing that type assignment for $\cal L$ enjoys the principal typing property.


title: Testing parton distribution functions with t-channel single-top-quark production

abstract: The production of single top-quarks in the t-channel at hadron colliders imposes strong analytic constraints on parton distribution functions (PDFs) through its double deeply inelastic scattering (DDIS) form. We exploit this to provide novel consistency checks between LO, NLO and NNLO PDF fits and propose to include it as a constraint in future PDF fits. Furthermore, while it is well-known that the b-quark PDF is highly sensitive to the b-quark mass, we show that the treatment of this systematic uncertainty is still incomplete, fragmented or outright missing at the moment. Consequently, we conclude that the b-quark mass uncertainty is the dominant but so far broadly neglected theory uncertainty for this process.


title: The supremum principle selects simple, transferable models

abstract: We consider how mathematical models enable predictions for conditions that are qualitatively different from the training data. We propose techniques based on information topology to find models that can apply their learning in regimes for which there is no data. The first step is to use the Manifold Boundary Approximation Method to construct simple, reduced models of target phenomena in a data-driven way. We consider the set of all such reduced models and use the topological relationships among them to reason about model selection for new, unobserved phenomena. Given minimal models for several target behaviors, we introduce the supremum principle as a criterion for selecting a new, transferable model. The supremal model, i.e., the least upper bound, is the simplest model that reduces to each of the target behaviors. We illustrate how to discover supremal models with several examples; in each case, the supremal model unifies causal mechanisms to transfer successfully to new target domains. We use these examples to motivate a general algorithm that has formal connections to theories of analogical reasoning in cognitive psychology.

categories: q-bio.QM cond-mat.stat-mech physics.bio-ph physics.data-an


title: Towards cyber-physical systems robust to communication delays: A differential game approach

abstract: Collaboration between interconnected cyber-physical systems is becoming increasingly pervasive. Time-delays in communication channels between such systems are known to induce catastrophic failure modes, like high frequency oscillations in robotic manipulators in bilateral teleoperation or string instability in platoons of autonomous vehicles. This paper considers nonlinear time-delay systems representing coupled robotic agents, and proposes controllers that are robust to time-varying communication delays. We introduce approximations that allow the delays to be considered as implicit control inputs themselves, and formulate the problem as a zero-sum differential game between the stabilizing controllers and the delays acting adversarially. The ensuing optimal control law is finally compared to known results from Lyapunov-Krasovskii based approaches via numerical experiments.


title: More powerful selective inference for the graph fused lasso

abstract: The graph fused lasso -- which includes as a special case the one-dimensional fused lasso -- is widely used to reconstruct signals that are piecewise constant on a graph, meaning that nodes connected by an edge tend to have identical values. We consider testing for a difference in the means of two connected components estimated using the graph fused lasso. A naive procedure such as a z-test for a difference in means will not control the selective Type I error, since the hypothesis that we are testing is itself a function of the data. In this work, we propose a new test for this task that controls the selective Type I error, and conditions on less information than existing approaches, leading to substantially higher power. We illustrate our approach in simulation and on datasets of drug overdose death rates and teenage birth rates in the contiguous United States. Our approach yields more discoveries on both datasets.


title: Personalized Online Machine Learning

abstract: In this work, we introduce the Personalized Online Super Learner (POSL) -- an online ensembling algorithm for streaming data whose optimization procedure accommodates varying degrees of personalization. Namely, POSL optimizes predictions with respect to baseline covariates, so personalization can vary from completely individualized (i.e., optimization with respect to baseline covariate subject ID) to many individuals (i.e., optimization with respect to common baseline covariates). As an online algorithm, POSL learns in real-time. POSL can leverage a diversity of candidate algorithms, including online algorithms with different training and update times, fixed algorithms that are never updated during the procedure, pooled algorithms that learn from many individuals' time-series, and individualized algorithms that learn from within a single time-series. POSL's ensembling of this hybrid of base learning strategies depends on the amount of data collected, the stationarity of the time-series, and the mutual characteristics of a group of time-series. In essence, POSL decides whether to learn across samples, through time, or both, based on the underlying (unknown) structure in the data. For a wide range of simulations that reflect realistic forecasting scenarios, and in a medical data application, we examine the performance of POSL relative to other current ensembling and online learning methods. We show that POSL is able to provide reliable predictions for time-series data and adjust to changing data-generating environments. We further cultivate POSL's practicality by extending it to settings where time-series enter/exit dynamically over chronological time.


title: Extracting Fine-Grained Knowledge Graphs of Scientific Claims: Dataset and Transformer-Based Results

abstract: Recent transformer-based approaches demonstrate promising results on relational scientific information extraction. Existing datasets focus on high-level description of how research is carried out. Instead we focus on the subtleties of how experimental associations are presented by building SciClaim, a dataset of scientific claims drawn from Social and Behavior Science (SBS), PubMed, and CORD-19 papers. Our novel graph annotation schema incorporates not only coarse-grained entity spans as nodes and relations as edges between them, but also fine-grained attributes that modify entities and their relations, for a total of 12,738 labels in the corpus. By including more label types and more than twice the label density of previous datasets, SciClaim captures causal, comparative, predictive, statistical, and proportional associations over experimental variables along with their qualifications, subtypes, and evidence. We extend work in transformer-based joint entity and relation extraction to effectively infer our schema, showing the promise of fine-grained knowledge graphs in scientific claims and beyond.


title: Modewise Operators, the Tensor Restricted Isometry Property, and Low-Rank Tensor Recovery

abstract: Recovery of sparse vectors and low-rank matrices from a small number of linear measurements is well-known to be possible under various model assumptions on the measurements. The key requirement on the measurement matrices is typically the restricted isometry property, that is, approximate orthonormality when acting on the subspace to be recovered. Among the most widely used random matrix measurement models are (a) independent sub-gaussian models and (b) randomized Fourier-based models, allowing for the efficient computation of the measurements. For the now ubiquitous tensor data, direct application of the known recovery algorithms to the vectorized or matricized tensor is awkward and memory-heavy because of the huge measurement matrices to be constructed and stored. In this paper, we propose modewise measurement schemes based on sub-gaussian and randomized Fourier measurements. These modewise operators act on the pairs or other small subsets of the tensor modes separately. They require significantly less memory than the measurements working on the vectorized tensor, provably satisfy the tensor restricted isometry property and experimentally can recover the tensor data from fewer measurements and do not require impractical storage.


title: An Audio Synthesis Framework Derived from Industrial Process Control

abstract: Since its conception, digital synthesis has significantly influenced the advancement of music, leading to new genres and production styles. Through existing synthesis techniques, one can recreate naturally occurring sounds as well as generate innovative artificial timbres. However, research in audio technology continues to pursue new methods of synthesizing sounds, keeping the transformation of music constant. This research attempts to formulate the framework of a new synthesis technique by redefining the popular Proportional-Integral-Derivative (PID) algorithm used in feedback-based process control. The framework is then implemented as a Python application to study the available control parameters and their effect on the synthesized output. Further, applications of this technique as an audio signal and LFO generator, including its potentiality as an alternative to FM and Wavetable synthesis techniques, are studied in detail. The research concludes by highlighting some of the imperfections in the current framework and the possible research directions to be considered to address them.


title: Rotationally symmetric translating solutions to extrinsic geometric flows

abstract: Analogous to the bowl soliton of mean curvature flow, we construct rotationally symmetric translating solutions to a very large class of extrinsic curvature flows, namely those whose speeds are $\alpha$-homogeneous ($\alpha>0$), elliptic and symmetric with respect to the principal curvatures. We show that these solutions are necessarily convex, and give precise criteria for the speed functions which determine whether these translators are defined on all of $\mathbb{R}^{n}$ or contained in a cylinder. For speeds that are nonzero when at least one of the principal curvatures is nonzero, we are also able to describe the asymptotics of the translator at infinity.


title: Infrastructure Node-based Vehicle Localization for Autonomous Driving

abstract: Vehicle localization is essential for autonomous vehicle (AV) navigation and Advanced Driver Assistance Systems (ADAS). Accurate vehicle localization is often achieved via expensive inertial navigation systems or by employing compute-intensive vision processing (LiDAR/camera) to augment the low-cost and noisy inertial sensors. Here we have developed a framework for fusing the information obtained from a smart infrastructure node (ix-node) with the autonomous vehicles on-board localization engine to estimate the robust and accurate pose of the ego-vehicle even with cheap inertial sensors. A smart ix-node is typically used to augment the perception capability of an autonomous vehicle, especially when the onboard perception sensors of AVs are blocked by the dynamic and static objects in the environment thereby making them ineffectual. In this work, we utilize this perception output from an ix-node to increase the localization accuracy of the AV. The fusion of ix-node perception output with the vehicle's low-cost inertial sensors allows us to perform reliable vehicle localization without the need for relying on expensive inertial navigation systems or compute-intensive vision processing onboard the AVs. The proposed approach has been tested on real-world datasets collected from a test track in Ann Arbor, Michigan. Detailed analysis of the experimental results shows that incorporating ix-node data improves localization performance.


title: Achieving Counterfactual Fairness for Causal Bandit

abstract: In online recommendation, customers arrive in a sequential and stochastic manner from an underlying distribution and the online decision model recommends a chosen item for each arriving individual based on some strategy. We study how to recommend an item at each step to maximize the expected reward while achieving user-side fairness for customers, i.e., customers who share similar profiles will receive a similar reward regardless of their sensitive attributes and items being recommended. By incorporating causal inference into bandits and adopting soft intervention to model the arm selection strategy, we first propose the d-separation based UCB algorithm (D-UCB) to explore the utilization of the d-separation set in reducing the amount of exploration needed to achieve low cumulative regret. Based on that, we then propose the fair causal bandit (F-UCB) for achieving the counterfactual individual fairness. Both theoretical analysis and empirical evaluation demonstrate effectiveness of our algorithms.


title: Optimal excitation and measurement pattern for cascade networks

abstract: This work deals with accuracy analysis of dynamical systems interconnected in a cascade structure. For a cascade network there are a number of experimental settings for which the dynamic systems within the network can be identified. We study the problem of choosing which excitation and measurement pattern delivers the most accurate parameter estimates for the whole network. The optimal experiment is based on the accuracy assessed through the asymptotic covariance matrix of the prediction error method, while the cost criterion is the number of excitations and measurements. We develop theoretical results under the assumptions that all dynamic systems are equal and with equal signal-to-noise ratio throughout the network. We show that there are experimental settings which result in equal overall precision and that there is an excitation and measurement pattern that yields more accurate results than others. From these results a guideline based on the topology of the network emerges for the choice of the experimental setting. We provide numerical results which attest that the principles behind this guideline are also valid for more general situations.


title: Graph-based Cluttered Scene Generation and Interactive Exploration using Deep Reinforcement Learning

abstract: We introduce a novel method to teach a robotic agent to interactively explore cluttered yet structured scenes, such as kitchen pantries and grocery shelves, by leveraging the physical plausibility of the scene. We propose a novel learning framework to train an effective scene exploration policy to discover hidden objects with minimal interactions. First, we define a novel scene grammar to represent structured clutter. Then we train a Graph Neural Network (GNN) based Scene Generation agent using deep reinforcement learning (deep RL), to manipulate this Scene Grammar to create a diverse set of stable scenes, each containing multiple hidden objects. Given such cluttered scenes, we then train a Scene Exploration agent, using deep RL, to uncover hidden objects by interactively rearranging the scene. We show that our learned agents hide and discover significantly more objects than the baselines. We present quantitative results that prove the generalization capabilities of our agents. We also demonstrate sim-to-real transfer by successfully deploying the learned policy on a real UR10 robot to explore real-world cluttered scenes. The supplemental video can be found at https://www.youtube.com/watch?v=T2Jo7wwaXss.


title: Minimax Rates for Conditional Density Estimation via Empirical Entropy

abstract: We consider the task of estimating a conditional density using i.i.d. samples from a joint distribution, which is a fundamental problem with applications in both classification and uncertainty quantification for regression. For joint density estimation, minimax rates have been characterized for general density classes in terms of uniform (metric) entropy, a well-studied notion of statistical capacity. When applying these results to conditional density estimation, the use of uniform entropy -- which is infinite when the covariate space is unbounded and suffers from the curse of dimensionality -- can lead to suboptimal rates. Consequently, minimax rates for conditional density estimation cannot be characterized using these classical results. We resolve this problem for well-specified models, obtaining matching (within logarithmic factors) upper and lower bounds on the minimax Kullback--Leibler risk in terms of the empirical Hellinger entropy for the conditional density class. The use of empirical entropy allows us to appeal to concentration arguments based on local Rademacher complexity, which -- in contrast to uniform entropy -- leads to matching rates for large, potentially nonparametric classes and captures the correct dependence on the complexity of the covariate space. Our results require only that the conditional densities are bounded above, and do not require that they are bounded below or otherwise satisfy any tail conditions.


title: A Hierarchical Network-Oriented Analysis of User Participation in Misinformation Spread on WhatsApp

abstract: WhatsApp emerged as a major communication platform in many countries in the recent years. Despite offering only one-to-one and small group conversations, WhatsApp has been shown to enable the formation of a rich underlying network, crossing the boundaries of existing groups, and with structural properties that favor information dissemination at large. Indeed, WhatsApp has reportedly been used as a forum of misinformation campaigns with significant social, political and economic consequences in several countries. In this article, we aim at complementing recent studies on misinformation spread on WhatsApp, mostly focused on content properties and propagation dynamics, by looking into the network that connects users sharing the same piece of content. Specifically, we present a hierarchical network-oriented characterization of the users engaged in misinformation spread by focusing on three perspectives: individuals, WhatsApp groups and user communities, i.e., groupings of users who, intentionally or not, share the same content disproportionately often. By analyzing sharing and network topological properties, our study offers valuable insights into how WhatsApp users leverage the underlying network connecting different groups to gain large reach in the spread of misinformation on the platform.


title: Admissible Poisson bialgebras

abstract: An admissible Poisson algebra (or briefly, an adm-Poisson algebra) gives an equivalent presentation with only one operation for a Poisson algebra. We establish a bialgebra theory for adm-Poisson algebras independently and systematically, including but beyond the corresponding results on Poisson bialgebras given in [27]. Explicitly, we introduce the notion of adm-Poisson bialgebras which are equivalent to Manin triples of adm-Poisson algebras as well as Poisson bialgebras. The direct correspondence between adm-Poisson bialgebras with one comultiplication and Poisson bialgebras with one cocommutative and one anti-cocommutative comultiplications generalizes and illustrates the polarization-depolarization process in the context of bialgebras. The study of a special class of adm-Poisson bialgebras which include the known coboundary Poisson bialgebras in [27] as a proper subclass in general, illustrating an advantage in terms of the presentation with one operation, leads to the introduction of adm-Poisson Yang-Baxter equation in an adm-Poisson algebra. It is an unexpected consequence that both the adm-Poisson Yang-Baxter equation and the associative Yang-Baxter equation have the same form and thus it motivates and simplifies the involved study from the study of the associative Yang-Baxter equation, which is another advantage in terms of the presentation with one operation. A skew-symmetric solution of adm-Poisson Yang-Baxter equation gives an adm-Poisson bialgebra. Finally the notions of an $\mathcal O$-operator of an adm-Poisson algebra and a pre-adm-Poisson algebra are introduced to construct skew-symmetric solutions of adm-Poisson Yang-Baxter equation and hence adm-Poisson bialgebras. Note that a pre-adm-Poisson algebra gives an equivalent presentation for a pre-Poisson algebra introduced by Aguiar.


title: Stolarsky-Puebla index

abstract: We introduce a degree-based variable topological index inspired on the Stolarsky mean (known as the generalization of the logarithmic mean). We name this new index as the Stolarsky-Puebla index: $SP_\alpha(G) = \sum_{uv \in E(G)} d_u$, if $d_u=d_v$, and $SP_\alpha(G) = \sum_{uv \in E(G)} \left[\left( d_u^\alpha-d_v^\alpha\right)/\left( \alpha(d_u-d_v\right)\right]^{1/(\alpha-1)}$, otherwise. Here, $uv$ denotes the edge of the network $G$ connecting the vertices $u$ and $v$, $d_u$ is the degree of the vertex $u$, and $\alpha \in \mathbb{R} \backslash \{0,1\}$. Indeed, for given values of $\alpha$, the Stolarsky-Puebla index reproduces well-known topological indices such as the reciprocal Randic index, the first Zagreb index, and several mean Sombor indices. Moreover, we apply these indices to random networks and demonstrate that $\left< SP_\alpha(G) \right>$, normalized to the order of the network, scale with the corresponding average degree $\left< d \right>$.


title: Scalable and Efficient MoE Training for Multitask Multilingual Models

abstract: The Mixture of Experts (MoE) models are an emerging class of sparsely activated deep learning models that have sublinear compute costs with respect to their parameters. In contrast with dense models, the sparse architecture of MoE offers opportunities for drastically growing model size with significant accuracy gain while consuming much lower compute budget. However, supporting large scale MoE training also has its own set of system and modeling challenges. To overcome the challenges and embrace the opportunities of MoE, we first develop a system capable of scaling MoE models efficiently to trillions of parameters. It combines multi-dimensional parallelism and heterogeneous memory technologies harmoniously with MoE to empower 8x larger models on the same hardware compared with existing work. Besides boosting system efficiency, we also present new training methods to improve MoE sample efficiency and leverage expert pruning strategy to improve inference time efficiency. By combining the efficient system and training methods, we are able to significantly scale up large multitask multilingual models for language generation which results in a great improvement in model accuracy. A model trained with 10 billion parameters on 50 languages can achieve state-of-the-art performance in Machine Translation (MT) and multilingual natural language generation tasks. The system support of efficient MoE training has been implemented and open-sourced with the DeepSpeed library.


title: Efficient Partial Rewind of Polar Codes' Successive Cancellation-based Decoders for Re-decoding Attempts

abstract: Successive cancellation (SC) process is an essential component of various decoding algorithms used for polar codes and their variants. Rewinding this process seems trivial if we have access to all intermediate log-likelihood ratios (LLRs) and partial sums. However, as the block length increases, retaining all of the intermediate information becomes inefficient and impractical. Rewinding the SC process in a memory-efficient way is a problem that we address in this paper. We first explore the properties of the SC process based on the binary representation of the bit indices by introducing a new operator used for grouping the bit indices. This special grouping helps us in finding the closest bit index to the target index for rewinding. We also analytically prove that this approach gives access to the untouched intermediate information stored in the memory which is essential in resuming the SC process. Then, we adapt the proposed approach to multiple rewinds and apply it on SC-flip decoding and shifted-pruning based list decoding. The numerical evaluation of the proposed solution shows a significant reduction of >=50% in the complexity of the additional decoding attempts at medium and high SNR regimes for SC-flip decoding and less for shifted-pruning based list decoding.


title: Erasing the which-path information of photons

abstract: Which-path information of a quantum particle in interferometers is the key to infer the past of quantum particle. It arises many extensive discussions including quantum complementarity and path-visibility relation. The basic of these discussions are the description, detection and control of which-path information. In this article, we focus on the investigation of multidimensional which-path information in nested Mach-Zehnder interferometer. A general expression of which-path information is given and can be partially extracted by different detection method. Further analysis shows that the which-path information can be controlled by the phase differences and beam splitting ratios between the arms of nested Mach-Zehnder interferometer. Moreover, a new which-path information elimination phenomenon has been predicted and demonstrated experimentally. Our work can help to understand the physics of quantum particles, potentially apply to quantum information process and quantum metrology.


title: Band-selective Holstein polaron in Luttinger liquid material A0.3MoO3 (A = K, Rb)

abstract: (Quasi-)one-dimensional systems exhibit various fascinating properties such as Luttinger liquid behavior, Peierls transition, novel topological phases, and the accommodation of unique quasiparticles (e.g., spinon, holon, and soliton, etc.). Here we study molybdenum blue bronze A0.3MoO3 (A = K, Rb), a canonical quasi-one-dimensional charge-density-wave material, using laser-based angle-resolved photoemission spectroscopy. Our experiment suggests that the normal phase of A0.3MoO3 is a prototypical Luttinger liquid, from which the charge-density-wave emerges with decreasing temperature. Prominently, we observe strong renormalizations of band dispersions, which is recognized as the spectral function of Holstein polaron derived from band-selective electron-phonon coupling in the system. We argue that the strong electron-phonon coupling plays a dominant role in electronic properties and the charge-density-wave transition in blue bronzes. Our results not only reconcile the long-standing heavy debates on the electronic properties of blue bronzes but also provide a rare platform to study novel composite quasiparticles in Luttinger liquid materials.


title: Differentiable Scaffolding Tree for Molecular Optimization

abstract: The structural design of functional molecules, also called molecular optimization, is an essential chemical science and engineering task with important applications, such as drug discovery. Deep generative models and combinatorial optimization methods achieve initial success but still struggle with directly modeling discrete chemical structures and often heavily rely on brute-force enumeration. The challenge comes from the discrete and non-differentiable nature of molecule structures. To address this, we propose differentiable scaffolding tree (DST) that utilizes a learned knowledge network to convert discrete chemical structures to locally differentiable ones. DST enables a gradient-based optimization on a chemical graph structure by back-propagating the derivatives from the target properties through a graph neural network (GNN). Our empirical studies show the gradient-based molecular optimizations are both effective and sample efficient. Furthermore, the learned graph parameters can also provide an explanation that helps domain experts understand the model output.


title: The density distribution and physical origins of intermittency in supersonic, highly magnetised turbulence with diverse modes of driving

abstract: The probability density function (PDF) of the logarithmic density contrast, $s=\ln (\rho/\rho_0)$, with gas density $\rho$ and mean density $\rho_0$, for hydrodynamical supersonic turbulence is well-known to have significant non-Gaussian (intermittent) features that monotonically increase with the turbulent Mach number, $\mathcal{M}$. By studying the mass- and volume-weighted $s$-PDF for an ensemble of 36 sub-to-trans-Alf\'venic mean-field, supersonic, isothermal turbulence simulations with different modes of driving, relevant to molecular gas in the cool interstellar medium, we show that a more intricate picture emerges for the non-Gaussian nature of $s$. Using four independent measures of the non-Gaussian components, we find hydrodynamical-like structure in the highly magnetised plasma for $\mathcal{M} \lesssim 4$. However, for $\mathcal{M} \gtrsim 4$, the non-Gaussian signatures disappear, leaving approximately Gaussian $s$-statistics -- exactly the opposite of hydrodynamical turbulence in the high-$\mathcal{M}$ limit. We also find that the non-Gaussian components of the PDF increase monotonically with more compressive driving modes. To understand the $\mathcal{M} \lesssim 4$ non-Gaussian features we use one-dimensional (1D) pencil beams to explore the dynamics along and across the large-scale magnetic field, $\mathbf{B}_0$. We discuss kinetic, density and magnetic field fluctuations from the pencil beams, and identify physical sources of non-Gaussian components to the PDF as single, strong shocks coupled to fast magnetosonic compressions that form along $\mathbf{B}_0$. We discuss the Gaussianisation of the $\mathcal{M} \gtrsim 4$ $s$-fields through the lens of two phenomenologies: the self-similarity of the $s$-field and homogenisation of the dynamical timescales between the over- and under-dense regions in the compressible gas.


title: The First Vision For Vitals (V4V) Challenge for Non-Contact Video-Based Physiological Estimation

abstract: Telehealth has the potential to offset the high demand for help during public health emergencies, such as the COVID-19 pandemic. Remote Photoplethysmography (rPPG) - the problem of non-invasively estimating blood volume variations in the microvascular tissue from video - would be well suited for these situations. Over the past few years a number of research groups have made rapid advances in remote PPG methods for estimating heart rate from digital video and obtained impressive results. How these various methods compare in naturalistic conditions, where spontaneous behavior, facial expressions, and illumination changes are present, is relatively unknown. To enable comparisons among alternative methods, the 1st Vision for Vitals Challenge (V4V) presented a novel dataset containing high-resolution videos time-locked with varied physiological signals from a diverse population. In this paper, we outline the evaluation protocol, the data used, and the results. V4V is to be held in conjunction with the 2021 International Conference on Computer Vision.


title: Rotor Localization and Phase Mapping of Cardiac Excitation Waves using Deep Neural Networks

abstract: The analysis of electrical impulse phenomena in cardiac muscle tissue is important for the diagnosis of heart rhythm disorders and other cardiac pathophysiology. Cardiac mapping techniques acquire local temporal measurements and combine them to visualize the spread of electrophysiological wave phenomena across the heart surface. However, low spatial resolution, sparse measurement locations, noise and other artifacts make it challenging to accurately visualize spatio-temporal activity. For instance, electro-anatomical catheter mapping is severely limited by the sparsity of the measurements, and optical mapping is prone to noise and motion artifacts. In the past, several approaches have been proposed to obtain more reliable maps from noisy or sparse mapping data. Here, we demonstrate that deep learning can be used to compute phase maps and detect phase singularities in optical mapping videos of ventricular fibrillation, as well as in very noisy, low-resolution and extremely sparse simulated data of reentrant wave chaos mimicking catheter mapping data. The deep learning approach learns to directly associate phase maps and the positions of phase singularities with short spatio-temporal sequences of electrical data. We tested several neural network architectures, based on a convolutional neural network with an encoding and decoding structure, to predict phase maps or rotor core positions either directly or indirectly via the prediction of phase maps and a subsequent classical calculation of phase singularities. Predictions can be performed across different data, with models being trained on one species and then successfully applied to another, or being trained solely on simulated data and then applied to experimental data. Future uses may include the analysis of optical mapping studies in basic cardiovascular research, as well as the mapping of atrial fibrillation in the clinical setting.

categories: physics.med-ph cs.CV eess.IV physics.bio-ph


title: MVM3Det: A Novel Method for Multi-view Monocular 3D Detection

abstract: Monocular 3D object detection encounters occlusion problems in many application scenarios, such as traffic monitoring, pedestrian monitoring, etc., which leads to serious false negative. Multi-view object detection effectively solves this problem by combining data from different perspectives. However, due to label confusion and feature confusion, the orientation estimation of multi-view 3D object detection is intractable, which is important for object tracking and intention prediction. In this paper, we propose a novel multi-view 3D object detection method named MVM3Det which simultaneously estimates the 3D position and orientation of the object according to the multi-view monocular information. The method consists of two parts: 1) Position proposal network, which integrates the features from different perspectives into consistent global features through feature orthogonal transformation to estimate the position. 2) Multi-branch orientation estimation network, which introduces feature perspective pooling to overcome the two confusion problems during the orientation estimation. In addition, we present a first dataset for multi-view 3D object detection named MVM3D. Comparing with State-Of-The-Art (SOTA) methods on our dataset and public dataset WildTrack, our method achieves very competitive results.


title: Rapid detection and recognition of whole brain activity in a freely behaving Caenorhabditis elegans

abstract: Advanced volumetric imaging methods and genetically encoded activity indicators have permitted a comprehensive characterization of whole brain activity at single neuron resolution in \textit{Caenorhabditis elegans}. The constant motion and deformation of the nematode nervous system, however, impose a great challenge for consistent identification of densely packed neurons in a behaving animal. Here, we propose a cascade solution for long-term and rapid recognition of head ganglion neurons in a freely moving \textit{C. elegans}. First, potential neuronal regions from a stack of fluorescence images are detected by a deep learning algorithm. Second, 2-dimensional neuronal regions are fused into 3-dimensional neuron entities. Third, by exploiting the neuronal density distribution surrounding a neuron and relative positional information between neurons, a multi-class artificial neural network transforms engineered neuronal feature vectors into digital neuronal identities. With a small number of training samples, our bottom-up approach is able to process each volume - $1024 \times 1024 \times 18$ in voxels - in less than 1 second and achieves an accuracy of $91\%$ in neuronal detection and above $80\%$ in neuronal tracking over a long video recording. Our work represents a step towards rapid and fully automated algorithms for decoding whole brain activity underlying naturalistic behaviors.


title: Salience-Aware Event Chain Modeling for Narrative Understanding

abstract: Storytelling, whether via fables, news reports, documentaries, or memoirs, can be thought of as the communication of interesting and related events that, taken together, form a concrete process. It is desirable to extract the event chains that represent such processes. However, this extraction remains a challenging problem. We posit that this is due to the nature of the texts from which chains are discovered. Natural language text interleaves a narrative of concrete, salient events with background information, contextualization, opinion, and other elements that are important for a variety of necessary discourse and pragmatics acts but are not part of the principal chain of events being communicated. We introduce methods for extracting this principal chain from natural language text, by filtering away non-salient events and supportive sentences. We demonstrate the effectiveness of our methods at isolating critical event chains by comparing their effect on downstream tasks. We show that by pre-training large language models on our extracted chains, we obtain improvements in two tasks that benefit from a clear understanding of event chains: narrative prediction and event-based temporal question answering. The demonstrated improvements and ablative studies confirm that our extraction method isolates critical event chains.


title: Self-Supervised Learning to Prove Equivalence Between Straight-Line Programs via Rewrite Rules

abstract: We target the problem of automatically synthesizing proofs of semantic equivalence between two programs made of sequences of statements. We represent programs using abstract syntax trees (AST), where a given set of semantics-preserving rewrite rules can be applied on a specific AST pattern to generate a transformed and semantically equivalent program. In our system, two programs are equivalent if there exists a sequence of application of these rewrite rules that leads to rewriting one program into the other. We propose a neural network architecture based on a transformer model to generate proofs of equivalence between program pairs. The system outputs a sequence of rewrites, and the validity of the sequence is simply checked by verifying it can be applied. If no valid sequence is produced by the neural network, the system reports the programs as non-equivalent, ensuring by design no programs may be incorrectly reported as equivalent. Our system is fully implemented for one single grammar which can represent straight-line programs with function calls and multiple types. To efficiently train the system to generate such sequences, we develop an original incremental training technique, named self-supervised sample selection. We extensively study the effectiveness of this novel training approach on proofs of increasing complexity and length. Our system, S4Eq, achieves 97% proof success on a curated dataset of 10,000 pairs of equivalent programs.


title: Generating Compositional Color Representations from Text

abstract: We consider the cross-modal task of producing color representations for text phrases. Motivated by the fact that a significant fraction of user queries on an image search engine follow an (attribute, object) structure, we propose a generative adversarial network that generates color profiles for such bigrams. We design our pipeline to learn composition - the ability to combine seen attributes and objects to unseen pairs. We propose a novel dataset curation pipeline from existing public sources. We describe how a set of phrases of interest can be compiled using a graph propagation technique, and then mapped to images. While this dataset is specialized for our investigations on color, the method can be extended to other visual dimensions where composition is of interest. We provide detailed ablation studies that test the behavior of our GAN architecture with loss functions from the contrastive learning literature. We show that the generative model achieves lower Frechet Inception Distance than discriminative ones, and therefore predicts color profiles that better match those from real images. Finally, we demonstrate improved performance in image retrieval and classification, indicating the crucial role that color plays in these downstream tasks.