title: Y-Net: A Spatiospectral Dual-Encoder Networkfor Medical Image Segmentation

abstract: Automated segmentation of retinal optical coherence tomography (OCT) images has become an important recent direction in machine learning for medical applications. We hypothesize that the anatomic structure of layers and their high-frequency variation in OCT images make retinal OCT a fitting choice for extracting spectral-domain features and combining them with spatial domain features. In this work, we present $\Upsilon$-Net, an architecture that combines the frequency domain features with the image domain to improve the segmentation performance of OCT images. The results of this work demonstrate that the introduction of two branches, one for spectral and one for spatial domain features, brings a very significant improvement in fluid segmentation performance and allows outperformance as compared to the well-known U-Net model. Our improvement was 13% on the fluid segmentation dice score and 1.9% on the average dice score. Finally, removing selected frequency ranges in the spectral domain demonstrates the impact of these features on the fluid segmentation outperformance.


title: DeepCSI: Rethinking Wi-Fi Radio Fingerprinting Through MU-MIMO CSI Feedback Deep Learning

abstract: We present DeepCSI, a novel approach to Wi-Fi radio fingerprinting (RFP) which leverages standard-compliant beamforming feedback matrices to authenticate MU-MIMO Wi-Fi devices on the move. By capturing unique imperfections in off-the-shelf radio circuitry, RFP techniques can identify wireless devices directly at the physical layer, allowing low-latency low-energy cryptography-free authentication. However, existing Wi-Fi RFP techniques are based on software-defined radio (SDRs), which may ultimately prevent their widespread adoption. Moreover, it is unclear whether existing strategies can work in the presence of MU-MIMO transmitters - a key technology in modern Wi-Fi standards. Conversely from prior work, DeepCSI does not require SDR technologies and can be run on any low-cost Wi-Fi device to authenticate MU-MIMO transmitters. Our key intuition is that imperfections in the transmitter's radio circuitry percolate onto the beamforming feedback matrix, and thus RFP can be performed without explicit channel state information (CSI) computation. DeepCSI is robust to inter-stream and inter-user interference being the beamforming feedback not affected by those phenomena. We extensively evaluate the performance of DeepCSI through a massive data collection campaign performed in the wild with off-the-shelf equipment, where 10 MU-MIMO Wi-Fi radios emit signals in different positions. Experimental results indicate that DeepCSI correctly identifies the transmitter with an accuracy of up to 98%. The identification accuracy remains above 82% when the device moves within the environment. To allow replicability and provide a performance benchmark, we pledge to share the 800 GB datasets - collected in static and, for the first time, dynamic conditions - and the code database with the community.


title: TabNAS: Rejection Sampling for Neural Architecture Search on Tabular Datasets

abstract: The best neural architecture for a given machine learning problem depends on many factors: not only the complexity and structure of the dataset, but also on resource constraints including latency, compute, energy consumption, etc. Neural architecture search (NAS) for tabular datasets is an important but under-explored problem. Previous NAS algorithms designed for image search spaces incorporate resource constraints directly into the reinforcement learning (RL) rewards. However, for NAS on tabular datasets, this protocol often discovers suboptimal architectures. This paper develops TabNAS, a new and more effective approach to handle resource constraints in tabular NAS using an RL controller motivated by the idea of rejection sampling. TabNAS immediately discards any architecture that violates the resource constraints without training or learning from that architecture. TabNAS uses a Monte-Carlo-based correction to the RL policy gradient update to account for this extra filtering step. Results on several tabular datasets demonstrate the superiority of TabNAS over previous reward-shaping methods: it finds better models that obey the constraints.


title: Multi-Frame Self-Supervised Depth with Transformers

abstract: Multi-frame depth estimation improves over single-frame approaches by also leveraging geometric relationships between images via feature matching, in addition to learning appearance-based features. In this paper we revisit feature matching for self-supervised monocular depth estimation, and propose a novel transformer architecture for cost volume generation. We use depth-discretized epipolar sampling to select matching candidates, and refine predictions through a series of self- and cross-attention layers. These layers sharpen the matching probability between pixel features, improving over standard similarity metrics prone to ambiguities and local minima. The refined cost volume is decoded into depth estimates, and the whole pipeline is trained end-to-end from videos using only a photometric objective. Experiments on the KITTI and DDAD datasets show that our DepthFormer architecture establishes a new state of the art in self-supervised monocular depth estimation, and is even competitive with highly specialized supervised single-frame architectures. We also show that our learned cross-attention network yields representations transferable across datasets, increasing the effectiveness of pre-training strategies. Project page: https://sites.google.com/tri.global/depthformer


title: Celestial insights into the S-matrix bootstrap

abstract: We consider 2-2 scattering in four spacetime dimensions in Celestial variables. Using the crossing symmetric dispersion relation (CSDR), we recast the Celestial amplitudes in terms of crossing symmetric partial waves. These partial waves have spurious singularities in the complex Celestial variable, which need to be removed in local theories. The locality constraints (null constraints) admit closed form expressions, which lead to novel bounds on partial wave moments. These bounds allow us to quantify the degree of low spin dominance(LSD) for scalar theories. We study a new kind of positivity that seems to be present in a wide class of theories. We prove that this positivity arises only in theories with a spin-0 dominance. The crossing symmetric partial waves with spurious singularities removed, dubbed as Feynman blocks, have remarkable properties in the Celestial variable, namely typically realness, in the sense of Geometric Function Theory (GFT). Using GFT techniques we derive non-projective bounds on Wilson coefficients in terms of partial wave moments.


title: Operator inequalities via accretive transforms

abstract: In this article, we employ certain properties of the transform $C_{M,m}(A)=(MI-A^*)(A-mI)$ to obtain new inequalities for the bounded linear operator $A$ on a complex Hilbert space $\mathcal{H}$. In particular, we obtain new relations among $|A|,|A^*|,|\mathfrak{R}A|$ and $|\mathfrak{I}A|$. Further numerical radius inequalities that extend some known inequalities will be presented too.


title: Transfer Importance Sampling -- How Testing Automated Vehicles in Multiple Test Setups Helps With the Bias-Variance Tradeoff

abstract: The promise of increased road safety is a key motivator for the development of automated vehicles (AV). Yet, demonstrating that an AV is as safe as, or even safer than, a human-driven vehicle has proven to be challenging. Should an AV be examined purely virtually, allowing large numbers of fully controllable tests? Or should it be tested under real environmental conditions on a proving ground? Since different test setups have different strengths and weaknesses, it is still an open question how virtual and real tests should be combined. On the way to answer this question, this paper proposes transfer importance sampling (TIS), a risk estimation method linking different test setups. Fusing the concepts of transfer learning and importance sampling, TIS uses a scalable, cost-effective test setup to comprehensively explore an AV's behavior. The insights gained then allow parameterizing tests in a more trustworthy test setup accurately reflecting risks. We show that when using a trustworthy test setup alone is prohibitively expensive, linking it to a scalable test setup can increase efficiency $\unicode{x2013}$ without sacrificing the result's validity. Thus, the test setups' individual deficiencies are compensated for by their systematic linkage.


title: Some weighted numerical radius inequalities

abstract: The weighted numerical radius of a Hilbert space operator has been defined recently. This article explores other properties and uses this newly defined numerical radius to obtain several new interesting inequalities for the weighted numerical radius and the numerical radius. In particular, new identities for the numerical radius, further comparisons between the numerical radius and the real and imaginary parts, and some inequalities for sectorial operators will be presented.


title: Beyond the Local Volume. II. Population Scaleheights and Ages of Ultracool Dwarfs in Deep HST/WFC3 Parallel Fields

abstract: Ultracool dwarfs represent a significant proportion of stars in the Milky Way,and deep samples of these sources have the potential to constrain the formation history and evolution of low-mass objects in the Galaxy. Until recently, spectral samples have been limited to the local volume (d<100 pc). Here, we analyze a sample of 164 spectroscopically-characterized ultracool dwarfs identified by Aganze et al. (2022) in the Hubble Space Telescope WFC3 Infrared Spectroscopic Parallel (WISP) Survey and 3D-HST. We model the observed luminosity function using population simulations to place constraints on scaleheights, vertical velocity dispersions and population ages as a function of spectral type. Our star counts are consistent with a power-law mass function and constant star formation history for ultracool dwarfs, with vertical scaleheights 249$_{-61}^{+48}$ pc for late M dwarfs, 153$_{-30}^{+56}$ pc for L dwarfs, and 175$_{-56}^{+149}$ pc for T dwarfs. Using spatial and velocity dispersion relations, these scaleheights correspond to disk population ages of 3.6$_{-1.0}^{+0.8}$ for late M dwarfs, 2.1$_{-0.5}^{+0.9}$ Gyr for L dwarfs, and 2.4$_{-0.8}^{+2.4}$ Gyr for T dwarfs, which are consistent with prior simulations that predict that L-type dwarfs are on average a younger and less dispersed population. There is an additional 1-2 Gyr systematic uncertainty on these ages due to variances in age-velocity relations. We use our population simulations to predict the UCD yield in the JWST PASSAGES survey, a similar and deeper survey to WISPS and 3D-HST, and find that it will produce a comparably-sized UCD sample, albeit dominated by thick disk and halo sources.


title: Operator inequalities via the triangle inequality

abstract: This article improves the triangle inequality for complex numbers, using the Hermite-Hadamard inequality for convex functions. Then, applications of the obtained refinement are presented to include some operator inequalities. The operator applications include numerical radius inequalities and operator mean inequalities.


title: Active Mapping via Gradient Ascent Optimization of Shannon Mutual Information over Continuous SE(3) Trajectories

abstract: The problem of active mapping aims to plan an informative sequence of sensing views given a limited budget such as distance traveled. This paper consider active occupancy grid mapping using a range sensor, such as LiDAR or depth camera. State-of-the-art methods optimize information-theoretic measures relating the occupancy grid probabilities with the range sensor measurements. The non-smooth nature of ray-tracing within a grid representation makes the objective function non-differentiable, forcing existing methods to search over a discrete space of candidate trajectories. This work proposes a differentiable approximation of the Shannon mutual information between a grid map and ray-based observations that enables gradient ascent optimization in the continuous space of SE(3) sensor poses. Our gradient-based formulation leads to more informative sensing trajectories, while avoiding occlusions and collisions. The proposed method is demonstrated in simulated and real-world experiments in 2-D and 3-D environments.


title: Total mean curvatures of Riemannian hypersurfaces

abstract: We obtain a comparison formula for integrals of mean curvatures of Riemannian hypersurfaces, via Reilly's identities. As applications we derive several geometric inequalities for a convex hypersurface $\Gamma$ in a Cartan-Hadamard manifold $M$. In particular we show that the first mean curvature integral of a convex hypersurface $\gamma$ nested inside $\Gamma$ cannot exceed that of $\Gamma$, which leads to a sharp lower bound in dimension $3$ for the total first mean curvature of $\Gamma$ in terms of the volume it bounds in $M$. This monotonicity property is extended to all mean curvature integrals when $\gamma$ is parallel to $\Gamma$, or $M$ has constant curvature. We also characterize hyperbolic balls as minimizers of the mean curvature integrals among balls with equal radii in Cartan-Hadamard manifolds.


title: Design of optimization tools for quantum information theory

abstract: In this thesis, we present optimization tools for different problems in quantum information theory. First, we introduce an algorithm for quantum estate estimation. The algorithm consists of orthogonal projections on intersecting hyperplanes, which are determined by the probability distributions and the measurement operators. We show its performance, in both runtime and fidelity, considering realistic errors. Second, we present a technique for certifying quantum non-locality. Given a set of bipartite measurement frequencies, this technique finds a Bell inequality that maximizes the gap between the local hidden variable and the quantum value of a Bell inequality. Lastly, to study the quantum marginal problem, we introduce an operator and develop an algorithm, which takes as inputs a set of quantum marginals and eigenvalues, and outputs a density matrix, if exists, compatible with the prescribed data.


title: Short Time Existence for Coupling of Scaled Mean Curvature Flow and Diffusion

abstract: We prove a short time existence result for a system consisting of a geometric evolution equation for a hypersurface and a parabolic equation on this evolving hypersurface. More precisely, we discuss a mean curvature flow scaled with a term that depends on a quantity defined on the surface coupled to a diffusion equation for that quantity. The proof is based on a splitting ansatz, solving both equations separately using linearization and a contraction argument. Our result is formulated for the case of immersed hypersurfaces and yields a uniform lower bound on the existence time that allows for small changes in the initial value of the height function.


title: Metallicity of Galactic RR Lyrae from Optical and Infrared Light Curves: II. Period-Fourier-Metallicity Relations for First Overtone RR Lyrae

abstract: We present new period-$\phi_{31}$-[Fe/H] relations for first overtone RRL stars (RRc), calibrated over a broad range of metallicities ($-2.5 < \textrm{[Fe/H]}< 0.0$) utilizing the largest currently available set of Galactic halo field RRL with homogeneous spectroscopic metallicities. Our relations are defined in the optical (ASAS-SN $V$-band) and, inaugurally, in the infrared (WISE $W1$ and $W2$ bands). Our $V$-band relation can reproduce individual RRc spectroscopic metallicities with a dispersion of 0.30 dex over the entire metallicity range of our calibrator sample (an RMS smaller than what we found for other relations in literature including non-linear terms). Our infrared relation has a similar dispersion in the low and intermediate metallicity range ($\textrm{[Fe/H]} < -0.5$) but tends to underestimate the [Fe/H] abundance around solar metallicity. We tested our relations by measuring both the metallicity of the Sculptor dSph and a sample of Galactic globular clusters, rich in both RRc and RRab stars. The average metallicity we obtain for the combined RRL sample in each cluster is within $\pm 0.08$ dex of their spectroscopic metallicities. The infrared and optical relations presented in this work will enable deriving reliable photometric RRL metallicities in conditions where spectroscopic measurements are not feasible; e.g., in distant galaxies or reddened regions (observed with upcoming Extremely Large Telescopes and the James Webb Space Telescope), or in the large sample of new RRL that will be discovered in large-area time-domain photometric surveys (such as LSST and the Roman space telescope).


title: On annular short-time stability conditions for generalized Persidskii systems

abstract: This paper studies the trajectory behavior evaluation for generalized Persidskii systems with an essentially bounded input on a finite time interval. Also, the notions of annular settling and output annular settling for general nonlinear systems are introduced. We propose conditions for annular short-time stability, short-time boundedness with a nonzero initial state, annular settling, and output annular settling for a class of Persidskii systems. These conditions are based on the verification of linear matrix inequalities. An application to recurrent neural networks illustrates the usefulness of the proposed notions and conditions.


title: Navigation between initial and desired community states using shortcuts

abstract: Ecological management problems often involve navigating from an initial to a desired community state. We ask whether navigation is possible without brute-force additions and deletions of species, using actions of varying costs: adding/deleting a small number of individuals of a species, changing the environment, and waiting. Navigation can yield direct paths (single sequence of actions) or shortcut paths (multiple sequences of actions with lower cost than a direct path). We ask (1) when is non-brute-force navigation possible?; (2) do shortcuts exist and what are their properties?; and (3) what heuristics predict shortcut existence? Using several empirical datasets, we show that (1) non-brute-force navigation is only possible between some state pairs, (2) shortcuts exist between many state pairs; and (3) changes in abundance and richness are the strongest predictors of shortcut existence, independent of dataset and algorithm choices. State diagrams thus unveil hidden strategies for efficiently shifting between states.


title: Prismatic Soft Actuator Augments the Workspace of Soft Continuum Robots

abstract: Soft robots are promising for manipulation tasks thanks to their compliance, safety, and high degree of freedom. However, the commonly used bidirectional continuum segment design means soft robotic manipulators only function in a limited hemispherical workspace. This work increases a soft robotic arm's workspace by designing, fabricating, and controlling an additional soft prismatic actuator at the base of the soft arm. This actuator consists of pneumatic artificial muscles and a piston, making the actuator back-driveable. We increase the task space volume by 116\%, and we are now able to perform manipulation tasks that were previously impossible for soft robots, such as picking and placing objects at different positions on a surface and grabbing an object out of a container. By combining a soft robotic arm with a prismatic joint, we greatly increase the usability of soft robots for object manipulation. This work promotes the use of integrated and modular soft robotic systems for practical manipulation applications in human-centered environments.


title: Evaluating the Effectiveness of Corrective Demonstrations and a Low-Cost Sensor for Dexterous Manipulation

abstract: Imitation learning is a promising approach to help robots acquire dexterous manipulation capabilities without the need for a carefully-designed reward or a significant computational effort. However, existing imitation learning approaches require sophisticated data collection infrastructure and struggle to generalize beyond the training distribution. One way to address this limitation is to gather additional data that better represents the full operating conditions. In this work, we investigate characteristics of such additional demonstrations and their impact on performance. Specifically, we study the effects of corrective and randomly-sampled additional demonstrations on learning a policy that guides a five-fingered robot hand through a pick-and-place task. Our results suggest that corrective demonstrations considerably outperform randomly-sampled demonstrations, when the proportion of additional demonstrations sampled from the full task distribution is larger than the number of original demonstrations sampled from a restrictive training distribution. Conversely, when the number of original demonstrations are higher than that of additional demonstrations, we find no significant differences between corrective and randomly-sampled additional demonstrations. These results provide insights into the inherent trade-off between the effort required to collect corrective demonstrations and their relative benefits over randomly-sampled demonstrations. Additionally, we show that inexpensive vision-based sensors, such as LeapMotion, can be used to dramatically reduce the cost of providing demonstrations for dexterous manipulation tasks. Our code is available at https://github.com/GT-STAR-Lab/corrective-demos-dexterous-manipulation.


title: Mass Distribution and "Mass Gap" of Compact Stellar Remnants in Binary Systems

abstract: The highest critical mass of neutron stars (NSs) was reviewed in the context of equation of state and observationsl results/ It was predicted that the maximum NS mass (MNS) exists in the range MNS ~ 2.2-2.9 M_Sun. However, recent observations of gravitationsl waves and other studies had suggested the higher mass limit of NSs, MNS ~ 3/2 M_Sun. The NS mass up to the value of MNS ~ 2 M_Sun is well understood, and with such a mass value it was meaning ful to discuss the "mass gap" ("m-gap") between the NS and black hole (BH) collapsars.The "m-gap" exists in between the highest mass of NS and the lowest mass of BH collapsars (Mm-gap ~ 2-5 M_Sun). in the mass distribution, the maximim population of NSs and BHs is located at MNS = 1.4 M_Sun and MBH = 6.7 M_Sun, respectively. However, recent ofservational results predicted filling the "m-gap" by the compact objects. In this paper, the concept of gravidynamics was reported to resolve the problem of peak likelihood value of gravitational mass at Mpeak = 6.7 M_Sun and the "m-gap" (Mm-gap ~ 2-5 M_Sun). This concept was based on a non-metric scalar-tensor model of gravitational interaction with localizable field energy. The gravidynamics model shows the total mass (MQ) of a compact relativistic object filled with matter of quark-gluon plasma of the radius r* = GMQ/c2 ~ 10 km, consistent with the "m-gap". It was conceptualized that the total measurable gravitational mass of such an extremely dense object consists of both matter and field, which is described by scalar-tensor components. This model is also useful for predicting the collapsars within the "m-gap".


title: Topology-based Phase Identification of Bulk, Interface, and Confined Water using Edge-Conditioned Convolutional Graph Neural Network

abstract: Water plays a significant role in various physicochemical and biological processes. Understanding and identifying water phases in various systems such as bulk, interface, and confined water is crucial in improving and engineering state-of-the-art nano-devices. Various order parameters have been developed to distinguish water phases, including bond-order parameters, local structure index, and tetrahedral order parameters. These order parameters are often developed with the assumption of homogenous bulk systems, while most applications involve heterogeneous and non-bulk systems, thus, limiting their generalizability. Our study develops a methodology based on the graph neural network to distinguish water phases directly from data and to learn features instead of predefining them. We provide comparisons between baseline methods trained using conventional order-parameters as features, and a graph neural network model trained using radial distance and hydrogen-bonding information for phase classification and phase transition of water in bulk, interface, and confined systems with continuous and discontinuous phase transitions.


title: A generative neural network model for random dot product graphs

abstract: We present GraphMoE, a novel neural network-based approach to learning generative models for random graphs. The neural network is trained to match the distribution of a class of random graphs by way of a moment estimator. The features used for training are graphlets, subgraph counts of small order. The neural network accepts random noise as input and outputs vector representations for nodes in the graph. Random graphs are then realized by applying a kernel to the representations. Graphs produced this way are demonstrated to be able to imitate data from chemistry, medicine, and social networks. The produced graphs are similar enough to the target data to be able to fool discriminator neural networks otherwise capable of separating classes of random graphs.


title: Full superconducting gap in the candidate topological superconductor In$_{1-x}$Pb$_x$Te for x = 0.2

abstract: High-pressure synthesis techniques have allowed for the growth of samples on the indium-rich side of (Pb,In)Te, which have increased superconducting transition temperatures compared to lead-rich compounds. In this study we present measurements of the temperature dependence of the London penetration depth $\Delta \lambda(T)$ in the compound In$_{0.8}$Pb$_{0.2}$Te, which shows a bulk $T_{c,onset}$ of $\sim4.75$ K. The results indicate fully gapped BCS-like behavior, ruling out odd-parity, topologically nontrivial $A_{2u}$ pairing; however, odd-parity $A_{1u}$ pairing is still possible. Critical field values measured below 1 K and other superconducting parameters are also presented.


title: Lagrangian Motion Magnification with Double Sparse Optical Flow Decomposition

abstract: Microexpressions are fast and spatially small facial expressions that are difficult to detect. Therefore motion magnification techniques, which aim at amplifying and hence revealing subtle motion in videos, appear useful for handling such expressions. There are basically two main approaches, namely via Eulerian or Lagrangian techniques. While the first one magnifies motion implicitly by operating directly on image pixels, the Lagrangian approach uses optical flow (OF) techniques to extract and magnify pixel trajectories. In this paper, we propose a novel approach for local Lagrangian motion magnification of facial micro-motions. Our contribution is three-fold: first, we fine tune the recurrent all-pairs field transforms (RAFT) for OFs deep learning approach for faces by adding ground truth obtained from the variational dense inverse search (DIS) for OF algorithm applied to the CASME II video set of facial micro expressions. This enables us to produce OFs of facial videos in an efficient and sufficiently accurate way. Second, since facial micro-motions are both local in space and time, we propose to approximate the OF field by sparse components both in space and time leading to a double sparse decomposition. Third, we use this decomposition to magnify micro-motions in specific areas of the face, where we introduce a new forward warping strategy using a triangular splitting of the image grid and barycentric interpolation of the RGB vectors at the corners of the transformed triangles. We demonstrate the feasibility of our approach by various examples.


title: Towards a Stronger Theory for Permutation-based Evolutionary Algorithms

abstract: While the theoretical analysis of evolutionary algorithms (EAs) has made significant progress for pseudo-Boolean optimization problems in the last 25 years, only sporadic theoretical results exist on how EAs solve permutation-based problems. To overcome the lack of permutation-based benchmark problems, we propose a general way to transfer the classic pseudo-Boolean benchmarks into benchmarks defined on sets of permutations. We then conduct a rigorous runtime analysis of the permutation-based $(1+1)$ EA proposed by Scharnow, Tinnefeld, and Wegener (2004) on the analogues of the \textsc{LeadingOnes} and \textsc{Jump} benchmarks. The latter shows that, different from bit-strings, it is not only the Hamming distance that determines how difficult it is to mutate a permutation $\sigma$ into another one $\tau$, but also the precise cycle structure of $\sigma \tau^{-1}$. For this reason, we also regard the more symmetric scramble mutation operator. We observe that it not only leads to simpler proofs, but also reduces the runtime on jump functions with odd jump size by a factor of $\Theta(n)$. Finally, we show that a heavy-tailed version of the scramble operator, as in the bit-string case, leads to a speed-up of order $m^{\Theta(m)}$ on jump functions with jump size~$m$.%


title: Paths are Tur\'an-good

abstract: We show that among $K_{k+1}$-free $n$-vertex graphs, the Tur\'an graph contains the most copies of any path.


title: Graded Frobenius Rings

abstract: In order to study graded Frobenius algebras from a ring theoretical perspective, we introduce graded quasi-Frobenius rings, graded Frobenius rings and a shift-version of the latter ones, and we investigate the structure and representations of such objects. We need to revisit graded simple graded left Artinian rings, graded semisimple rings, and to provide graded versions of certain results concerning the Jacobson radical, the singular radical, and their connection to finiteness conditions and injectivity. We prove a structure result for (shift-)graded Frobenius rings.


title: Event-aided Direct Sparse Odometry

abstract: We introduce EDS, a direct monocular visual odometry using events and frames. Our algorithm leverages the event generation model to track the camera motion in the blind time between frames. The method formulates a direct probabilistic approach of observed brightness increments. Per-pixel brightness increments are predicted using a sparse number of selected 3D points and are compared to the events via the brightness increment error to estimate camera motion. The method recovers a semi-dense 3D map using photometric bundle adjustment. EDS is the first method to perform 6-DOF VO using events and frames with a direct approach. By design, it overcomes the problem of changing appearance in indirect methods. We also show that, for a target error performance, EDS can work at lower frame rates than state-of-the-art frame-based VO solutions. This opens the door to low-power motion-tracking applications where frames are sparingly triggered "on demand" and our method tracks the motion in between. We release code and datasets to the public.


title: Investigating Positive and Negative Qualities of Human-in-the-Loop Optimization for Designing Interaction Techniques

abstract: Designers reportedly struggle with design optimization tasks where they are asked to find a combination of design parameters that maximizes a given set of objectives. In HCI, design optimization problems are often exceedingly complex, involving multiple objectives and expensive empirical evaluations. Model-based computational design algorithms assist designers by generating design examples during design, however they assume a model of the interaction domain. Black box methods for assistance, on the other hand, can work with any design problem. However, virtually all empirical studies of this human-in-the-loop approach have been carried out by either researchers or end-users. The question stands out if such methods can help designers in realistic tasks. In this paper, we study Bayesian optimization as an algorithmic method to guide the design optimization process. It operates by proposing to a designer which design candidate to try next, given previous observations. We report observations from a comparative study with 40 novice designers who were tasked to optimize a complex 3D touch interaction technique. The optimizer helped designers explore larger proportions of the design space and arrive at a better solution, however they reported lower agency and expressiveness. Designers guided by an optimizer reported lower mental effort but also felt less creative and less in charge of the progress. We conclude that human-in-the-loop optimization can support novice designers in cases where agency is not critical.


title: Reduced Recombination via Tunable Surface Fields in Perovskite Solar Cells

abstract: The ability to reduce energy loss at semiconductor surfaces through passivation or surface field engineering has become an essential step in the manufacturing of efficient photovoltaic (PV) and optoelectronic devices. Similarly, surface modification of emerging halide perovskites with quasi-2D heterostructures is now ubiquitous to achieve PV power conversion efficiencies (PCEs) > 22% and has enabled single-junction PV devices to reach 25.7%, yet a fundamental understanding to how these treatments function is still generally lacking. This has established a bottleneck for maximizing beneficial improvements as no concrete selection and design rules currently exist. Here we uncover a new type of tunable passivation strategy and mechanism found in perovskite PV devices that were the first to reach the > 25% PCE milestone, which is enabled by surface treating a bulk perovskite layer with hexylammonium bromide (HABr). We uncover the simultaneous formation of an iodide-rich 2D layer along with a Br halide gradient achieved through partial halide exchange that extends from defective surfaces and grain boundaries into the bulk layer. We demonstrate and directly visualize the tunability of both the 2D layer thickness, halide gradient, and band structure using a unique combination of depth-sensitive nanoscale characterization techniques. We show that the optimization of this interface can extend the charge carrier lifetime to values > 30 {\mu}s, which is the longest value reported for a direct bandgap semiconductor (GaAs, InP, CdTe) over the past 50 years. Importantly, this work reveals an entirely new strategy and knob for optimizing and tuning recombination and charge transport at semiconductor interfaces and will likely establish new frontiers in achieving the next set of perovskite device performance records.


title: Towards a proof of the Riemann Hypothesis

abstract: In this article we will prove the Riemann Hypothesis for a infinite number of choices of the imaginary part of the argument - $\Im(s)=T$.


title: Identifying Ethical Issues in AI Partners in Human-AI Co-Creation

abstract: Human-AI co-creativity involves humans and AI collaborating on a shared creative product as partners. In many existing co-creative systems, users communicate with the AI using buttons or sliders. However, typically, the AI in co-creative systems cannot communicate back to humans, limiting their potential to be perceived as partners. This paper starts with an overview of a comparative study with 38 participants to explore the impact of AI-to-human communication on user perception and engagement in co-creative systems and the results show improved collaborative experience and user engagement with the system incorporating AI-to-human communication. The results also demonstrate that users perceive co-creative AI as more reliable, personal and intelligent when it can communicate with the users. The results indicate a need to identify potential ethical issues from an engaging communicating co-creative AI. Later in the paper, we present some potential ethical issues in human-AI co-creation and propose to use participatory design fiction as the research methodology to investigate the ethical issues associated with a co-creative AI that communicates with users.


title: Timescales for Nitric Acid Desorption in Epitaxial Graphene Devices

abstract: This work reports the dynamics of transient hole doping in epitaxial graphene devices by using nitric acid as an adsorbent. The timescales associated with corresponding desorption processes are extracted from the data. The understanding of reversible hole doping without gating is of crucial importance to those fabricating devices with a particular functionality. Measurements of the electrical and optical properties of several devices post-exposure were performed with transport temperatures between 300 K and 1.5 K. Ambient conditions are applied to non-transport measurements to replicate the most likely laboratory conditions for handling devices using this doping method. The relevant timescales from transport measurements are compared with results from Raman spectroscopy measurements.


title: Wavelet Moments for Cosmological Parameter Estimation

abstract: Extracting non-Gaussian information from the non-linear regime of structure formation is key to fully exploiting the rich data from upcoming cosmological surveys probing the large-scale structure of the universe. However, due to theoretical and computational complexities, this remains one of the main challenges in analyzing observational data. We present a set of summary statistics for cosmological matter fields based on 3D wavelets to tackle this challenge. These statistics are computed as the spatial average of the complex modulus of the 3D wavelet transform raised to a power $q$ and are therefore known as invariant wavelet moments. The 3D wavelets are constructed to be radially band-limited and separable on a spherical polar grid and come in three types: isotropic, oriented, and harmonic. In the Fisher forecast framework, we evaluate the performance of these summary statistics on matter fields from the Quijote suite, where they are shown to reach state-of-the-art parameter constraints on the base $\Lambda$CDM parameters, as well as the sum of neutrino masses. We show that we can improve constraints by a factor 5 to 10 in all parameters with respect to the power spectrum baseline.


title: Spectroscopic assessment of short-term nitric acid doping of epitaxial graphene

abstract: This work reports information on the transience of hole doping in epitaxial graphene devices when nitric acid is used as an adsorbent. Under vacuum conditions, desorption processes are monitored by electrical and spectroscopic means to extract the relevant timescales from the corresponding data. It is of vital importance to understand the reversible nature of hole doping because such device processing can be a suitable alternative to large-scale, metallic gating. Most measurements are performed post-exposure at room temperature, and, for some electrical transport measurements, at 1.5 K. Vacuum conditions are applied to many measurements to replicate the laboratory conditions under which devices using this doping method would be measured. The relevant timescales from transport measurements are compared with results from X-ray photoelecton spectroscopy and Fourier transform infrared spectroscopy measurements, with the latter performed at ambient conditions and accompanied by calculations of the spectra in the Reststrahlen band.


title: Design of an arrangement of cubic magnets for a quasi-axisymmetric stellarator experiment

abstract: The usage of permanent magnets to shape the confining magnetic field of a stellarator has the potential to reduce or eliminate the need for non-planar coils. As a proof-of-concept for this idea, we have developed a procedure for designing an array of cubic permanent magnets that works in tandem with a set of toroidal-field coils to confine a stellarator plasma. All of the magnets in the design are constrained to have identical geometry and one of three polarization types in order to simplify fabrication while still producing sufficient field accuracy. We present some of the key steps leading to the design, including the geometric arrangement of the magnets around the device, the procedure for optimizing the polarizations according to the three allowable magnet types, and the choice of magnet types to be used. We apply these methods to design an array of rare-Earth permanent magnets that can be paired with a set of planar toroidal-field coils to confine a quasi-axisymmetric plasma with a toroidal magnetic field strength of about 0.5 T on axis.


title: MultiEarth 2022 -- Multimodal Learning for Earth and Environment Workshop and Challenge

abstract: The Multimodal Learning for Earth and Environment Challenge (MultiEarth 2022) will be the first competition aimed at the monitoring and analysis of deforestation in the Amazon rainforest at any time and in any weather conditions. The goal of the Challenge is to provide a common benchmark for multimodal information processing and to bring together the earth and environmental science communities as well as multimodal representation learning communities to compare the relative merits of the various multimodal learning methods to deforestation estimation under well-defined and strictly comparable conditions. MultiEarth 2022 will have three sub-challenges: 1) matrix completion, 2) deforestation estimation, and 3) image-to-image translation. This paper presents the challenge guidelines, datasets, and evaluation metrics for the three sub-challenges. Our challenge website is available at https://sites.google.com/view/rainforest-challenge.


title: Momentum microscopy of Pb-intercalated graphene on SiC: charge neutrality and electronic structure of interfacial Pb

abstract: Intercalation is an established technique for tailoring the electronic structure of epitaxial graphene. Moreover, it enables the synthesis of otherwise unstable two-dimensional (2D) layers of elements with unique physical properties compared to their bulk versions due to interfacial quantum confinement. In this work, we present uniformly Pb-intercalated quasi-freestanding monolayer graphene on SiC, which turns out to be essentially charge neutral with an unprecedented $p$-type carrier density of only $(5.5\pm2.5)\times10^9$ cm$^{-2}$. Probing the low-energy electronic structure throughout the entire first surface Brillouin zone by means of momentum microscopy, we clearly discern additional bands related to metallic 2D-Pb at the interface. Low-energy electron diffraction further reveals a $10\times10$ Moir\'e superperiodicity relative to graphene, counterparts of which cannot be directly identified in the available band structure data. Our experiments demonstrate 2D interlayer confinement and associated band structure formation of a heavy-element superconductor, paving the way towards strong spin-orbit coupling effects or even 2D superconductivity at the graphene/SiC interface.


title: Learning time-dependent PDE solver using Message Passing Graph Neural Networks

abstract: One of the main challenges in solving time-dependent partial differential equations is to develop computationally efficient solvers that are accurate and stable. Here, we introduce a graph neural network approach to finding efficient PDE solvers through learning using message-passing models. We first introduce domain invariant features for PDE-data inspired by classical PDE solvers for an efficient physical representation. Next, we use graphs to represent PDE-data on an unstructured mesh and show that message passing graph neural networks (MPGNN) can parameterize governing equations, and as a result, efficiently learn accurate solver schemes for linear/nonlinear PDEs. We further show that the solvers are independent of the initial trained geometry, i.e. the trained solver can find PDE solution on different complex domains. Lastly, we show that a recurrent graph neural network approach can find a temporal sequence of solutions to a PDE.


title: Precise predictions for V+2 jet backgrounds in searches for invisible Higgs decays

abstract: We present next-to-leading order QCD and electroweak (EW) theory predictions for $V+2\,$jet production, with $V=Z,W^{\pm}$, considering both the QCD and EW production modes and their interference. We focus on phase-space regions where $V+2\,$jet production is dominated by vector-boson fusion, and where these processes yield the dominant irreducible backgrounds in searches for invisible Higgs boson decays. Predictions at parton level are provided together with detailed prescriptions for their implementation in experimental analyses based on the reweighting of Monte Carlo samples. The key idea is that, exploiting accurate data for $W+2\,$jet production in combination with a theory-driven extrapolation to the $Z+2\,$jet process can lead to a determination of the irreducible background at the few-percent level. Particular attention is devoted to the estimate of the residual theoretical uncertainties due to unknown higher-order QCD and EW effects and their correlation between the different $V+2\,$jet processes, which is key to improve the sensitivity to invisible Higgs decays.


title: Bayesian Updating of Seismic Ground Failure Estimates via Causal Graphical Models and Satellite Imagery

abstract: Earthquake-induced secondary ground failure hazards, such as liquefaction and landslides, result in catastrophic building and infrastructure damage as well as human fatalities. To facilitate emergency responses and mitigate losses, the U.S. Geological Survey provides a rapid hazard estimation system for earthquake-triggered landslides and liquefaction using geospatial susceptibility proxies and ShakeMap ground motion estimates. In this study, we develop a generalized causal graph-based Bayesian network that models the physical interdependencies between geospatial features, seismic ground failures, and building damage, as well as DPMs. Geospatial features provide physical insights for estimating ground failure occurrence while DPMs contain event-specific surface change observations. This physics-informed causal graph incorporates these variables with complex physical relationships in one holistic Bayesian updating scheme to effectively fuse information from both geospatial models and remote sensing data. This framework is scalable and flexible enough to deal with highly complex multi-hazard combinations. We then develop a stochastic variational inference algorithm to jointly update the intractable posterior probabilities of unobserved landslides, liquefaction, and building damage at different locations efficiently. In addition, a local graphical model pruning algorithm is presented to reduce the computational cost of large-scale seismic ground failure estimation. We apply this framework to the September 2018 Hokkaido Iburi-Tobu, Japan (M6.6) earthquake and January 2020 Southwest Puerto Rico (M6.4) earthquake to evaluate the performance of our algorithm.


title: Noisy detectors with unmatched detection efficiency thwart identification of single photon emitters via photon coincidence correlation

abstract: Single photon emitters (SPEs) are often identified with a Hanbury Brown and Twiss intensity interferometer (HBTII) consisting of a 50:50 beamsplitter and two time-correlated single photon counters. For an SPE, the cross-correlation of photon arrival time between the two detectors, $g^{(2)}(\tau)$, shows a hallmark dip to zero at $\tau=0$. One common heuristic for identifying SPEs is by measuring a system to have $g^{(2)}(0)<1/2$. Here in, we use stochastic methods to simulate the case of a SPE observed with non-ideal detectors and optics. We show that identification of SPEs is thwarted when the detectors have asymmetric detection efficiency, and when detector background noise is more than half the true SPE signal rate.


title: Deep Unlearning via Randomized Conditionally Independent Hessians

abstract: Recent legislation has led to interest in machine unlearning, i.e., removing specific training samples from a predictive model as if they never existed in the training dataset. Unlearning may also be required due to corrupted/adversarial data or simply a user's updated privacy requirement. For models which require no training (k-NN), simply deleting the closest original sample can be effective. But this idea is inapplicable to models which learn richer representations. Recent ideas leveraging optimization-based updates scale poorly with the model dimension d, due to inverting the Hessian of the loss function. We use a variant of a new conditional independence coefficient, L-CODEC, to identify a subset of the model parameters with the most semantic overlap on an individual sample level. Our approach completely avoids the need to invert a (possibly) huge matrix. By utilizing a Markov blanket selection, we premise that L-CODEC is also suitable for deep unlearning, as well as other applications in vision. Compared to alternatives, L-CODEC makes approximate unlearning possible in settings that would otherwise be infeasible, including vision models used for face recognition, person re-identification and NLP models that may require unlearning samples identified for exclusion. Code can be found at https://github.com/vsingh-group/LCODEC-deep-unlearning/


title: Universal Non-Polar Switching in Carbon-doped Transition Metal Oxides (TMOs) and Post TMOs

abstract: Transition metal oxides (TMOs) and post-TMOs (PTMOs), when doped with Carbon, show non-volatile current-voltage (I-V) characteristics, which are both universal and repeatable. We have shown spectroscopic evidence of the introduction of carbon-based impurity states inside the existing larger bandgap effectively creating a smaller bandgap which we suggest could enable Mott-like correlation effect. Our findings indicate new insights for yet to be understood unipolar and nonpolar resistive switching in the TMOs and PTMOs. We have shown that device switching is not thermal-energy dependent and have developed an electronic-dominated switching model that allows for the extreme temperature operation (from 1.5 K to 423 K) and state retention up to 673 K for a 1-hour bake. Importantly, we have optimized the technology in an industrial process and demonstrated integrated 1-transistor/1-resistor (1T1R) arrays up to 1 kbit with 47 nm devices on 300 mm wafers for advanced node CMOS-compatible correlated electron RAM (CeRAM). These devices are shown to operate with 2 ns write pulses and retain the memory states up to 200 C for 24 hours. The collection of attributes shown, including scalability to state-of-the-art dimensions, non-volatile operation to extreme low and high temperatures, fast write, and reduced stochasticity as compared to filamentary memories such as ReRAMs show the potential for a highly capable two-terminal back-end-of-line non-volatile memory.


title: Detection of sepsis during emergency department triage using machine learning

abstract: Sepsis is a life-threatening condition with organ dysfunction and is a leading cause of death and critical illness worldwide. Even a few hours of delay in the treatment of sepsis results in increased mortality. Early detection of sepsis during emergency department triage would allow early initiation of lab analysis, antibiotic administration, and other sepsis treatment protocols. The purpose of this study was to compare sepsis detection performance at ED triage (prior to the use of laboratory diagnostics) of the standard sepsis screening algorithm (SIRS with source of infection) and a machine learning algorithm trained on EHR triage data. A machine learning model (KATE Sepsis) was developed using patient encounters with triage data from 16participating hospitals. KATE Sepsis and standard screening were retrospectively evaluated on the adult population of 512,949 medical records. KATE Sepsis demonstrates an AUC of 0.9423 (0.9401 - 0.9441) with sensitivity of 71.09% (70.12% - 71.98%) and specificity of 94.81% (94.75% - 94.87%). Standard screening demonstrates an AUC of 0.6826 (0.6774 - 0.6878) with sensitivity of 40.8% (39.71% - 41.86%) and specificity of 95.72% (95.68% - 95.78%). The KATE Sepsis model trained to detect sepsis demonstrates 77.67% (75.78% -79.42%) sensitivity in detecting severe sepsis and 86.95% (84.2% - 88.81%) sensitivity in detecting septic shock. The standard screening protocol demonstrates 43.06% (41% - 45.87%) sensitivity in detecting severe sepsis and40% (36.55% - 43.26%) sensitivity in detecting septic shock. Future research should focus on the prospective impact of KATE Sepsis on administration of antibiotics, readmission rate, morbidity and mortality.


title: An anticyclotomic Euler system for adjoint modular Galois representations

abstract: Let $K$ be an imaginary quadratic field and $p$ a prime split in $K$. In this paper we construct an anticyclotomic Euler system for the adjoint representation attached to elliptic modular forms base changed to $K$. We also relate our Euler system to a $p$-adic $L$-function deduced from the construction by Eischen-Wan and Eischen-Harris-Li-Skinner of $p$-adic $L$-functions for unitary groups. This allows us to derive new cases of the Bloch-Kato conjecture in rank zero, and a divisibility towards an Iwasawa main conjecture.


title: Weighted Generalized Fractional Integration by Parts and the Euler-Lagrange Equation

abstract: Integration by parts plays a crucial role in mathematical analysis, e.g., during the proof of necessary optimality conditions in the calculus of variations and optimal control. Motivated by this fact, we construct a new, right-weighted generalized fractional derivative in the Riemann-Liouville sense with its associated integral for the recently introduced weighted generalized fractional derivative with Mittag-Leffler kernel. We rewrite these operators equivalently in effective series, proving some interesting properties relating to the left and the right fractional operators. These results permit us to obtain the corresponding integration by parts formula. With the new general formula, we obtain an appropriate weighted Euler-Lagrange equation for dynamic optimization, extending those existing in the literature. We end with the application of an optimization variational problem to the quantum mechanics framework.


title: It is Okay to Not Be Okay: Overcoming Emotional Bias in Affective Image Captioning by Contrastive Data Collection

abstract: Datasets that capture the connection between vision, language, and affection are limited, causing a lack of understanding of the emotional aspect of human intelligence. As a step in this direction, the ArtEmis dataset was recently introduced as a large-scale dataset of emotional reactions to images along with language explanations of these chosen emotions. We observed a significant emotional bias towards instance-rich emotions, making trained neural speakers less accurate in describing under-represented emotions. We show that collecting new data, in the same way, is not effective in mitigating this emotional bias. To remedy this problem, we propose a contrastive data collection approach to balance ArtEmis with a new complementary dataset such that a pair of similar images have contrasting emotions (one positive and one negative). We collected 260,533 instances using the proposed method, we combine them with ArtEmis, creating a second iteration of the dataset. The new combined dataset, dubbed ArtEmis v2.0, has a balanced distribution of emotions with explanations revealing more fine details in the associated painting. Our experiments show that neural speakers trained on the new dataset improve CIDEr and METEOR evaluation metrics by 20% and 7%, respectively, compared to the biased dataset. Finally, we also show that the performance per emotion of neural speakers is improved across all the emotion categories, significantly on under-represented emotions. The collected dataset and code are available at https://artemisdataset-v2.org.


title: Fairly Accurate: Learning Optimal Accuracy vs. Fairness Tradeoffs for Hate Speech Detection

abstract: Recent work has emphasized the importance of balancing competing objectives in model training (e.g., accuracy vs. fairness, or competing measures of fairness). Such trade-offs reflect a broader class of multi-objective optimization (MOO) problems in which optimization methods seek Pareto optimal trade-offs between competing goals. In this work, we first introduce a differentiable measure that enables direct optimization of group fairness (specifically, balancing accuracy across groups) in model training. Next, we demonstrate two model-agnostic MOO frameworks for learning Pareto optimal parameterizations over different groups of neural classification models. We evaluate our methods on the specific task of hate speech detection, in which prior work has shown lack of group fairness across speakers of different English dialects. Empirical results across convolutional, sequential, and transformer-based neural architectures show superior empirical accuracy vs. fairness trade-offs over prior work. More significantly, our measure enables the Pareto machinery to ensure that each architecture achieves the best possible trade-off between fairness and accuracy w.r.t. the dataset, given user-prescribed error tolerance bounds.


title: A Catalogue of Concerns for Specifying Machine Learning-Enabled Systems

abstract: Requirements engineering (RE) activities for machine learning (ML) are not well-established and researched in the literature. Many issues and challenges exist when specifying, designing, and developing ML-enabled systems. Adding more focus on RE for ML can help to develop more reliable ML-enabled systems. Based on insights collected from previous work and industrial experiences, we propose a catalogue of 45 concerns to be considered when specifying ML-enabled systems, covering five different perspectives we identified as relevant for such systems: objectives, user experience, infrastructure, model, and data. Examples of such concerns include the execution engine and telemetry for the infrastructure perspective, and explainability and reproducibility for the model perspective. We conducted a focus group session with eight software professionals with experience developing ML-enabled systems to validate the importance, quality and feasibility of using our catalogue. The feedback allowed us to improve the catalogue and confirmed its practical relevance. The main research contribution of this work consists in providing a validated set of concerns grouped into perspectives that can be used by requirements engineers to support the specification of ML-enabled systems.


title: Spanish Abstract Meaning Representation: Annotation of a General Corpus

abstract: The Abstract Meaning Representation (AMR) formalism, designed originally for English, has been adapted to a number of languages. We build on previous work proposing the annotation of AMR in Spanish, which resulted in the release of 50 Spanish AMR annotations for the fictional text "The Little Prince." In this work, we present the first sizable, general annotation project for Spanish Abstract Meaning Representation. Our approach to annotation makes use of Spanish rolesets from the AnCora-Net lexicon and extends English AMR with semantic features specific to Spanish. In addition to our guidelines, we release an annotated corpus (586 annotations total, for 486 unique sentences) of multiple genres of documents from the "Abstract Meaning Representation 2.0 - Four Translations" sembank. This corpus is commonly used for evaluation of AMR parsing and generation, but does not include gold AMRs; we hope that providing gold annotations for this dataset can result in a more complete approach to cross-lingual AMR parsing. Finally, we perform a disagreement analysis and discuss the implications of our work on the adaptability of AMR to languages other than English.


title: Conditional Injective Flows for Bayesian Imaging

abstract: Most deep learning models for computational imaging regress a single reconstructed image. In practice, however, ill-posedness, nonlinearity, model mismatch, and noise often conspire to make such point estimates misleading or insufficient. The Bayesian approach models images and (noisy) measurements as jointly distributed random vectors and aims to approximate the posterior distribution of unknowns. Recent variational inference methods based on conditional normalizing flows are a promising alternative to traditional MCMC methods, but they come with drawbacks: excessive memory and compute demands for moderate to high resolution images and underwhelming performance on hard nonlinear problems. In this work, we propose C-Trumpets -- conditional injective flows specifically designed for imaging problems, which greatly diminish these challenges. Injectivity reduces memory footprint and training time while low-dimensional latent space together with architectural innovations like fixed-volume-change layers and skip-connection revnet layers, C-Trumpets outperform regular conditional flow models on a variety of imaging and image restoration tasks, including limited-view CT and nonlinear inverse scattering, with a lower compute and memory budget. C-Trumpets enable fast approximation of point estimates like MMSE or MAP as well as physically-meaningful uncertainty quantification.


title: High-Order Enriched Finite Element Methods for Elliptic Interface Problems with Discontinuous Solutions

abstract: Elliptic interface problems whose solutions are $C^0$ continuous have been well studied over the past two decades. The well-known numerical methods include the strongly stable generalized finite element method (SGFEM) and immersed FEM (IFEM). In this paper, we study numerically a larger class of elliptic interface problems where their solutions are discontinuous. A direct application of these existing methods fails immediately as the approximate solution is in a larger space that covers discontinuous functions. We propose a class of high-order enriched unfitted FEMs to solve these problems with implicit or Robin-type interface jump conditions. We design new enrichment functions that capture the imposed discontinuity of the solution while keeping the condition number from fast growth. A linear enriched method in 1D was recently developed using one enrichment function and we generalized it to an arbitrary degree using two simple discontinuous one-sided enrichment functions. The natural tensor product extension to the 2D case is demonstrated. Optimal order convergence in the $L^2$ and broken $H^1$-norms are established. We also establish superconvergence at all discretization nodes (including exact nodal values in special cases). Numerical examples are provided to confirm the theory. Finally, to prove the efficiency of the method for practical problems, the enriched linear, quadratic, and cubic elements are applied to a multi-layer wall model for drug-eluting stents in which zero-flux jump conditions and implicit concentration interface conditions are both present.


title: Designing Creative AI Partners with COFI: A Framework for Modeling Interaction in Human-AI Co-Creative Systems

abstract: Human-AI co-creativity involves both humans and AI collaborating on a shared creative product as partners. In a creative collaboration, interaction dynamics, such as turn-taking, contribution type, and communication, are the driving forces of the co-creative process. Therefore the interaction model is a critical and essential component for effective co-creative systems. There is relatively little research about interaction design in the co-creativity field, which is reflected in a lack of focus on interaction design in many existing co-creative systems. The primary focus of co-creativity research has been on the abilities of the AI. This paper focuses on the importance of interaction design in co-creative systems with the development of the Co-Creative Framework for Interaction design (COFI) that describes the broad scope of possibilities for interaction design in co-creative systems. Researchers can use COFI for modeling interaction in co-creative systems by exploring alternatives in this design space of interaction. COFI can also be beneficial while investigating and interpreting the interaction design of existing co-creative systems. We coded a dataset of existing 92 co-creative systems using COFI and analyzed the data to show how COFI provides a basis to categorize the interaction models of existing co-creative systems. We identify opportunities to shift the focus of interaction models in co-creativity to enable more communication between the user and AI leading to human-AI partnerships.


title: Just Fine-tune Twice: Selective Differential Privacy for Large Language Models

abstract: Protecting large language models from privacy leakage is becoming increasingly crucial with their wide adoption in real-world products. Yet applying differential privacy (DP), a canonical notion with provable privacy guarantees for machine learning models, to those models remains challenging due to the trade-off between model utility and privacy loss. Utilizing the fact that sensitive information in language data tends to be sparse, Shi et al. (2021) formalized a DP notion extension called Selective Differential Privacy (SDP) to protect only the sensitive tokens defined by a policy function. However, their algorithm only works for RNN-based models. In this paper, we develop a novel framework, Just Fine-tune Twice (JFT), that achieves SDP for state-of-the-art large transformer-based models. Our method is easy to implement: it first fine-tunes the model with redacted in-domain data, and then fine-tunes it again with the original in-domain data using a private training mechanism. Furthermore, we study the scenario of imperfect implementation of policy functions that misses sensitive tokens and develop systematic methods to handle it. Experiments show that our method achieves strong utility compared to previous baselines. We also analyze the SDP privacy guarantee empirically with the canary insertion attack.


title: Induced Gravitational Waves from Multi-Sound Speed Resonances during Cosmological Inflation

abstract: We explore the possibility of multi-parametric resonances from time varying sound speed during cosmological inflation. In particular, we fix our set-up to the simpler case beyond a single oscillation model already explored in literature: two sinusoidal harmonics around a constant sound speed equal to one. We find that, within the perturbative regime, except for some certain extreme corners of the parameter space, the primordial density spectrum is characterized by two groups of amplified peaks centered around two critical oscillatory frequencies of the sound speed. As a general result, we show that the energy spectrum of the secondary induced GWs from the inflationary era has a single major broad peak, whereas the one from the radiation dominated phase consists of one/two principle peak-like configuration(s) for relatively small/large ratio of two oscillatory frequencies. The GW relic stochastic backgrounds carry a gravitational memory of the parametric resonances during inflation. GW signals from double sound speed resonances can be tested in complementary channels from Pulsar-timing radio-astronomy, space and terrestrial GW interferometers.


title: Investigating the Impact of Forgetting in Software Development

abstract: Context: Forgetting is defined as a gradual process of losing information. Even though there are many studies demonstrating the effect of forgetting in software development, to the best of our knowledge, no study explores the impact of forgetting in software development using a controlled experiment approach. Objective: We would like to provide insights on the impact of forgetting in software development projects. We want to examine whether the recency & frequency of interaction impact forgetting in software development. Methods: We will conduct an experiment that examines the impact of forgetting in software development. Participants will first do an initial task. According to their initial task performance, they will be assigned to either the experiment or the control group. The experiment group will then do two additional tasks to enhance their exposure to the code. Both groups will then do a final task to see if additional exposure to the code benefits the experiment group's performance in the final task. Finally, we will conduct a survey and a recall task with the same participants to collect data about their perceptions of forgetting and quantify their memory performance, respectively.


title: Twin-width can be exponential in treewidth

abstract: For any small positive real $\varepsilon$ and integer $t > \frac{1}{\varepsilon}$, we build a graph with a vertex deletion set of size $t$ to a tree, and twin-width greater than $2^{(1-\varepsilon) t}$. In particular, this shows that the twin-width is sometimes exponential in the treewidth, in the so-called oriented twin-width and grid number, and that adding an apex may multiply the twin-width by at least $2-\varepsilon$. Except for the one in oriented twin-width, these lower bounds are essentially tight.


title: Minimal induced subgraphs of the class of 2-connected non-Hamiltonian wheel-free graphs

abstract: Given a graph $G$ and a graph property $P$ we say that $G$ is minimal with respect to $P$ if no proper induced subgraph of $G$ has the property $P$. An HC-obstruction is a minimal 2-connected non-Hamiltonian graph. Given a graph $H$, a graph $G$ is $H$-free if $G$ has no induced subgraph isomorphic to $H$. The main motivation for this paper originates from a theorem of Duffus, Gould, and Jacobson (1981), which characterizes all the minimal connected graphs with no Hamiltonian path. In 1998, Brousek characterized all the claw-free HC-obstructions. On a similar note, Chiba and Furuya (2021), characterized all (not only the minimal) 2-connected non-Hamiltonian $\{K_{1,3}, N_{3,1,1}\}$-free graphs. Recently, Cheriyan, Hajebi, and two of us (2022), characterized all triangle-free HC-obstructions and all the HC-obstructions which are split graphs. A wheel is a graph obtained from a cycle by adding a new vertex with at least three neighbors in the cycle. In this paper we characterize all the HC-obstructions which are wheel-free graphs.


title: Abadie's Kappa and Weighting Estimators of the Local Average Treatment Effect

abstract: Recent research has demonstrated the importance of flexibly controlling for covariates in instrumental variables estimation. In this paper we study the finite sample and asymptotic properties of various weighting estimators of the local average treatment effect (LATE), motivated by Abadie's (2003) kappa theorem and offering the requisite flexibility relative to standard practice. We argue that two of the estimators under consideration, which are weight normalized, are generally preferable. Several other estimators, which are unnormalized, do not satisfy the properties of scale invariance with respect to the natural logarithm and translation invariance, thereby exhibiting sensitivity to the units of measurement when estimating the LATE in logs and the centering of the outcome variable more generally. We also demonstrate that, when noncompliance is one sided, certain weighting estimators have the advantage of being based on a denominator that is strictly greater than zero by construction. This is the case for only one of the two normalized estimators, and we recommend this estimator for wider use. We illustrate our findings with a simulation study and three empirical applications, which clearly document the sensitivity of unnormalized estimators to how the outcome variable is coded. We implement the proposed estimators in the Stata package kappalate.


title: Self-Similarity Priors: Neural Collages as Differentiable Fractal Representations

abstract: Many patterns in nature exhibit self-similarity: they can be compactly described via self-referential transformations. Said patterns commonly appear in natural and artificial objects, such as molecules, shorelines, galaxies and even images. In this work, we investigate the role of learning in the automated discovery of self-similarity and in its utilization for downstream tasks. To this end, we design a novel class of implicit operators, Neural Collages, which (1) represent data as the parameters of a self-referential, structured transformation, and (2) employ hypernetworks to amortize the cost of finding these parameters to a single forward pass. We investigate how to leverage the representations produced by Neural Collages in various tasks, including data compression and generation. Neural Collages image compressors are orders of magnitude faster than other self-similarity-based algorithms during encoding and offer compression rates competitive with implicit methods. Finally, we showcase applications of Neural Collages for fractal art and as deep generative models.


title: CILDA: Contrastive Data Augmentation using Intermediate Layer Knowledge Distillation

abstract: Knowledge distillation (KD) is an efficient framework for compressing large-scale pre-trained language models. Recent years have seen a surge of research aiming to improve KD by leveraging Contrastive Learning, Intermediate Layer Distillation, Data Augmentation, and Adversarial Training. In this work, we propose a learning based data augmentation technique tailored for knowledge distillation, called CILDA. To the best of our knowledge, this is the first time that intermediate layer representations of the main task are used in improving the quality of augmented samples. More precisely, we introduce an augmentation technique for KD based on intermediate layer matching using contrastive loss to improve masked adversarial data augmentation. CILDA outperforms existing state-of-the-art KD approaches on the GLUE benchmark, as well as in an out-of-domain evaluation.


title: MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation

abstract: Pre-trained language models have demonstrated superior performance in various natural language processing tasks. However, these models usually contain hundreds of millions of parameters, which limits their practicality because of latency requirements in real-world applications. Existing methods train small compressed models via knowledge distillation. However, performance of these small models drops significantly compared with the pre-trained models due to their reduced model capacity. We propose MoEBERT, which uses a Mixture-of-Experts structure to increase model capacity and inference speed. We initialize MoEBERT by adapting the feed-forward neural networks in a pre-trained model into multiple experts. As such, representation power of the pre-trained model is largely retained. During inference, only one of the experts is activated, such that speed can be improved. We also propose a layer-wise distillation method to train MoEBERT. We validate the efficiency and effectiveness of MoEBERT on natural language understanding and question answering tasks. Results show that the proposed method outperforms existing task-specific distillation algorithms. For example, our method outperforms previous approaches by over 2% on the MNLI (mismatched) dataset. Our code is publicly available at https://github.com/SimiaoZuo/MoEBERT.


title: Limit Theorems for Patterns in Ranked Tree-Child Networks

abstract: We prove limit laws for the number of occurrences of a pattern on the fringe of a ranked tree-child network which is picked uniformly at random. Our results extend the limit law for cherries proved by Bienvenu et al. (2022). For patterns of height $1$ and $2$, we show that they either occur frequently (mean is asymptotically linear and limit law is normal) or sporadically (mean is asymptotically constant and limit law is Poisson) or not all (mean tends to $0$ and limit law is degenerate). We expect that these are the only possible limit laws for any fringe pattern.


title: Astrometric Gravitational-Wave Detection via Stellar Interferometry

abstract: We evaluate the potential for gravitational-wave (GW) detection in the frequency band from 10 nHz to 1 $\mu$Hz using extremely high-precision astrometry of a small number of stars. In particular, we argue that non-magnetic, photometrically stable hot white dwarfs (WD) located at $\sim$ kpc distances may be optimal targets for this approach. Previous studies of astrometric GW detection have focused on the potential for less precise surveys of large numbers of stars; our work provides an alternative optimization approach to this problem. Interesting GW sources in this band are expected at characteristic strains around $h_c \sim 10^{-17} \times \left(\mu\text{Hz}/f_{\text{GW}}\right)$. The astrometric angular precision required to see these sources is $\Delta \theta \sim h_c$ after integrating for a time $T \sim 1/f_{\text{GW}}$. We show that jitter in the photometric center of WD of this type due to starspots is bounded to be small enough to permit this high-precision, small-$N$ approach. We discuss possible noise arising from stellar reflex motion induced by orbiting objects and show how it can be mitigated. The only plausible technology able to achieve the requisite astrometric precision is a space-based stellar interferometer. Such a future mission with few-meter-scale collecting dishes and baselines of $\mathcal{O}(100\text{ km})$ is sufficient to achieve the target precision. This collector size is broadly in line with the collectors proposed for some formation-flown, space-based astrometer or optical synthetic-aperture imaging-array concepts proposed for other science reasons. The proposed baseline is however somewhat larger than the km-scale baselines discussed for those concepts, but we see no fundamental technical obstacle to utilizing such baselines. A mission of this type thus also holds the promise of being one of the few ways to access interesting GW sources in this band.


title: Host movement, transmission hot spots, and vector-borne disease dynamics on spatial networks

abstract: We examine how spatial heterogeneity combines with mobility network structure to influence vector-borne disease dynamics. Specifically, we consider a Ross-Macdonald-type disease model on $n$ spatial locations that are coupled by host movement on a strongly connected, weighted, directed graph. We derive a closed form approximation to the domain reproduction number using a Laurent series expansion, and use this approximation to compute sensitivities of the basic reproduction number to model parameters. To illustrate how these results can be used to help inform mitigation strategies, as a case study we apply these results to malaria dynamics in Namibia, using published cell phone data and estimates for local disease transmission. Our analytical results are particularly useful for understanding drivers of transmission when mobility sinks and transmission hot spots do not coincide.


title: DialAug: Mixing up Dialogue Contexts in Contrastive Learning for Robust Conversational Modeling

abstract: Retrieval-based conversational systems learn to rank response candidates for a given dialogue context by computing the similarity between their vector representations. However, training on a single textual form of the multi-turn context limits the ability of a model to learn representations that generalize to natural perturbations seen during inference. In this paper we propose a framework that incorporates augmented versions of a dialogue context into the learning objective. We utilize contrastive learning as an auxiliary objective to learn robust dialogue context representations that are invariant to perturbations injected through the augmentation method. We experiment with four benchmark dialogue datasets and demonstrate that our framework combines well with existing augmentation methods and can significantly improve over baseline BERT-based ranking architectures. Furthermore, we propose a novel data augmentation method, ConMix, that adds token level perturbations through stochastic mixing of tokens from other contexts in the batch. We show that our proposed augmentation method outperforms previous data augmentation approaches, and provides dialogue representations that are more robust to common perturbations seen during inference.


title: Sequential discretisation schemes for a class of stochastic differential equations and their application to Bayesian filtering

abstract: We introduce a predictor-corrector discretisation scheme for the numerical integration of a class of stochastic differential equations and prove that it converges with weak order 1.0. The key feature of the new scheme is that it builds up sequentially (and recursively) in the dimension of the state space of the solution, hence making it suitable for approximations of high-dimensional state space models. We show, using the stochastic Lorenz 96 system as a test model, that the proposed method can operate with larger time steps than the standard Euler-Maruyama scheme and, therefore, generate valid approximations with a smaller computational cost. We also introduce the theoretical analysis of the error incurred by the new predictor-corrector scheme when used as a building block for discrete-time Bayesian filters for continuous-time systems. Finally, we assess the performance of several ensemble Kalman filters that incorporate the proposed sequential predictor-corrector Euler scheme and the standard Euler-Maruyama method. The numerical experiments show that the filters employing the new sequential scheme can operate with larger time steps, smaller Monte Carlo ensembles and noisier systems.


title: Dust dynamics in RAMSES -- I. Methods and turbulent acceleration

abstract: Supernova ejecta and stellar winds are believed to produce interstellar dust grains with relatively large sizes. Smaller grains can be produced via the shattering of large grains that have been stochastically accelerated. To understand this stochastic acceleration, we have implemented novel magnetohydrodynamic(MHD)-particle-in-cell(PIC) methods into the astrophysical fluid code RAMSES. We treat dust grains as a set of massive ``superparticles'' that experience aerodynamic drag and Lorentz force. We subject our code to a range of numerical tests designed to validate our method in different physical conditions, as well as to illustrate possible mechanisms by which grains can be accelerated. As a final test as well as a foundation for future work, we present the results of decaying dusty MHD turbulence simulations with grain parameters chosen to resemble 1-2 $\mu$m grains in typical cold neutral medium conditions. We find that in these conditions, these grains can be effectively accelerated to well beyond their shattering velocities. This is true for both electrically charged and neutral grains. While the peak of the gas-grain relative drift velocity distribution is higher for neutral grains, the drift velocity distribution of charged grains exhibits an extended exponential tail out to much greater velocities. Even so, the shapes of the distributions are such that the extra gas-grain coupling provided by the Lorentz force offers grains relative protection from shattering. We also discuss the connection between our simulations and the relatively pristine ~$\mu$m sized presolar grains that do not appear to have undergone significant wear in their lifetimes.


title: Reliability Evaluation of Individual Predictions: A Data-centric Approach

abstract: Machine learning models only provide probabilistic guarantees on the expected loss of random samples from the distribution represented by their training data. As a result, a model with high accuracy, may or may not be reliable for predicting an individual query point. To address this issue, XAI aims to provide explanations of individual predictions, while approaches such as conformal predictions, probabilistic predictions, and prediction intervals count on the model's certainty in its prediction to identify unreliable cases. Conversely, instead of relying on the model itself, we look for insights in the training data. That is, following the fact a model's performance is limited to the data it has been trained on, we ask "is a model trained on a given data set, fit for making a specific prediction?". Specifically, we argue that a model's prediction is not reliable if (i) there were not enough similar instances in the training set to the query point, and (ii) if there is a high fluctuation (uncertainty) in the vicinity of the query point in the training set. Using these two observations, we propose data-centric reliability measures for individual predictions and develop novel algorithms for efficient and effective computation of the reliability measures during inference time. The proposed algorithms learn the necessary components of the measures from the data itself and are sublinear, which makes them scalable to very large and multi-dimensional settings. Furthermore, an estimator is designed to enable no-data access during the inference time. We conduct extensive experiments using multiple real and synthetic data sets and different tasks, which reflect a consistent correlation between distrust values and model performance.


title: Safe Self-Refinement for Transformer-based Domain Adaptation

abstract: Unsupervised Domain Adaptation (UDA) aims to leverage a label-rich source domain to solve tasks on a related unlabeled target domain. It is a challenging problem especially when a large domain gap lies between the source and target domains. In this paper we propose a novel solution named SSRT (Safe Self-Refinement for Transformer-based domain adaptation), which brings improvement from two aspects. First, encouraged by the success of vision transformers in various vision tasks, we arm SSRT with a transformer backbone. We find that the combination of vision transformer with simple adversarial adaptation surpasses best reported Convolutional Neural Network (CNN)-based results on the challenging DomainNet benchmark, showing its strong transferable feature representation. Second, to reduce the risk of model collapse and improve the effectiveness of knowledge transfer between domains with large gaps, we propose a Safe Self-Refinement strategy. Specifically, SSRT utilizes predictions of perturbed target domain data to refine the model. Since the model capacity of vision transformer is large and predictions in such challenging tasks can be noisy, a safe training mechanism is designed to adaptively adjust learning configuration. Extensive evaluations are conducted on several widely tested UDA benchmarks and SSRT achieves consistently the best performances, including 85.43% on Office-Home, 88.76% on VisDA-2017 and 45.2% on DomainNet.


title: Circuit-theoretic Line Outage Distribution Factor

abstract: This work presents the design of AC line outage distribution factor created from the circuit-theoretic power flow models. Experiment results are shown to demonstrate its efficacy in quantifying the impact of line outages on the grid, and its resulting potential for fast contingency screening.


title: Stable submanifolds in the product of projective spaces II

abstract: We prove that there do not exist odd-dimensional stable compact minimal immersions in the product of two complex projective spaces. We also prove that the only stable compact minimal immersions in the product of a quaternionic projective space with any other Riemannian manifold are the products of quaternionic projective subspaces with compact stable minimal immersions of the second manifold in the Riemmanian product. These generalize similar results of the second-named author of immersions with low dimensions or codimensions to immersions with arbitrary dimensions. In addition, we prove that the only stable compact minimal immersions in the product of a octonionic projective plane with any other Riemannian manifold are the products of octonionic projective subspaces with compact stable minimal immersions of the second manifold in the Riemmanian product.


title: Homonuclear J-Coupling Spectroscopy using J-Synchronized Echo Detection

abstract: In the strong coupling regime with J-coupling much larger than chemical shift differences, J-coupling spectroscopy enables spectral identification of molecules even when conventional NMR fails. While this classically required the presence of a heteronucleus, we recently showed that J-coupling spectra can be acquired in many homonuclear systems using spin-lock induced crossing (SLIC). Here, we present an alternative method using a spin echo train in lieu of a spin-locking SLIC pulse, which has a number of advantages. In particular, spin echo acquisition within the pulse train enables simultaneous collection of time and frequency data. The resulting 2D spectrum can be used to study dynamic spin evolution, and the time domain data can be averaged to create a 1D J-coupling spectrum with increased signal-to-noise ratio.


title: LO-mode phonon of KCl and NaCl at 300 K by inelastic X ray scattering measurements and first principles calculations

abstract: Longitudinal-optical (LO) mode phonon branches of KCl and NaCl were measured using inelastic X-ray scattering (IXS) at 300 K and calculated by the first-principles phonon calculation with the stochastic self-consistent harmonic approximation. Spectral shapes of the IXS measurements and calculated spectral functions agreed well. We analyzed the calculated spectral functions that provide higher resolutions of the spectra than the IXS measurements. Due to strong anharmonicity, the spectral functions of these phonon branches have several peaks and the LO modes along $\Gamma$--L paths are disconnected.


title: Relative accelerations characterize the hydrodynamic interaction of cloud droplets

abstract: Water droplets coalesce into larger ones in atmospheric clouds to form rain. But droplets on collision courses do not always coalesce due to the cushioning effects of the air between them. The extent to which these so-called hydrodynamic interactions reduce coalescence rates is embodied in the collision efficiency, which is often small and is not generally known. In order to characterize the mechanisms that determine the collision efficiency, we exploited new time-resolved three-dimensional droplet tracking techniques to measure the positions of cloud droplet pairs settling through quiescent air. We did so with an unprecedented precision that enabled us to calculate the relative positions, velocities, and accelerations of the droplets at droplet surface-to-surface separations as small as about one-tenth of a droplet diameter. We show that relative accelerations clearly distinguish coalescing from non-coalescing droplet trajectories, the former being associated with relative accelerations that exceeded a threshold value. We outline how relative accelerations relate to hydrodynamic interactions, and present scaling arguments that predict the threshold relative acceleration. We speculate that the relative acceleration distribution of droplets in turbulent clouds can parameterize the collision efficiency, and that this distribution together with the well-known relative position and velocity distributions can generate a physical description of both the collision and coalescence rates of cloud droplets.


title: Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners

abstract: Traditional multi-task learning (MTL) methods use dense networks that use the same set of shared weights across several different tasks. This often creates interference where two or more tasks compete to pull model parameters in different directions. In this work, we study whether sparsely activated Mixture-of-Experts (MoE) improve multi-task learning by specializing some weights for learning shared representations and using the others for learning task-specific information. To this end, we devise task-aware gating functions to route examples from different tasks to specialized experts which share subsets of network weights conditioned on the task. This results in a sparsely activated multi-task model with a large number of parameters, but with the same computational cost as that of a dense model. We demonstrate such sparse networks to improve multi-task learning along three key dimensions: (i) transfer to low-resource tasks from related tasks in the training mixture; (ii) sample-efficient generalization to tasks not seen during training by making use of task-aware routing from seen related tasks; (iii) robustness to the addition of unrelated tasks by avoiding catastrophic forgetting of existing tasks.


title: Optimal H\"older Regularity of Solution Operator to the $\bar\partial$-equation on Product Domains

abstract: This note seeks to prove the existence of a canonical solution operator to the $\bar\partial$-equation that preserves H\"older regularity on product domains. It is a well known fact that such solution operators do not in general gain H\"older regularity, and as such, our solution operator is optimal in this regard.


title: Unification of Mixed Hilbert-Space Representations in Condensed Matter Physics and Quantum Field Theory

abstract: We present a unification of mixed-space quantum representations in Condensed Matter Physics (CMP) and Quantum Field Theory (QFT). The unifying formalism is based on being able to expand any quantum operator, for bosons, fermions, and spin systems, using a universal basis operator Y(u,v) involving mixed Hilbert spaces of P and Q, respectively, where P and Q are momentum and position operators in CMP (which can be considered as a bozonization of free Bloch electrons which incorporates the Pauli exclusion principle and Fermi-Dirac distribution), whereas these are related to the creation and annihilation operators in QFT, where {\psi}^{{\dag}}=-iP and {\psi}=Q. The expansion coefficient is the Fourier transform of the Wigner quantum distribution function (lattice Weyl transform) otherwise known as the characteristic distribution function. Thus, in principle, fermionization via Jordan-Wigner for spin systems, as well as the Holstein--Primakoff transformation from boson to the spin operators can be performed depending on the ease of the calculations. Unitary transformation on the creation and annihilation operators themselves is also employed, as exemplified by the Bogoliubov transformation. Moreover, whenever Y(u,v) is already expressed in matrix form, M_{ij}, e.g. the Pauli spin matrices, the Jordan--Schwinger transformation is a map to bilinear expressions of creation and annihilation operators which expedites computation of representations. We show that the well-known coherent states formulation of quantum physics is a special case of the present unification. A new formulation of QFT based on Q-distribution of functional-field variables is suggested. The case of nonequilibrium quantum transport physics, which not only involves non-Hermitian operators but also time-reversal symmetry breaking, is discussed in the Appendix.


title: FedVQCS: Federated Learning via Vector Quantized Compressed Sensing

abstract: In this paper, a new communication-efficient federated learning (FL) framework is proposed, inspired by vector quantized compressed sensing. The basic strategy of the proposed framework is to compress the local model update at each device by applying dimensionality reduction followed by vector quantization. Subsequently, the global model update is reconstructed at a parameter server by applying a sparse signal recovery algorithm to the aggregation of the compressed local model updates. By harnessing the benefits of both dimensionality reduction and vector quantization, the proposed framework effectively reduces the communication overhead of local update transmissions. Both the design of the vector quantizer and the key parameters for the compression are optimized so as to minimize the reconstruction error of the global model update under the constraint of wireless link capacity. By considering the reconstruction error, the convergence rate of the proposed framework is also analyzed for a non-convex loss function. Simulation results on the MNIST and FEMNIST datasets demonstrate that the proposed framework provides more than a 2.4% increase in classification accuracy compared to state-of-the-art FL frameworks when the communication overhead of the local model update transmission is 0.1 bit per local model entry.


title: Calibrating Trust of Multi-Hop Question Answering Systems with Decompositional Probes

abstract: Multi-hop Question Answering (QA) is a challenging task since it requires an accurate aggregation of information from multiple context paragraphs and a thorough understanding of the underlying reasoning chains. Recent work in multi-hop QA has shown that performance can be boosted by first decomposing the questions into simpler, single-hop questions. In this paper, we explore one additional utility of the multi-hop decomposition from the perspective of explainable NLP: to create explanation by probing a neural QA model with them. We hypothesize that in doing so, users will be better able to predict when the underlying QA system will give the correct answer. Through human participant studies, we verify that exposing the decomposition probes and answers to the probes to users can increase their ability to predict system performance on a question instance basis. We show that decomposition is an effective form of probing QA systems as well as a promising approach to explanation generation. In-depth analyses show the need for improvements in decomposition systems.


title: Sandwiched Renyi Relative Entropy in AdS/CFT

abstract: We explore the role of sandwiched Renyi relative entropy in AdS/CFT and in finite-dimensional models of holographic quantum error correction. In particular, in the context of operator algebra quantum error correction, we discuss a suitable generalization of sandwiched Renyi relative entropy over finite-dimensional von Neumann algebras. It is then shown that the equality of bulk and boundary sandwiched relative Renyi entropies is equivalent to algebraic encoding of bulk and boundary states, the Ryu-Takayanagi formula, the equality of bulk and boundary relative entropy, and subregion duality. This adds another item to an equivalence theorem between the last four items established in arxiv:1607.03901. We then discuss the sandwiched Renyi relative entropy defined in terms of modular operators, and show that this becomes the definition naturally suited to the finite-dimensional models of holographic quantum error correction. Finally, we explore some numerical calculations of sandwiched Renyi relative entropies for a simple holographic random tensor network in order to obtain a better understanding of corrections to the exact equality of bulk and boundary sandwiched relative Renyi entropy.