title: QFT in Curved Spacetime from Quantum Gravity: proper WKB decomposition of the gravitational component

abstract: Starting from a re-analysis of previous work, we construct the proper low energy quantum field theory (QFT) limit of a full quantum gravity theory in the Born-Oppenheimer approach. We separate the gravitational sector into a classical background, given by a vacuum diagonal Bianchi I cosmology, and its quantum perturbations represented by the two graviton degrees of freedom; we further include quantum matter in the form of a test scalar field. We then implement a Born-Oppenheimer separation, where the gravitons and matter play the role of "slow" and "fast" quantum components respectively, and perform a Wentzel-Kramers-Brillouin (WKB) expansion in a Planckian parameter. The functional Schr\"odinger evolution for matter is recovered after averaging over quantum gravitational effects, provided that a condition is imposed on the gravitons' wave functional. Such a condition fixes the graviton dynamics and is equivalent to the purely gravitational Wheeler-DeWitt constraint imposed in previous approaches. The main accomplishment of the present work is to clarify that QFT in curved spacetime can be recovered in the low energy limit of quantum gravity only after averaging over the graviton degrees of freedom, in the spirit of effective field theory. Furthermore, it justifies a posteriori the implementation of the gravitational Wheeler-DeWitt equation on the "slow" gravitons' wave functional rather than assuming its validity a priori.


title: Imaging exoplanets with coronagraphic instruments

abstract: Exoplanetary science is a very active field of astronomy nowadays, with questions still opened such as how planetary systems form and evolve (occurrence, process), why such a diversity of exoplanets is observed (mass, radius, orbital parameters, temperature, composition), and what are the interactions between planets, circumstellar disk and their host star. Several complementary methods are used for the detection of exoplanets. Among these, imaging aims at the direct detection of the light reflected, scattered or emitted by exoplanets and circumstellar disks. This allows their spectral and polarimetric characterization. Such imaging remains challenging because of the large luminosity ratio (1e4-1e10$) and the small angular separation (fraction of an arcsecond) between the star and its environment. Over the past two decades, numerous techniques, including coronagraphy, have been developed to make exoplanet imaging a reality. This review gives a broad overview of the subsystems that make up a coronagraphic instrument for imaging exoplanetary systems. It is especially intended for non-specialists or newcomers in the field. We explain the principle of coronagraphy and propose a formalism to understand their behavior. We discuss the impact of wavefront aberrations on the performance of coronagraphs and how they induce stellar speckles in the scientific image. Finally, we present instrumental and signal processing techniques used for on-sky minimization or a posteriori calibration of these speckles in order to improve the performance of coronagraphs.


title: Weakly Supervised Temporal Convolutional Networks for Fine-grained Surgical Activity Recognition

abstract: Automatic recognition of fine-grained surgical activities, called steps, is a challenging but crucial task for intelligent intra-operative computer assistance. The development of current vision-based activity recognition methods relies heavily on a high volume of manually annotated data. This data is difficult and time-consuming to generate and requires domain-specific knowledge. In this work, we propose to use coarser and easier-to-annotate activity labels, namely phases, as weak supervision to learn step recognition with fewer step annotated videos. We introduce a step-phase dependency loss to exploit the weak supervision signal. We then employ a Single-Stage Temporal Convolutional Network (SS-TCN) with a ResNet-50 backbone, trained in an end-to-end fashion from weakly annotated videos, for temporal activity segmentation and recognition. We extensively evaluate and show the effectiveness of the proposed method on a large video dataset consisting of 40 laparoscopic gastric bypass procedures and the public benchmark CATARACTS containing 50 cataract surgeries.


title: A General-Purpose Transferable Predictor for Neural Architecture Search

abstract: Understanding and modelling the performance of neural architectures is key to Neural Architecture Search (NAS). Performance predictors have seen widespread use in low-cost NAS and achieve high ranking correlations between predicted and ground truth performance in several NAS benchmarks. However, existing predictors are often designed based on network encodings specific to a predefined search space and are therefore not generalizable to other search spaces or new architecture families. In this paper, we propose a general-purpose neural predictor for NAS that can transfer across search spaces, by representing any given candidate Convolutional Neural Network (CNN) with a Computation Graph (CG) that consists of primitive operators. We further combine our CG network representation with Contrastive Learning (CL) and propose a graph representation learning procedure that leverages the structural information of unlabeled architectures from multiple families to train CG embeddings for our performance predictor. Experimental results on NAS-Bench-101, 201 and 301 demonstrate the efficacy of our scheme as we achieve strong positive Spearman Rank Correlation Coefficient (SRCC) on every search space, outperforming several Zero-Cost Proxies, including Synflow and Jacov, which are also generalizable predictors across search spaces. Moreover, when using our proposed general-purpose predictor in an evolutionary neural architecture search algorithm, we can find high-performance architectures on NAS-Bench-101 and find a MobileNetV3 architecture that attains 79.2% top-1 accuracy on ImageNet.


title: nlive: an R Package to facilitate the application of the sigmoidal and random changepoint mixed models

abstract: Background: The use of mixed effect models with a specific functional form such as the Sigmoidal Mixed Model and the Piecewise Mixed Model (or Changepoint Mixed Model) with abrupt or smooth random change allows the interpretation of the defined parameters to understand longitudinal trajectories. Currently, there are no interface R packages that can easily fit the Sigmoidal Mixed Model allowing the inclusion of covariates or incorporating recent developments to fit the Piecewise Mixed Model with random change. Results: To facilitate the modeling of the Sigmoidal Mixed Model, and Piecewise Mixed Model with abrupt or smooth random change, we have created an R package called nlive. All needed pieces such as functions, covariance matrices, and initials generation were programmed. The package was implemented with recent developments such as the polynomial smooth transition of the piecewise mixed model with improved properties over Bacon-Watts, and the stochastic approximation expectation-maximization (SAEM) for efficient estimation. It was designed to help interpretation of the output by providing features such as annotated output, warnings, and graphs. Functionality, including time and convergence, was tested using simulations. We provided a data example to illustrate the package use and output features and interpretation. The package implemented in the R software is available from the Comprehensive R Archive Network (CRAN) at https://CRAN.R-project.org/package=nlive. Conclusions: The nlive package for R fits the Sigmoidal Mixed Model and the Piecewise Mixed: abrupt and smooth. The nlive allows fitting these models with only five mandatory arguments that are intuitive enough to the less sophisticated users.


title: Performant feature extraction for photometric time series

abstract: Astronomy is entering the era of large surveys of the variable sky such as Zwicky Transient Facility (ZTF) and the forthcoming Legacy Survey of Space and Time (LSST) which are intended to produce up to a million alerts per night. Such an amount of photometric data requires efficient light-curve pre-processing algorithms for the purposes of subsequent data quality cuts, classification, and characterization analysis. In this work, we present the new library "light-curve" for Python and Rust, which is intended for feature extraction from light curves of variable astronomical sources. The library is suitable for machine learning classification problems: it provides a fast implementation of feature extractors, which outperforms other public available codes, and consists of dozens features describing shape, magnitude distribution, and periodic properties of light curves. It includes not only features which had been shown to provide a high performance in classification tasks, but also new features we developed to improve classification quality of selected types of objects. The "light-curve" library is currently used by the ANTARES, AMPEL, and Fink broker systems for analyzing the ZTF alert stream, and has been selected for use with the LSST.


title: A 2:1 Mean-Motion Resonance Super-Jovian pair revealed by TESS, FEROS, and HARPS

abstract: We report the discovery of a super-Jovian 2:1 mean-motion resonance (MMR) pair around the G-type star TIC 279401253, whose dynamical architecture is a prospective benchmark for planet formation and orbital evolution analysis. The system was discovered thanks to a single transit event recorded by the Transiting Exoplanet Survey Satellite (TESS) mission, which pointed to a Jupiter-sized companion with poorly constrained orbital parameters. We began ground-based precise radial velocity (RV) monitoring with HARPS and FEROS within the Warm gIaNts with tEss (WINE) survey to constrain the transiting body's period, mass, and eccentricity. The RV measurements revealed not one but two massive planets with periods of 76.80$_{-0.06}^{+0.06}$ days and 155.3$_{-0.7}^{+0.7}$ days, respectively. A combined analysis of transit and RV data yields an inner transiting planet with a mass of 6.14$_{-0.42}^{+0.39}$ M$_{\rm Jup}$ and a radius of 1.00$_{-0.04}^{+0.04}$ R$_{\rm Jup}$, and an outer planet with a minimum mass of 8.02$_{-0.18}^{+0.18}$ M$_{\rm Jup}$, indicating a massive giant pair. A detailed dynamical analysis of the system reveals that the planets are locked in a strong first-order, eccentricity-type 2:1 MMR, which makes TIC 279401253 one of the rare examples of truly resonant architectures supporting disk-induced planet migration. The bright host star, $V \approx$ 11.9 mag, the relatively short orbital period ($P_{\rm b}$ = 76.80$_{-0.06}^{+0.06}$ d) and pronounced eccentricity (e =0.448$_{-0.029}^{+0.028}$) make the transiting planet a valuable target for atmospheric investigation with the James Webb Space Telescope (JWST) and ground-based extremely-large telescopes.


title: Inclusion relations among fractional Orlicz-Sobolev spaces and a Littlewood-Paley characterization

abstract: Embeddings among fractional Orlicz-Sobolev spaces with different smoothness are characterized. The equivalence of their Gagliardo-Slobodeckij norms to norms defined via Littlewood-Paley decompostions, via oscillations, or via Besov type difference quotients is also established. These equivalences, of independent interest, are a key tool in the proof of the relevant embeddings. They also rest upon a new optimal inequality for convolutions in Orlicz spaces.


title: Valid Inference for Machine Learning Model Parameters

abstract: The parameters of a machine learning model are typically learned by minimizing a loss function on a set of training data. However, this can come with the risk of overtraining; in order for the model to generalize well, it is of great importance that we are able to find the optimal parameter for the model on the entire population -- not only on the given training sample. In this paper, we construct valid confidence sets for this optimal parameter of a machine learning model, which can be generated using only the training data without any knowledge of the population. We then show that studying the distribution of this confidence set allows us to assign a notion of confidence to arbitrary regions of the parameter space, and we demonstrate that this distribution can be well-approximated using bootstrapping techniques.


title: The Power of an Adversary in Glauber Dynamics

abstract: Glauber dynamics are a natural model of dynamics of dependent systems. While originally introduced in statistical physics, they have found important applications in the study of social networks, computer vision and other domains. In this work, we introduce a model of corrupted Glauber dynamics whereby instead of updating according to the prescribed conditional probabilities, some of the vertices and their updates are controlled by an adversary. We study the effect of such corruptions on global features of the system. Among the questions we study are: How many nodes need to be controlled in order to change the average statistics of the system in polynomial time? And how many nodes are needed to obstruct approximate convergence of the dynamics? Our results can be viewed as studying the robustness of classical sampling methods and are thus related to robust inference. The proofs connect to classical theory of Glauber dynamics from statistical physics.


title: DSL-Assembly: A Robust and Safe Assembly Strategy

abstract: A reinforcement learning (RL) based method that enables the robot to accomplish the assembly-type task with safety regulations is proposed. The overall strategy consists of grasping and assembly, and this paper mainly considers the assembly strategy. Force feedback is used instead of visual feedback to perceive the shape and direction of the hole in this paper. Furthermore, since the emergency stop is triggered when the force output is too large, a force-based dynamic safety lock (DSL) is proposed to limit the pressing force of the robot. Finally, we train and test the robot model with a simulator and build ablation experiments to illustrate the effectiveness of our method. The models are independently tested 500 times in the simulator, and we get an 88.57% success rate with a 4mm gap. These models are transferred to the real world and deployed on a real robot. We conducted independent tests and obtained a 79.63% success rate with a 4mm gap. Simulation environments: https://github.com/0707yiliu/peg-in-hole-with-RL.


title: Polarization Imaging of Back-Scattered Terahertz Speckle Fields

abstract: Speckle patterns observed in coherent optical imaging reflect important characteristic information of the scattering object. To capture speckle patterns, angular resolved or oblique illumination geometries are usually employed in combination with Rayleigh statistical models. We present a portable and handheld 2-channel polarization-sensitive imaging instrument to directly resolve terahertz (THz) speckle fields in a collocated telecentric back-scattering geometry. The polarization state of the THz light is measured using two orthogonal photoconductive antennas and can be presented in the form of the Stokes vectors of the THz beam upon interaction with the sample. We report on the validation of the method in surface scattering from gold-coated sandpapers, demonstrating a strong dependence of the polarization state on the surface roughness and the frequency of the broadband THz illumination. We also demonstrate non-Rayleigh first-order and second-order statistical parameters, such as degree of polarization uniformity (DOPU) and phase difference, for quantifying the randomness of polarization. This technique provides a fast method for broadband THz polarimetric measurement in the field and has the potential for detecting light depolarization in applications ranging from biomedical imaging to non-destructive testing.


title: Robust Mean Estimation Without Moments for Symmetric Distributions

abstract: We study the problem of robustly estimating the mean or location parameter without moment assumptions. We show that for a large class of symmetric distributions, the same error as in the Gaussian setting can be achieved efficiently. The distributions we study include products of arbitrary symmetric one-dimensional distributions, such as product Cauchy distributions, as well as elliptical distributions. For product distributions and elliptical distributions with known scatter (covariance) matrix, we show that given an $\varepsilon$-corrupted sample, we can with probability at least $1-\delta$ estimate its location up to error $O(\varepsilon \sqrt{\log(1/\varepsilon)})$ using $\tfrac{d\log(d) + \log(1/\delta)}{\varepsilon^2 \log(1/\varepsilon)}$ samples. This result matches the best-known guarantees for the Gaussian distribution and known SQ lower bounds (up to the $\log(d)$ factor). For elliptical distributions with unknown scatter (covariance) matrix, we propose a sequence of efficient algorithms that approaches this optimal error. Specifically, for every $k \in \mathbb{N}$, we design an estimator using time and samples $\tilde{O}({d^k})$ achieving error $O(\varepsilon^{1-\frac{1}{2k}})$. This matches the error and running time guarantees when assuming certifiably bounded moments of order up to $k$. For unknown covariance, such error bounds of $o(\sqrt{\varepsilon})$ are not even known for (general) sub-Gaussian distributions. Our algorithms are based on a generalization of the well-known filtering technique. We show how this machinery can be combined with Huber-loss-based techniques to work with projections of the noise that behave more nicely than the initial noise. Moreover, we show how SoS proofs can be used to obtain algorithmic guarantees even for distributions without a first moment. We believe that this approach may find other applications in future works.


title: TherapyView: Visualizing Therapy Sessions with Temporal Topic Modeling and AI-Generated Arts

abstract: We present the TherapyView, a demonstration system to help therapists visualize the dynamic contents of past treatment sessions, enabled by the state-of-the-art neural topic modeling techniques to analyze the topical tendencies of various psychiatric conditions and deep learning-based image generation engine to provide a visual summary. The system incorporates temporal modeling to provide a time-series representation of topic similarities at a turn-level resolution and AI-generated artworks given the dialogue segments to provide a concise representations of the contents covered in the session, offering interpretable insights for therapists to optimize their strategies and enhance the effectiveness of psychotherapy. This system provides a proof of concept of AI-augmented therapy tools with e in-depth understanding of the patient's mental state and enabling more effective treatment.


title: Probabilistic Risk Assessment for Chance-Constrained Collision Avoidance in Uncertain Dynamic Environments

abstract: Balancing safety and efficiency when planning in crowded scenarios with uncertain dynamics is challenging where it is imperative to accomplish the robot's mission without incurring any safety violations. Typically, chance constraints are incorporated into the planning problem to provide probabilistic safety guarantees by imposing an upper bound on the collision probability of the planned trajectory. Yet, this results in overly conservative behavior on the grounds that the gap between the obtained risk and the specified upper limit is not explicitly restricted. To address this issue, we propose a real-time capable approach to quantify the risk associated with planned trajectories obtained from multiple probabilistic planners, running in parallel, with different upper bounds of the acceptable risk level. Based on the evaluated risk, the least conservative plan is selected provided that its associated risk is below a specified threshold. In such a way, the proposed approach provides probabilistic safety guarantees by attaining a closer bound to the specified risk, while being applicable to generic uncertainties of moving obstacles. We demonstrate the efficiency of our proposed approach, by improving the performance of a state-of-the-art probabilistic planner, in simulations and experiments using a mobile robot in an environment shared with humans.


title: There Are No Post-Quantum Weakly Pseudo-Free Families in Any Nontrivial Variety of Expanded Groups

abstract: Let $\Omega$ be a finite set of finitary operation symbols and let $\mathfrak V$ be a nontrivial variety of $\Omega$-algebras. Assume that for some set $\Gamma\subseteq\Omega$ of group operation symbols, all $\Omega$-algebras in $\mathfrak V$ are groups under the operations associated with the symbols in $\Gamma$. In other words, $\mathfrak V$ is assumed to be a nontrivial variety of expanded groups. In particular, $\mathfrak V$ can be a nontrivial variety of groups or rings. Our main result is that there are no post-quantum weakly pseudo-free families in $\mathfrak V$, even in the worst-case setting and/or the black-box model. In this paper, we restrict ourselves to families $(H_d\mathbin|d\in D)$ of computational and black-box $\Omega$-algebras (where $D\subseteq\{0,1\}^*$) such that for every $d\in D$, each element of $H_d$ is represented by a unique bit string of length polynomial in the length of $d$. We use straight-line programs to represent nontrivial relations between elements of $\Omega$-algebras in our main result. Note that under certain conditions, this result depends on the classification of finite simple groups. Also, we define and study some types of weak pseudo-freeness for families of computational and black-box $\Omega$-algebras.


title: Deep reinforced learning heuristic tested on spin-glass ground states: The larger picture

abstract: In Changjun Fan et al. [Nature Communications https://doi.org/10.1038/s41467-023-36363-w (2023)], the authors present a deep reinforced learning approach to augment combinatorial optimization heuristics. In particular, they present results for several spin glass ground state problems, for which instances on non-planar networks are generally NP-hard, in comparison with several Monte Carlo based methods, such as simulated annealing (SA) or parallel tempering (PT). Indeed, those results demonstrate that the reinforced learning improves the results over those obtained with SA or PT, or at least allows for reduced runtimes for the heuristics before results of comparable quality have been obtained relative to those other methods. To facilitate the conclusion that their method is ''superior'', the authors pursue two basic strategies: (1) A commercial GUROBI solver is called on to procure a sample of exact ground states as a testbed to compare with, and (2) a head-to-head comparison between the heuristics is given for a sample of larger instances where exact ground states are hard to ascertain. Here, we put these studies into a larger context, showing that the claimed superiority is at best marginal for smaller samples and becomes essentially irrelevant with respect to any sensible approximation of true ground states in the larger samples. For example, this method becomes irrelevant as a means to determine stiffness exponents $\theta$ in $d>2$, as mentioned by the authors, where the problem is not only NP-hard but requires the subtraction of two almost equal ground-state energies and systemic errors in each of $\approx 1\%$ found here are unacceptable. This larger picture on the method arises from a straightforward finite-size corrections study over the spin glass ensembles the authors employ, using data that has been available for decades.

categories: cond-mat.dis-nn cond-mat.stat-mech cs.AI cs.LG


title: Io's Optical Aurorae in Jupiter's Shadow

abstract: Decline and recovery timescales surrounding eclipse are indicative of the controlling physical processes in Io's atmosphere. Recent studies have established that the majority of Io's molecular atmosphere, SO2 and SO, condenses during its passage through Jupiter's shadow. The eclipse response of Io's atomic atmosphere is less certain, having been characterized solely by ultraviolet aurorae. Here we explore the response of optical aurorae for the first time. We find oxygen to be indifferent to the changing illumination, with [O I] brightness merely tracking the plasma density at Io's position in the torus. In shadow, line ratios confirm sparse SO2 coverage relative to O, since their collisions would otherwise quench the emission. Io's sodium aurora mostly disappears in eclipse and e-folding timescales, for decline and recovery differ sharply: ~10 minutes at ingress and nearly 2 hr at egress. Only ion chemistry can produce such a disparity; Io's molecular ionosphere is weaker at egress due to rapid recombination. Interruption of a NaCl+ photochemical pathway best explains Na behavior surrounding eclipse, implying that the role of electron impact ionization is minor relative to photons. Auroral emission is also evident from potassium, confirming K as the major source of far red emissions seen with spacecraft imaging at Jupiter. In all cases, direct electron impact on atomic gas is sufficient to explain the brightness without invoking significant dissociative excitation of molecules. Surprisingly, the nonresponse of O and rapid depletion of Na is opposite the temporal behavior of their SO2 and NaCl parent molecules during Io's eclipse phase.


title: Offline Reinforcement Learning for Mixture-of-Expert Dialogue Management

abstract: Reinforcement learning (RL) has shown great promise for developing dialogue management (DM) agents that are non-myopic, conduct rich conversations, and maximize overall user satisfaction. Despite recent developments in RL and language models (LMs), using RL to power conversational chatbots remains challenging, in part because RL requires online exploration to learn effectively, whereas collecting novel human-bot interactions can be expensive and unsafe. This issue is exacerbated by the combinatorial action spaces facing these algorithms, as most LM agents generate responses at the word level. We develop a variety of RL algorithms, specialized to dialogue planning, that leverage recent Mixture-of-Expert Language Models (MoE-LMs) -- models that capture diverse semantics, generate utterances reflecting different intents, and are amenable for multi-turn DM. By exploiting MoE-LM structure, our methods significantly reduce the size of the action space and improve the efficacy of RL-based DM. We evaluate our methods in open-domain dialogue to demonstrate their effectiveness w.r.t.\ the diversity of intent in generated utterances and overall DM performance.


title: Symmetry breaking in merging binary black holes from young massive clusters and isolated binaries

abstract: Properties of the to-date-observed binary black hole (BBH) merger events suggest a preference towards spin-orbit aligned mergers. Naturally, this has caused widespread interest and speculations regrading implications on various merger formation channels. Here we show that (i) not only the BBH-merger population from isolated binaries, but also (ii) BBH population formed in young massive clusters (YMC) would possess an asymmetry in favour of aligned mergers, in the distribution of the events' effective spin parameter ($\chi_{\rm eff}$). In our analysis, we utilize BBH-merger outcomes from state-of-the-art N-body evolutionary models of YMCs and isolated binary population synthesis. We incorporate, for the first time in such an analysis, misalignments due to both natal kicks and dynamical encounters. The YMC $\chi_{\rm eff}$ distribution has a mean (an anti-aligned merger fraction) of $\langle\chi_{\rm eff}\rangle\leq0.04$ ($f_X-\approx40\%$), which is smaller (larger) than but consistent with the observed asymmetry of $\langle\chi_{\rm eff}\rangle\approx0.06$ ($f_X-\approx28\%$) as obtained from the population analysis by the LIGO-Virgo-KAGRA collaboration. In contrast, isolated binaries alone tend to produce a much stronger asymmetry; for the tested physical models, $\langle\chi_{\rm eff}\rangle\approx0.25$ and $f_X-\lesssim7\%$. Although the YMC $\chi_{\rm eff}$ distribution is more similar to the observed counterpart, none of the channels correctly reproduce the observed distribution. Our results suggest that further extensive model explorations for both isolated-binary and dynamical channels as well as better observational constraints are necessary to understand the physics of 'the symmetry breaking' of the BBH-merger population.


title: Epitaxial growth and scanning tunneling microscopy of LiV$_2$O$_4$ thin films on SrTiO$_3$(111)

abstract: LiV$_2$O$_4$ is a mixed-valent spinel oxide and one of a few transition-metal compounds to host a heavy fermion phase at low temperatures. While numerous experimental studies have attempted to elucidate how its 3$d$ electrons undergo giant mass renormalization, spectroscopic probes that may provide crucial hints, such as scanning tunneling microscopy (STM), remain to be applied. A prerequisite is atomically flat and pristine surfaces, which, in the case of LiV$_2$O$_4$, are difficult to obtain by cleavage of small, three-dimensional crystals. We report the epitaxial growth of LiV$_2$O$_4$ thin films with bulklike properties on SrTiO$_3$(111) via pulsed laser deposition and stable STM imaging of the LiV$_2$O$_4$(111) surface. The as-grown films were transferred $ex$ $situ$ to a room-temperature STM, where subsequent annealing with optional sputtering in ultrahigh vacuum enabled compact islands with smooth surfaces and a hexagonal 1$\times$1 atomic lattice to be resolved. Our STM measurements provide insights into growth mechanisms of LiV$_2$O$_4$ on SrTiO$_3$(111), as well as demonstrate the feasibility of performing surface-sensitive measurements of this heavy fermion compound.


title: On the gravitational collapse in 4-dimensional Einstein-Gauss-Bonnet gravity

abstract: In this paper, we treat 4-dimensional Einstein-Gauss-Bonnet gravity as general relativity with an effective stress-energy tensor. We will study the modified Oppenheimer-Snyder-Datt model of the gravitational collapse of a star in a 4-dimensional Einstein-Gauss-Bonnet black hole. The inside geometry of the star is described by the spatially flat Friedmann-Robertson-Walker metric and the matter is distributed uniformly without any pre-assumption about its equation of state. The exterior Einstein-Gauss-Bonnet black hole is smoothly matched to the interior geometry without the requirement of any thin shell. This gives the energy density, pressure, and the equation of state of collapsing matter. At the end, we study the time evolution of event and apparent horizons.


title: Many-body correlations in one-dimensional optical lattices with alkaline-earth(-like) atoms

abstract: We explore the rich nature of correlations in the ground state of ultracold atoms trapped in state-dependent optical lattices. In particular, we consider interacting fermionic ytterbium or strontium atoms, realizing a two-orbital Hubbard model with two spin components. We analyze the model in one-dimensional setting with the experimentally relevant hierarchy of tunneling and interaction amplitudes by means of exact diagonalization and matrix product states approaches, and study the correlation functions in density, spin, and orbital sectors as functions of variable densities of atoms in the ground and metastable excited states. We show that in certain ranges of densities these atomic systems demonstrate strong density-wave, ferro- and antiferromagnetic, as well as antiferroorbital correlations.


title: Dark-state enhanced loading of an optical tweezer array

abstract: Neutral atoms and molecules trapped in optical tweezers have become a prevalent resource for quantum simulation, computation, and metrology. However, the maximum achievable system sizes of such arrays are often limited by the stochastic nature of loading into optical tweezers, with a typical loading probability of only 50%. Here we present a species-agnostic method for dark-state enhanced loading (DSEL) based on real-time feedback, long-lived shelving states, and iterated array reloading. We demonstrate this technique with a 95-tweezer array of $^{88}$Sr atoms, achieving a maximum loading probability of 84.02(4)% and a maximum array size of 91 atoms in one dimension. Our protocol is complementary to, and compatible with, existing schemes for enhanced loading based on direct control over light-assisted collisions, and we predict it can enable close-to-unity filling for arrays of atoms or molecules.


title: Overview of the TREC 2021 Fair Ranking Track

abstract: The TREC Fair Ranking Track aims to provide a platform for participants to develop and evaluate novel retrieval algorithms that can provide a fair exposure to a mixture of demographics or attributes, such as ethnicity, that are represented by relevant documents in response to a search query. For example, particular demographics or attributes can be represented by the documents' topical content or authors. The 2021 Fair Ranking Track adopted a resource allocation task. The task focused on supporting Wikipedia editors who are looking to improve the encyclopedia's coverage of topics under the purview of a WikiProject. WikiProject coordinators and/or Wikipedia editors search for Wikipedia documents that are in need of editing to improve the quality of the article. The 2021 Fair Ranking track aimed to ensure that documents that are about, or somehow represent, certain protected characteristics receive a fair exposure to the Wikipedia editors, so that the documents have an fair opportunity of being improved and, therefore, be well-represented in Wikipedia. The under-representation of particular protected characteristics in Wikipedia can result in systematic biases that can have a negative human, social, and economic impact, particularly for disadvantaged or protected societal groups.


title: Conformal removability of non-simple Schramm-Loewner evolutions

abstract: We consider the Schramm-Loewner evolution (SLE$_\kappa$) for $\kappa \in (4,8)$, which is the regime that the curve is self-intersecting but not space-filling. We let ${\mathcal K}$ be the set of $\kappa \in (4,8)$ for which the adjacency graph of connected components of the complement of an SLE$_\kappa$ is a.s. connected, meaning that for every pair of complementary components $U, V$ there exist complementary components $U_1,\ldots,U_n$ with $U_1 = U$, $U_n = V$, and $\partial U_i \cap \partial U_{i+1} \neq \emptyset$ for each $1 \leq i \leq n-1$. We show that the range of an SLE$_\kappa$ for $\kappa \in {\mathcal K}$ is a.s. conformally removable, which answers a question of Sheffield. As a step in the proof, we construct the canonical conformally covariant volume measure on the cut points of an SLE$_\kappa$ for $\kappa \in (4,8)$ and establish a precise upper bound on the measure that it assigns to any Borel set in terms of its diameter.


title: Why Majority Judgement is not yet the solution for political elections, but can help finding it

abstract: Like many other voting systems, Majority Judgement suffers from the weaknesses of the underlying mathematical model: Elections as problem of choice or ranking. We show how the model can be enhanced to take into account the complete process starting from the whole set of persons having passive electoral rights and even the aspect of reelection. By a new view on abstentions from voting and an adaption of Majority Judgement with three grades, we are able to describe a complete process for an election that can be easily put into legislation and sets suitable incentives for politicians who want to be reelected.


title: SF2Former: Amyotrophic Lateral Sclerosis Identification From Multi-center MRI Data Using Spatial and Frequency Fusion Transformer

abstract: Amyotrophic Lateral Sclerosis (ALS) is a complex neurodegenerative disorder involving motor neuron degeneration. Significant research has begun to establish brain magnetic resonance imaging (MRI) as a potential biomarker to diagnose and monitor the state of the disease. Deep learning has turned into a prominent class of machine learning programs in computer vision and has been successfully employed to solve diverse medical image analysis tasks. However, deep learning-based methods applied to neuroimaging have not achieved superior performance in ALS patients classification from healthy controls due to having insignificant structural changes correlated with pathological features. Therefore, the critical challenge in deep models is to determine useful discriminative features with limited training data. By exploiting the long-range relationship of image features, this study introduces a framework named SF2Former that leverages vision transformer architecture's power to distinguish the ALS subjects from the control group. To further improve the network's performance, spatial and frequency domain information are combined because MRI scans are captured in the frequency domain before being converted to the spatial domain. The proposed framework is trained with a set of consecutive coronal 2D slices, which uses the pre-trained weights on ImageNet by leveraging transfer learning. Finally, a majority voting scheme has been employed to those coronal slices of a particular subject to produce the final classification decision. Our proposed architecture has been thoroughly assessed with multi-modal neuroimaging data using two well-organized versions of the Canadian ALS Neuroimaging Consortium (CALSNIC) multi-center datasets. The experimental results demonstrate the superiority of our proposed strategy in terms of classification accuracy compared with several popular deep learning-based techniques.


title: Spatio-Temporal Denoising Graph Autoencoders with Data Augmentation for Photovoltaic Timeseries Data Imputation

abstract: The integration of the global Photovoltaic (PV) market with real time data-loggers has enabled large scale PV data analytical pipelines for power forecasting and long-term reliability assessment of PV fleets. Nevertheless, the performance of PV data analysis heavily depends on the quality of PV timeseries data. This paper proposes a novel Spatio-Temporal Denoising Graph Autoencoder (STD-GAE) framework to impute missing PV Power Data. STD-GAE exploits temporal correlation, spatial coherence, and value dependencies from domain knowledge to recover missing data. Experimental results show that STD-GAE can achieve a gain of 43.14% in imputation accuracy and remains less sensitive to missing rate, different seasons, and missing scenarios, compared with state-of-the-art data imputation methods such as MIDA and LRTC-TNN.


title: Estimating the optimal time to perform a PET-PSMA exam in prostatectomized patients based on data from clinical practice

abstract: Prostatectomized patients are at risk of resurgence: this is the reason why, during a follow-up period, they are monitored for PSA growth, an indicator of tumor progression. The presence of tumors can be evaluated with an expensive exam, called PET-PSMA (Positron Emission Tomography with Prostate-Specific Membrane Antigen). But, to optimize the benefit/risk ratio, patients should be referred to this exam only when the evidence is strong. The aim is to estimate the optimal time to recommend the exam, based on patients' history and collected data. We build a Hierarchical Bayesian model that describes, jointly, the PSA growth curve and the probability of a positive PET-PSMA. Our proposal is to process all information about the patient in order to give an informed estimate of the optimal time.


title: A Note on Noisy Reservoir Computation

abstract: In this note we extend the definition of the Information Processing Capacity (IPC) by Dambre et al [1] to include the effects of stochastic reservoir dynamics. We quantify the degradation of the IPC in the presence of this noise. [1] Dambre et al. Scientific Reports 2, 514, (2012)


title: A Unifying Perspective on Multi-Calibration: Game Dynamics for Multi-Objective Learning

abstract: We provide a unifying framework for the design and analysis of multicalibrated predictors. By placing the multicalibration problem in the general setting of multi-objective learning -- where learning guarantees must hold simultaneously over a set of distributions and loss functions -- we exploit connections to game dynamics to achieve state-of-the-art guarantees for a diverse set of multicalibration learning problems. In addition to shedding light on existing multicalibration guarantees and greatly simplifying their analysis, our approach also yields improved guarantees, such as obtaining stronger multicalibration conditions that scale with the square-root of group size and improving the complexity of $k$-class multicalibration by an exponential factor of $k$. Beyond multicalibration, we use these game dynamics to address emerging considerations in the study of group fairness and multi-distribution learning.


title: Reinforcement Learning-based Control of Nonlinear Systems using Carleman Approximation: Structured and Unstructured Designs

abstract: We develop data-driven reinforcement learning (RL) control designs for input-affine nonlinear systems. We use Carleman linearization to express the state-space representation of the nonlinear dynamical model in the Carleman space, and develop a real-time algorithm that can learn nonlinear state-feedback controllers using state and input measurements in the infinite-dimensional Carleman space. Thereafter, we study the practicality of having a finite-order truncation of the control signal, followed by its closed-loop stability analysis. Finally, we develop two additional designs that can learn structured as well as sparse representations of the RL-based nonlinear controller, and provide theoretical conditions for ensuring their closed-loop stability. We present numerical examples to show how our proposed method generates closed-loop responses that are close to the optimal performance of the nonlinear plant. We also compare our designs to other data-driven nonlinear RL control methods such as those based on neural networks, and illustrate their relative advantages and drawbacks.


title: Colorful Vector Balancing

abstract: We extend classical estimates for the vector balancing constant of $\mathbb{R}^d$ equipped with the Euclidean and the maximum norms proved in the 1980's by showing that for $p =2$ and $p=\infty$, given vector families $V_1, \ldots, V_n \subset B_p^d$ with $0 \in \sum_{i=1}^n \mathrm{conv}\, V_i$, one may select vectors $v_i \in V_i$ with $ \| v_1 + \ldots + v_n \|_2 \leq \sqrt{d}$ for $p=2$, and $ \| v_1 + \ldots + v_n \|_\infty \leq O(\sqrt{d}) $ for $p = \infty$. These bounds are sharp and asymptotically sharp, respectively, for $n \geq d$. The proofs combine linear algebraic and probabilistic methods with a Gaussian random walk argument.


title: Hyena Hierarchy: Towards Larger Convolutional Language Models

abstract: Recent advances in deep learning have relied heavily on the use of large Transformers due to their ability to learn at scale. However, the core building block of Transformers, the attention operator, exhibits quadratic cost in sequence length, limiting the amount of context accessible. Existing subquadratic methods based on low-rank and sparse approximations need to be combined with dense attention layers to match Transformers, indicating a gap in capability. In this work, we propose Hyena, a subquadratic drop-in replacement for attention constructed by interleaving implicitly parametrized long convolutions and data-controlled gating. In recall and reasoning tasks on sequences of thousands to hundreds of thousands of tokens, Hyena improves accuracy by more than 50 points over operators relying on state-spaces and other implicit and explicit methods, matching attention-based models. We set a new state-of-the-art for dense-attention-free architectures on language modeling in standard datasets (WikiText103 and The Pile), reaching Transformer quality with a 20% reduction in training compute required at sequence length 2K. Hyena operators are twice as fast as highly optimized attention at sequence length 8K, and 100x faster at sequence length 64K.


title: Algebraic approach to contraction families

abstract: In this paper, we give a purely algebraic approach to the contraction group scheme predicted by Bernstein--Higson--Subag and constructed by Barbasch--Higson--Subag. We also compare quotient schemes of contraction group schemes with other related schemes, equipped with actions of contraction group schemes in the cases of symmetric and $\theta$-stable parabolic subgroups.


title: 3D Radiation Hydrodynamic Simulations of Gravitational Instability in AGN Accretion Disks: Effects of Radiation Pressure

abstract: We perform 3D radiation hydrodynamic local shearing box simulations to study the outcome of gravitational instability (GI) in optically thick Active Galactic Nuclei (AGN) accretion disks. GI develops when the Toomre parameter QT \leq 1, and may lead to turbulent heating that balances radiative cooling. However, when radiative cooling is too efficient, the disk may undergo runaway gravitational fragmentation. In the fully gas-pressure-dominated case, we confirm the classical result that such a thermal balance holds when the Shakura-Sunyaev viscosity parameter (alpha) due to the gravitationally-driven turbulence is \sim 0.2, corresponding to dimensionless cooling times Omega tcool \sim 5. As the fraction of support by radiation pressure increases, the disk becomes more prone to fragmentation, with a reduced (increased) critical value of alpha (omega tcool). The effect is already significant when the radiation pressure exceeds 10% of the gas pressure, while fully radiation-pressure-dominated disks fragment at Omega tcool <50 . The latter translates to a maximum turbulence level alpha<0.02, comparable to that generated by Magnetorotational Instability (MRI). Our results suggest that gravitationally unstable (QT \sim 1) outer regions of AGN disks with significant radiation pressure (likely for high/near- Eddington accretion rates) should always fragment into stars, and perhaps black holes.


title: Stable isomorphisms of operator algebras

abstract: Let $\A$ and $\B$ be operator algebras with $c_0$-isomorphic diagonals and let $\K$ denote the compact operators. We show that if $\A\otimes\K$ and $\B\otimes\K$ are isometrically isomorphic, then $\A$ and $\B$ are isometrically isomorphic. If the algebras $\A$ and $\B$ satisfy an extra analyticity condition a similar result holds with $\K$ being replaced by any operator algebra containing the compact operators. For non-selfadjoint graph algebras this implies that the graph is a complete invariant for various types of isomorphisms, including stable isomorphisms, thus strengthening a recent result of Dor-On, Eilers and Geffen. Similar results are proven for algebras whose diagonals satisfy cancellation and have $K_0$-groups isomorphic to $\bbZ$. This has implications in the study of stable isomorphisms between various semicrossed products.


title: On Provable Copyright Protection for Generative Models

abstract: There is a growing concern that learned conditional generative models may output samples that are substantially similar to some copyrighted data $C$ that was in their training set. We give a formal definition of $\textit{near access-freeness (NAF)}$ and prove bounds on the probability that a model satisfying this definition outputs a sample similar to $C$, even if $C$ is included in its training set. Roughly speaking, a generative model $p$ is $\textit{$k$-NAF}$ if for every potentially copyrighted data $C$, the output of $p$ diverges by at most $k$-bits from the output of a model $q$ that $\textit{did not access $C$ at all}$. We also give generative model learning algorithms, which efficiently modify the original generative model learning algorithm in a black box manner, that output generative models with strong bounds on the probability of sampling protected content. Furthermore, we provide promising experiments for both language (transformers) and image (diffusion) generative models, showing minimal degradation in output quality while ensuring strong protections against sampling protected content.


title: Efficient CTC Regularization via Coarse Labels for End-to-End Speech Translation

abstract: For end-to-end speech translation, regularizing the encoder with the Connectionist Temporal Classification (CTC) objective using the source transcript or target translation as labels can greatly improve quality metrics. However, CTC demands an extra prediction layer over the vocabulary space, bringing in nonnegligible model parameters and computational overheads, although this layer is typically not used for inference. In this paper, we re-examine the need for genuine vocabulary labels for CTC for regularization and explore strategies to reduce the CTC label space, targeting improved efficiency without quality degradation. We propose coarse labeling for CTC (CoLaCTC), which merges vocabulary labels via simple heuristic rules, such as using truncation, division or modulo (MOD) operations. Despite its simplicity, our experiments on 4 source and 8 target languages show that CoLaCTC with MOD particularly can compress the label space aggressively to 256 and even further, gaining training efficiency (1.18x ~ 1.77x speedup depending on the original vocabulary size) yet still delivering comparable or better performance than the CTC baseline. We also show that CoLaCTC successfully generalizes to CTC regularization regardless of using transcript or translation for labeling.


title: MP-Rec: Hardware-Software Co-Design to Enable Multi-Path Recommendation

abstract: Deep learning recommendation systems serve personalized content under diverse tail-latency targets and input-query loads. In order to do so, state-of-the-art recommendation models rely on terabyte-scale embedding tables to learn user preferences over large bodies of contents. The reliance on a fixed embedding representation of embedding tables not only imposes significant memory capacity and bandwidth requirements but also limits the scope of compatible system solutions. This paper challenges the assumption of fixed embedding representations by showing how synergies between embedding representations and hardware platforms can lead to improvements in both algorithmic- and system performance. Based on our characterization of various embedding representations, we propose a hybrid embedding representation that achieves higher quality embeddings at the cost of increased memory and compute requirements. To address the system performance challenges of the hybrid representation, we propose MP-Rec -- a co-design technique that exploits heterogeneity and dynamic selection of embedding representations and underlying hardware platforms. On real system hardware, we demonstrate how matching custom accelerators, i.e., GPUs, TPUs, and IPUs, with compatible embedding representations can lead to 16.65x performance speedup. Additionally, in query-serving scenarios, MP-Rec achieves 2.49x and 3.76x higher correct prediction throughput and 0.19% and 0.22% better model quality on a CPU-GPU system for the Kaggle and Terabyte datasets, respectively.


title: Context-Aware Timewise VAEs for Real-Time Vehicle Trajectory Prediction

abstract: Real-time, accurate prediction of human steering behaviors has wide applications, from developing intelligent traffic systems to deploying autonomous driving systems in both real and simulated worlds. In this paper, we present ContextVAE, a context-aware approach for multi-modal vehicle trajectory prediction. Built upon the backbone architecture of a timewise variational autoencoder, ContextVAE observation encoding employs a dual attention mechanism that accounts for the environmental context and the dynamic agents' states, in a unified way. By utilizing features extracted from semantic maps during agent state encoding, our approach takes into account both the social features exhibited by agents on the scene and the physical environment constraints to generate map-compliant and socially-aware trajectories. We perform extensive testing on the nuScenes prediction challenge, Lyft Level 5 dataset and Waymo Open Motion Dataset to show the effectiveness of our approach and its state-of-the-art performance. In all tested datasets, ContextVAE models are fast to train and provide high-quality multi-modal predictions in real-time. Our code is available at: https://github.com/xupei0610/ContextVAE.


title: Neutralized local entropy, and dimension bounds for invariant measurs

abstract: We introduce a notion of a point-wise entropy of measures (i.e local entropy) called neutralized local entropy, and compare it with the Brin-Katok local entropy. We show that the neutralized local entropy coincides with Brin-Katok local entropy almost everywhere. Neutralized local entropy is computed by measuring open sets with a relatively simple geometric description. Our proof uses a measure density lemma for Bowen balls, and a version of a Besicovitch covering lemma for Bowen balls. As an application, we prove a lower point-wise dimension bound for invariant measures, complementing the previously established bounds for upper point-wise dimension.


title: Echoes of Stars in tracking Rastall gravity

abstract: We construct a star with uniform density in frame of tracking Rastall gravity, in which the density of effective dark matter tracks the density of dark energy. To demonstrate stability of the star we analyse the axial gravitational perturbations of the star. We find that echo wavelets naturally appear in the axial gravitational waves when the dark matter plays a significant role in construction of the star. We show that the physical origin of this echo roots in the potential valley near the surface of star. This effect leads to a clue to detect Rastall dark energy from the ringdown phase of gravitational wave from binary stars enriched by dark matter.


title: Effects of Co-channel Interference on RIS Empowered Wireless Networks amid Multiple Eavesdropping Attempts

abstract: This letter is concerned with the secrecy performance of reconfigurable intelligent surfaces (RIS)-aided wireless networks in the existence of multiple interferers towards the destination. To be more precise, we analyze three critical issues in the design of secure RIS-assisted networks: 1) How do interferers affect the performance of secure wireless networks? 2) Which of the two groups of eavesdroppers (i.e., colluding and non-colluding) is more severe? 3) How can RIS improve network confidentiality? To do so, we develop the analytical expression of secrecy outage probability in closed-form, along with asymptotic analysis at high signal-to-noise ratio regime to better understand the impacts of different system parameters on secrecy performance. Finally, we validate our analytical results using a computer based Monte-Carlo simulation.


title: The moduli stack of $A_r$-stable curves

abstract: This paper is the first in a series of four papers aiming to describe the (almost integral) Chow ring of $\bar{\mathcal{M}}_3$, the moduli stack of stable curves of genus $3$. In this paper, we introduce the moduli stack $\tilde{\mathcal{M}}_{g,n}^r$ of $n$-pointed $A_r$-stable curves and extend some classical results about $\bar{\mathcal{M}}_{g,n}$ to $\tilde{\mathcal{M}}_{g,n}^r$, namely the existence of the contraction morphism. Moreover, we describe the normalization of the locally closed substack of $\tilde{\mathcal{M}}_{g,n}^r$ parametrizing curves with $A_h$-singularities for a fixed $h\leq r$.


title: Complete Gr\"obner basis for lattice codes

abstract: In this work, two algorithms are developed related to lattice codes. In the first one, an extended complete Gr\"obner basis is computed for the label code of a lattice. This basis supports all term orderings associated with a total degree order offering information about de label code of the lattice. The second one is a decoding algorithm that uses an extended complete Gr\"obner basis of the label code of the lattice for monomial reduction, this provides all the lattice vectors that constitute candidates for the solution of the Close Vector Problem for a given vector.


title: $k$NN-Adapter: Efficient Domain Adaptation for Black-Box Language Models

abstract: Fine-tuning a language model on a new domain is standard practice for domain adaptation. However, it can be infeasible when it comes to modern large-scale language models such as GPT-3, which can only be accessed through APIs, making it difficult to access the internal parameters of the model. In this paper, we propose $k$NN-Adapter, a method to effectively adapt these black-box large language models (LLMs) to a new domain. The $k$NN-Adapter builds on top of the retrieval-augmented language model, and adaptively learns to interpolate the output of the language model with retrieval results from a datastore consisting of the target domain data. Our experiments on four different domains demonstrate that $k$NN-Adapter significantly improves perplexity, and works particularly well in settings with limited access to LLMs. Additionally, we show that $k$NN-Adapter is more effective than fine-tuning when the amount of training data is limited. We also release a dataset to encourage further study.


title: Entropy of black holes coupled to a scalar field

abstract: The Hamiltonian approach to black hole entropy, recently proposed in the framework of Poincar\'e gauge theory, is extended by including the scalar matter. The improved approach is used to analyse asymptotic charges and entropy of a typical black hole with scalar hair in two complementary dynamical settings, in GR and in the teleparallel gravity. In both cases, the results confirm the validity of the first law.


title: Characterizing non-Markovian Off-Resonant Errors in Quantum Gates

abstract: As quantum gates improve, it becomes increasingly difficult to characterize the remaining errors. Here we describe a class of coherent non-Markovian errors -- excitations due to an off-resonant drive -- that occur naturally in quantum devices that use time-dependent fields to generate gate operations. We show how these errors are mischaracterized using standard Quantum Computer Verification and Validation (QCVV) techniques that rely on Markovianity and are therefore often overlooked or assumed to be incoherent. We first demonstrate off-resonant errors within a simple toy model of Z-gates created by the AC Stark effect, then show how off-resonant errors manifest in all gates driven on a fixed-frequency transmon architecture, a prominent example being incidental cross-resonance interaction driven during single-qubit gates. Furthermore, the same methodology can access the errors caused by two-level systems (TLS), showing evidence of coherent, off-resonant interactions with subsystems that are not intentional qubits. While we explore these results and their impact on gate error for fixed-frequency devices, we note that off-resonant excitations potentially limit any architectures that use frequency selectivity.


title: Quantum fluctuation of ferroelectric order in polar metals

abstract: Since its discovery a decade ago, "polar metallic phase" has ignited significant research interest, as it further functionalizes the switchable electric polarization of materials with additional transport capability, granting them great potential in next-generation electronic devices. The polar metallic phase is an unusual metallic phase of matter containing long-range ferroelectric (FE) order in the electronic and atomic structure. Distinct from the typical FE insulating phase, this phase spontaneously breaks the inversion symmetry but without global polarization. Unexpectedly, the FE order is found to be dramatically suppressed by carriers and destroyed at moderate ~10% carrier density. Here, we propose a general mechanism based on carrier-induced quantum fluctuations to explain this puzzling phenomenon. Basically, the quantum kinetic effect would drive the formation of polaronic quasi-particles made of the carriers and their surrounding dipoles. The disruption in dipolar directions can therefore weaken or even destroy the FE order. We demonstrate such polaron formation and the associated FE suppression via a simple model using exact diagonalization, perturbation, and quantum Monte Carlo approaches. This quantum mechanism also provides an intuitive picture for many puzzling experimental findings, thereby facilitating new designs of multifunctional FE electronic devices augmented with quantum effects.


title: Combining Blockchain and Biometrics: A Survey on Technical Aspects and a First Legal Analysis

abstract: Biometric recognition as a unique, hard-to-forge, and efficient way of identification and verification has become an indispensable part of the current digital world. The fast evolution of this technology has been a strong incentive for integrating it into many applications. Meanwhile, blockchain, the very attractive decentralized ledger technology, has been widely received both by the research and industry in the past years and it is being increasingly deployed nowadays in many different applications, such as money transfer, IoT, healthcare, or logistics. Recently, researchers have started to speculate what would be the pros and cons and what would be the best applications when these two technologies cross paths. This paper provides a survey of technical literature research on the combination of blockchain and biometrics and includes a first legal analysis of this integration to shed light on challenges and potentials. While this combination is still in its infancy and a growing body of literature discusses specific blockchain applications and solutions in an advanced technological set-up, this paper presents a holistic understanding of blockchains applicability in the biometric sector. This study demonstrates that combining blockchain and biometrics would be beneficial for novel applications in biometrics such as the PKI mechanism, distributed trusted service, and identity management. However, blockchain networks at their current stage are not efficient and economical for real-time applications. From a legal point of view, the allocation of accountability remains a main issue, while other difficulties remain, such as conducting a proper Data Protection Impact Assessment. Finally, it supplies technical and legal recommendations to reap the benefits and mitigate the risks of the combination.


title: Improved decoupling for the moment curve in three dimensions

abstract: By quantifying a bilinear decoupling iteration for the moment curve in three dimensions due to Guo--Li--Yung--Zorin-Kranich, we show a logarithmic improvement of the decoupling constant at critical exponent. Correspondingly, we obtain a logarithmic improvement of Vinogradov's mean-value theorem in the cubic case.


title: Communicating Intel to Decision-Makers: Toward the Integration Text and Charts in Reports

abstract: Intelligence analysts' roles include analyzing reports, identifying important information relevant to the current state of affairs, and communicating their takeaways. These reports are then analyzed and reported to decision-makers or translated into a presidential brief. While these tasks seem consistent across analysts, each step differs in its content, level of detail, and format. The purpose of this research is to gain an understanding of how consumers of analytic products receive and interact with reports. This was accomplished via a series of online questions to 22 experts recruited to provide input. Our analysis provides insight into what makes analytic products effective for decision-makers, which could improve the quality of reports produced and alleviate common customer pain points, should recommendations be appropriately incorporated.


title: Some Fundamental Aspects about Lipschitz Continuity of Neural Networks

abstract: Lipschitz continuity is a crucial functional property of any predictive model, that naturally governs its robustness, generalisation, as well as adversarial vulnerability. Contrary to other works that focus on obtaining tighter bounds and developing different practical strategies to enforce certain Lipschitz properties, we aim to thoroughly examine and characterise the Lipschitz behaviour of Neural Networks. Thus, we carry out an empirical investigation in a range of different settings (namely, architectures, datasets, label noise, and more) by exhausting the limits of the simplest and the most general lower and upper bounds. As a highlight of this investigation, we showcase a remarkable fidelity of the lower Lipschitz bound, identify a striking Double Descent trend in both upper and lower bounds to the Lipschitz and explain the intriguing effects of label noise on function smoothness and generalisation.


title: The configurable tree graph (CT-graph): measurable problems in partially observable and distal reward environments for lifelong reinforcement learning

abstract: This paper introduces a set of formally defined and transparent problems for reinforcement learning algorithms with the following characteristics: (1) variable degrees of observability (non-Markov observations), (2) distal and sparse rewards, (3) variable and hierarchical reward structure, (4) multiple-task generation, (5) variable problem complexity. The environment provides 1D or 2D categorical observations, and takes actions as input. The core structure of the CT-graph is a multi-branch tree graph with arbitrary branching factor, depth, and observation sets that can be varied to increase the dimensions of the problem in a controllable and measurable way. Two main categories of states, decision states and wait states, are devised to create a hierarchy of importance among observations, typical of real-world problems. A large observation set can produce a vast set of histories that impairs memory-augmented agents. Variable reward functions allow for the easy creation of multiple tasks and the ability of an agent to efficiently adapt in dynamic scenarios where tasks with controllable degrees of similarities are presented. Challenging complexity levels can be easily achieved due to the exponential growth of the graph. The problem formulation and accompanying code provide a fast, transparent, and mathematically defined set of configurable tests to compare the performance of reinforcement learning algorithms, in particular in lifelong learning settings.


title: Data-Efficient Protein 3D Geometric Pretraining via Refinement of Diffused Protein Structure Decoy

abstract: Learning meaningful protein representation is important for a variety of biological downstream tasks such as structure-based drug design. Having witnessed the success of protein sequence pretraining, pretraining for structural data which is more informative has become a promising research topic. However, there are three major challenges facing protein structure pretraining: insufficient sample diversity, physically unrealistic modeling, and the lack of protein-specific pretext tasks. To try to address these challenges, we present the 3D Geometric Pretraining. In this paper, we propose a unified framework for protein pretraining and a 3D geometric-based, data-efficient, and protein-specific pretext task: RefineDiff (Refine the Diffused Protein Structure Decoy). After pretraining our geometric-aware model with this task on limited data(less than 1% of SOTA models), we obtained informative protein representations that can achieve comparable performance for various downstream tasks.


title: An Asymmetric Loss with Anomaly Detection LSTM Framework for Power Consumption Prediction

abstract: Building an accurate load forecasting model with minimal underpredictions is vital to prevent any undesired power outages due to underproduction of electricity. However, the power consumption patterns of the residential sector contain fluctuations and anomalies making them challenging to predict. In this paper, we propose multiple Long Short-Term Memory (LSTM) frameworks with different asymmetric loss functions to impose a higher penalty on underpredictions. We also apply a density-based spatial clustering of applications with noise (DBSCAN) anomaly detection approach, prior to the load forecasting task, to remove any present oultiers. Considering the effect of weather and social factors, seasonality splitting is performed on the three considered datasets from France, Germany, and Hungary containing hourly power consumption, weather, and calendar features. Root-mean-square error (RMSE) results show that removing the anomalies efficiently reduces the underestimation and overestimation errors in all the seasonal datasets. Additionally, asymmetric loss functions and seasonality splitting effectively minimize underestimations despite increasing the overestimation error to some degree. Reducing underpredictions of electricity consumption is essential to prevent power outages that can be damaging to the community.


title: Learning Interpretable Low-dimensional Representation via Physical Symmetry

abstract: We have recently seen great progress in learning interpretable music representations, ranging from basic factors, such as pitch and timbre, to high-level concepts, such as chord and texture. However, most methods rely heavily on music domain knowledge. It remains an open question what general computational principles give rise to interpretable representations, especially low-dim factors that agree with human perception. In this study, we take inspiration from modern physics and use physical symmetry as a self consistency constraint for the latent space of time-series data. Specifically, it requires the prior model that characterises the dynamics of the latent states to be equivariant with respect to certain group transformations. We show that physical symmetry leads the model to learn a linear pitch factor from unlabelled monophonic music audio in a self-supervised fashion. In addition, the same methodology can be applied to computer vision, learning a 3D Cartesian space from videos of a simple moving object without labels. Furthermore, physical symmetry naturally leads to counterfactual representation augmentation, a new technique which improves sample efficiency.


title: An Implicit GNN Solver for Poisson-like problems

abstract: This paper presents $\Psi$-GNN, a novel Graph Neural Network (GNN) approach for solving the ubiquitous Poisson PDE problems with mixed boundary conditions. By leveraging the Implicit Layer Theory, $\Psi$-GNN models an "infinitely" deep network, thus avoiding the empirical tuning of the number of required Message Passing layers to attain the solution. Its original architecture explicitly takes into account the boundary conditions, a critical prerequisite for physical applications, and is able to adapt to any initially provided solution. $\Psi$-GNN is trained using a "physics-informed" loss, and the training process is stable by design, and insensitive to its initialization. Furthermore, the consistency of the approach is theoretically proven, and its flexibility and generalization efficiency are experimentally demonstrated: the same learned model can accurately handle unstructured meshes of various sizes, as well as different boundary conditions. To the best of our knowledge, $\Psi$-GNN is the first physics-informed GNN-based method that can handle various unstructured domains, boundary conditions and initial solutions while also providing convergence guarantees.


title: Eigen-informed NeuralODEs: Dealing with stability and convergence issues of NeuralODEs

abstract: Using vanilla NeuralODEs to model large and/or complex systems often fails due two reasons: Stability and convergence. NeuralODEs are capable of describing stable as well as instable dynamic systems. Selecting an appropriate numerical solver is not trivial, because NeuralODE properties change during training. If the NeuralODE becomes more stiff, a suboptimal solver may need to perform very small solver steps, which significantly slows down the training process. If the NeuralODE becomes to instable, the numerical solver might not be able to solve it at all, which causes the training process to terminate. Often, this is tackled by choosing a computational expensive solver that is robust to instable and stiff ODEs, but at the cost of a significantly decreased training performance. Our method on the other hand, allows to enforce ODE properties that fit a specific solver or application-related boundary conditions. Concerning the convergence behavior, NeuralODEs often tend to run into local minima, especially if the system to be learned is highly dynamic and/or oscillating over multiple periods. Because of the vanishing gradient at a local minimum, the NeuralODE is often not capable of leaving it and converge to the right solution. We present a technique to add knowledge of ODE properties based on eigenvalues - like (partly) stability, oscillation capability, frequency, damping and/or stiffness - to the training objective of a NeuralODE. We exemplify our method at a linear as well as a nonlinear system model and show, that the presented training process is far more robust against local minima, instabilities and sparse data samples and improves training convergence and performance.


title: Fair Diffusion: Instructing Text-to-Image Generation Models on Fairness

abstract: Generative AI models have recently achieved astonishing results in quality and are consequently employed in a fast-growing number of applications. However, since they are highly data-driven, relying on billion-sized datasets randomly scraped from the internet, they also suffer from degenerated and biased human behavior, as we demonstrate. In fact, they may even reinforce such biases. To not only uncover but also combat these undesired effects, we present a novel strategy, called Fair Diffusion, to attenuate biases after the deployment of generative text-to-image models. Specifically, we demonstrate shifting a bias, based on human instructions, in any direction yielding arbitrarily new proportions for, e.g., identity groups. As our empirical evaluation demonstrates, this introduced control enables instructing generative image models on fairness, with no data filtering and additional training required.


title: Red Teaming Deep Neural Networks with Feature Synthesis Tools

abstract: Interpretable AI tools are often motivated by the goal of understanding model behavior in out-of-distribution (OOD) contexts. Despite the attention this area of study receives, there are comparatively few cases where these tools have identified previously unknown bugs in models. We argue that this is due, in part, to a common feature of many interpretability methods: they analyze model behavior by using a particular dataset. This only allows for the study of the model in the context of features that the user can sample in advance. To address this, a growing body of research involves interpreting models using \emph{feature synthesis} methods that do not depend on a dataset. In this paper, we benchmark the usefulness of interpretability tools on debugging tasks. Our key insight is that we can implant human-interpretable trojans into models and then evaluate these tools based on whether they can help humans discover them. This is analogous to finding OOD bugs, except the ground truth is known, allowing us to know when an interpretation is correct. We make four contributions. (1) We propose trojan discovery as an evaluation task for interpretability tools and introduce a benchmark with 12 trojans of 3 different types. (2) We demonstrate the difficulty of this benchmark with a preliminary evaluation of 16 state-of-the-art feature attribution/saliency tools. Even under ideal conditions, given direct access to data with the trojan trigger, these methods still often fail to identify bugs. (3) We evaluate 7 feature-synthesis methods on our benchmark. (4) We introduce and evaluate 2 new variants of the best-performing method from the previous evaluation. A website for this paper and its code is at https://benchmarking-interpretability.csail.mit.edu/


title: CQnet: convex-geometric interpretation and constraining neural-network trajectories

abstract: We introduce CQnet, a neural network with origins in the CQ algorithm for solving convex split-feasibility problems and forward-backward splitting. CQnet's trajectories are interpretable as particles that are tracking a changing constraint set via its point-to-set distance function while being elements of another constraint set at every layer. More than just a convex-geometric interpretation, CQnet accommodates learned and deterministic constraints that may be sample or data-specific and are satisfied by every layer and the output. Furthermore, the states in CQnet progress toward another constraint set at every layer. We provide proof of stability/nonexpansiveness with minimal assumptions. The combination of constraint handling and stability put forward CQnet as a candidate for various tasks where prior knowledge exists on the network states or output.


title: IB-RAR: Information Bottleneck as Regularizer for Adversarial Robustness

abstract: In this paper, we propose a novel method, IB-RAR, which uses Information Bottleneck (IB) to strengthen adversarial robustness for both adversarial training and non-adversarial-trained methods. We first use the IB theory to build regularizers as learning objectives in the loss function. Then, we filter out unnecessary features of intermediate representation according to their mutual information (MI) with labels, as the network trained with IB provides easily distinguishable MI for its features. Experimental results show that our method can be naturally combined with adversarial training and provides consistently better accuracy on new adversarial examples. Our method improves the accuracy by an average of 3.07% against five adversarial attacks for the VGG16 network, trained with three adversarial training benchmarks and the CIFAR-10 dataset. In addition, our method also provides good robustness for undefended methods, such as training with cross-entropy loss only. Finally, in the absence of adversarial training, the VGG16 network trained using our method and the CIFAR-10 dataset reaches an accuracy of 35.86% against PGD examples, while using all layers reaches 25.61% accuracy.


title: Learning to Simulate Daily Activities via Modeling Dynamic Human Needs

abstract: Daily activity data that records individuals' various types of activities in daily life are widely used in many applications such as activity scheduling, activity recommendation, and policymaking. Though with high value, its accessibility is limited due to high collection costs and potential privacy issues. Therefore, simulating human activities to produce massive high-quality data is of great importance to benefit practical applications. However, existing solutions, including rule-based methods with simplified assumptions of human behavior and data-driven methods directly fitting real-world data, both cannot fully qualify for matching reality. In this paper, motivated by the classic psychological theory, Maslow's need theory describing human motivation, we propose a knowledge-driven simulation framework based on generative adversarial imitation learning. To enhance the fidelity and utility of the generated activity data, our core idea is to model the evolution of human needs as the underlying mechanism that drives activity generation in the simulation model. Specifically, this is achieved by a hierarchical model structure that disentangles different need levels, and the use of neural stochastic differential equations that successfully captures piecewise-continuous characteristics of need dynamics. Extensive experiments demonstrate that our framework outperforms the state-of-the-art baselines in terms of data fidelity and utility. Besides, we present the insightful interpretability of the need modeling. The code is available at https://github.com/tsinghua-fib-lab/SAND.


title: Estimating Driver Personality Traits from On-Road Driving Data

abstract: This paper focuses on the estimation of a driver's psychological characteristics using driving data for driving assistance systems. Driving assistance systems that support drivers by adapting individual psychological characteristics can provide appropriate feedback and prevent traffic accidents. As a first step toward implementing such adaptive assistance systems, this research aims to develop a model to estimate drivers' psychological characteristics, such as cognitive function, psychological driving style, and workload sensitivity, from on-road driving behavioral data using machine learning and deep learning techniques. We also investigated the relationship between driving behavior and various cognitive functions, including the Trail Making Test (TMT) and Useful Field of View (UFOV) test, through regression modeling. The proposed method focuses on road type information and captures various durations of time-series data observed from driving behaviors. First, we segment the driving time-series data into two road types, namely, arterial roads and intersections, to consider driving situations. Second, we further segment data into many sequences of various durations. Third, statistics are calculated from each sequence. Finally, these statistics are used as input features of machine learning models to estimate psychological characteristics. The experimental results show that our model can estimate a driver's cognitive function, namely, the TMT~(B) and UFOV test scores, with Pearson correlation coefficients $r$ of 0.579 and 0.708, respectively. Some characteristics, such as psychological driving style and workload sensitivity, are estimated with high accuracy, but whether various duration segmentation improves accuracy depends on the characteristics, and it is not effective for all characteristics.


title: Feature Affinity Assisted Knowledge Distillation and Quantization of Deep Neural Networks on Label-Free Data

abstract: In this paper, we propose a feature affinity (FA) assisted knowledge distillation (KD) method to improve quantization-aware training of deep neural networks (DNN). The FA loss on intermediate feature maps of DNNs plays the role of teaching middle steps of a solution to a student instead of only giving final answers in the conventional KD where the loss acts on the network logits at the output level. Combining logit loss and FA loss, we found that the quantized student network receives stronger supervision than from the labeled ground-truth data. The resulting FAQD is capable of compressing model on label-free data, which brings immediate practical benefits as pre-trained teacher models are readily available and unlabeled data are abundant. In contrast, data labeling is often laborious and expensive. Finally, we propose a fast feature affinity (FFA) loss that accurately approximates FA loss with a lower order of computational complexity, which helps speed up training for high resolution image input.


title: Semi-decentralized Federated Ego Graph Learning for Recommendation

abstract: Collaborative filtering (CF) based recommender systems are typically trained based on personal interaction data (e.g., clicks and purchases) that could be naturally represented as ego graphs. However, most existing recommendation methods collect these ego graphs from all users to compose a global graph to obtain high-order collaborative information between users and items, and these centralized CF recommendation methods inevitably lead to a high risk of user privacy leakage. Although recently proposed federated recommendation systems can mitigate the privacy problem, they either restrict the on-device local training to an isolated ego graph or rely on an additional third-party server to access other ego graphs resulting in a cumbersome pipeline, which is hard to work in practice. In addition, existing federated recommendation systems require resource-limited devices to maintain the entire embedding tables resulting in high communication costs. In light of this, we propose a semi-decentralized federated ego graph learning framework for on-device recommendations, named SemiDFEGL, which introduces new device-to-device collaborations to improve scalability and reduce communication costs and innovatively utilizes predicted interacted item nodes to connect isolated ego graphs to augment local subgraphs such that the high-order user-item collaborative information could be used in a privacy-preserving manner. Furthermore, the proposed framework is model-agnostic, meaning that it could be seamlessly integrated with existing graph neural network-based recommendation methods and privacy protection techniques. To validate the effectiveness of the proposed SemiDFEGL, extensive experiments are conducted on three public datasets, and the results demonstrate the superiority of the proposed SemiDFEGL compared to other federated recommendation methods.


title: Machine Learning Techniques for Predicting the Short-Term Outcome of Resective Surgery in Lesional-Drug Resistance Epilepsy

abstract: In this study, we developed and tested machine learning models to predict epilepsy surgical outcome using noninvasive clinical and demographic data from patients. Methods: Seven dif-ferent categorization algorithms were used to analyze the data. The techniques are also evaluated using the Leave-One-Out method. For precise evaluation of the results, the parameters accuracy, precision, recall and, F1-score are calculated. Results: Our findings revealed that a machine learning-based presurgical model of patients' clinical features may accurately predict the outcome of epilepsy surgery in patients with drug-resistant lesional epilepsy. The support vector machine (SVM) with the linear kernel yielded 76.1% in terms of accuracy could predict results in 96.7% of temporal lobe epilepsy (TLE) patients and 79.5% of extratemporal lobe epilepsy (ETLE) cases using ten clinical features. Significance: To predict the outcome of epilepsy surgery, this study recommends the use of a machine learning strategy based on supervised classification and se-lection of feature subsets data mining. Progress in the development of machine learning-based prediction models offers optimism for personalised medicine access.


title: Deep Imputation of Missing Values in Time Series Health Data: A Review with Benchmarking

abstract: The imputation of missing values in multivariate time series (MTS) data is critical in ensuring data quality and producing reliable data-driven predictive models. Apart from many statistical approaches, a few recent studies have proposed state-of-the-art deep learning methods to impute missing values in MTS data. However, the evaluation of these deep methods is limited to one or two data sets, low missing rates, and completely random missing value types. This survey performs six data-centric experiments to benchmark state-of-the-art deep imputation methods on five time series health data sets. Our extensive analysis reveals that no single imputation method outperforms the others on all five data sets. The imputation performance depends on data types, individual variable statistics, missing value rates, and types. Deep learning methods that jointly perform cross-sectional (across variables) and longitudinal (across time) imputations of missing values in time series data yield statistically better data quality than traditional imputation methods. Although computationally expensive, deep learning methods are practical given the current availability of high-performance computing resources, especially when data quality and sample size are highly important in healthcare informatics. Our findings highlight the importance of data-centric selection of imputation methods to optimize data-driven predictive models.


title: Trajectory-User Linking via Hierarchical Spatio-Temporal Attention Networks

abstract: Trajectory-User Linking (TUL) is crucial for human mobility modeling by linking diferent trajectories to users with the exploration of complex mobility patterns. Existing works mainly rely on the recurrent neural framework to encode the temporal dependencies in trajectories, have fall short in capturing spatial-temporal global context for TUL prediction. To ill this gap, this work presents a new hierarchical spatio-temporal attention neural network, called AttnTUL, to jointly encode the local trajectory transitional patterns and global spatial dependencies for TUL. Speciically, our irst model component is built over the graph neural architecture to preserve the local and global context and enhance the representation paradigm of geographical regions and user trajectories. Additionally, a hierarchically structured attention network is designed to simultaneously encode the intra-trajectory and inter-trajectory dependencies, with the integration of the temporal attention mechanism and global elastic attentional encoder. Extensive experiments demonstrate the superiority of our AttnTUL method as compared to state-of-the-art baselines on various trajectory datasets. The source code of our model is available at https://github.com/Onedean/AttnTUL.


title: Deep Learning in Healthcare: An In-Depth Analysis

abstract: Deep learning (DL) along with never-ending advancements in computational processing and cloud technologies have bestowed us powerful analyzing tools and techniques in the past decade and enabled us to use and apply them in various fields of study. Health informatics is not an exception, and conversely, is the discipline that generates the most amount of data in today's era and can benefit from DL the most. Extracting features and finding complex patterns from a huge amount of raw data and transforming them into knowledge is a challenging task. Besides, various DL architectures have been proposed by researchers throughout the years to tackle different problems. In this paper, we provide a review of DL models and their broad application in bioinformatics and healthcare categorized by their architecture. In addition, we also go over some of the key challenges that still exist and can show up while conducting DL research.


title: Scientific Computing with Diffractive Optical Neural Networks

abstract: Diffractive optical neural networks (DONNs) have been emerging as a high-throughput and energy-efficient hardware platform to perform all-optical machine learning (ML) in machine vision systems. However, the current demonstrated applications of DONNs are largely straightforward image classification tasks, which undermines the prospect of developing and utilizing such hardware for other ML applications. Here, we numerically and experimentally demonstrate the deployment of an all-optical reconfigurable DONNs system for scientific computing, including guiding two-dimensional quantum material synthesis, predicting the properties of nanomaterials and small molecular cancer drugs, predicting the device response of nanopatterned integrated photonic power splitters, and the dynamic stabilization of an inverted pendulum with reinforcement learning. Despite a large variety of input data structures, we develop a universal feature engineering approach to convert categorical input features to the images that can be processed in the DONNs system. Our results open up new opportunities of employing DONNs systems for a broad range of ML applications.


title: Deep Neural Networks for Encrypted Inference with TFHE

abstract: Fully homomorphic encryption (FHE) is an encryption method that allows to perform computation on encrypted data, without decryption. FHE preserves the privacy of the users of online services that handle sensitive data, such as health data, biometrics, credit scores and other personal information. A common way to provide a valuable service on such data is through machine learning and, at this time, Neural Networks are the dominant machine learning model for unstructured data. In this work we show how to construct Deep Neural Networks (DNN) that are compatible with the constraints of TFHE, an FHE scheme that allows arbitrary depth computation circuits. We discuss the constraints and show the architecture of DNNs for two computer vision tasks. We benchmark the architectures using the Concrete stack, an open-source implementation of TFHE.


title: Diffusion Models in Bioinformatics: A New Wave of Deep Learning Revolution in Action

abstract: Denoising diffusion models have emerged as one of the most powerful generative models in recent years. They have achieved remarkable success in many fields, such as computer vision, natural language processing (NLP), and bioinformatics. Although there are a few excellent reviews on diffusion models and their applications in computer vision and NLP, there is a lack of an overview of their applications in bioinformatics. This review aims to provide a rather thorough overview of the applications of diffusion models in bioinformatics to aid their further development in bioinformatics and computational biology. We start with an introduction of the key concepts and theoretical foundations of three cornerstone diffusion modeling frameworks (denoising diffusion probabilistic models, noise-conditioned scoring networks, and stochastic differential equations), followed by a comprehensive description of diffusion models employed in the different domains of bioinformatics, including cryo-EM data enhancement, single-cell data analysis, protein design and generation, drug and small molecule design, and protein-ligand interaction. The review is concluded with a summary of the potential new development and applications of diffusion models in bioinformatics.


title: Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-based Recruitment

abstract: The presence of decision-making algorithms in society is rapidly increasing nowadays, while concerns about their transparency and the possibility of these algorithms becoming new sources of discrimination are arising. There is a certain consensus about the need to develop AI applications with a Human-Centric approach. Human-Centric Machine Learning needs to be developed based on four main requirements: (i) utility and social good; (ii) privacy and data ownership; (iii) transparency and accountability; and (iv) fairness in AI-driven decision-making processes. All these four Human-Centric requirements are closely related to each other. With the aim of studying how current multimodal algorithms based on heterogeneous sources of information are affected by sensitive elements and inner biases in the data, we propose a fictitious case study focused on automated recruitment: FairCVtest. We train automatic recruitment algorithms using a set of multimodal synthetic profiles including image, text, and structured data, which are consciously scored with gender and racial biases. FairCVtest shows the capacity of the Artificial Intelligence (AI) behind automatic recruitment tools built this way (a common practice in many other application scenarios beyond recruitment) to extract sensitive information from unstructured data and exploit it in combination to data biases in undesirable (unfair) ways. We present an overview of recent works developing techniques capable of removing sensitive information and biases from the decision-making process of deep learning architectures, as well as commonly used databases for fairness research in AI. We demonstrate how learning approaches developed to guarantee privacy in latent spaces can lead to unbiased and fair automatic decision-making process.


title: Multi-modal Machine Learning in Engineering Design: A Review and Future Directions

abstract: In the rapidly advancing field of multi-modal machine learning (MMML), the convergence of multiple data modalities has the potential to reshape various applications. This paper presents a comprehensive overview of the current state, advancements, and challenges of MMML within the sphere of engineering design. The review begins with a deep dive into five fundamental concepts of MMML:multi-modal information representation, fusion, alignment, translation, and co-learning. Following this, we explore the cutting-edge applications of MMML, placing a particular emphasis on tasks pertinent to engineering design, such as cross-modal synthesis, multi-modal prediction, and cross-modal information retrieval. Through this comprehensive overview, we highlight the inherent challenges in adopting MMML in engineering design, and proffer potential directions for future research. To spur on the continued evolution of MMML in engineering design, we advocate for concentrated efforts to construct extensive multi-modal design datasets, develop effective data-driven MMML techniques tailored to design applications, and enhance the scalability and interpretability of MMML models. MMML models, as the next generation of intelligent design tools, hold a promising future to impact how products are designed.


title: Generative Oversampling for Imbalanced Data via Majority-Guided VAE

abstract: Learning with imbalanced data is a challenging problem in deep learning. Over-sampling is a widely used technique to re-balance the sampling distribution of training data. However, most existing over-sampling methods only use intra-class information of minority classes to augment the data but ignore the inter-class relationships with the majority ones, which is prone to overfitting, especially when the imbalance ratio is large. To address this issue, we propose a novel over-sampling model, called Majority-Guided VAE~(MGVAE), which generates new minority samples under the guidance of a majority-based prior. In this way, the newly generated minority samples can inherit the diversity and richness of the majority ones, thus mitigating overfitting in downstream tasks. Furthermore, to prevent model collapse under limited data, we first pre-train MGVAE on sufficient majority samples and then fine-tune based on minority samples with Elastic Weight Consolidation(EWC) regularization. Experimental results on benchmark image datasets and real-world tabular data show that MGVAE achieves competitive improvements over other over-sampling methods in downstream classification tasks, demonstrating the effectiveness of our method.