title: Machine learning-assisted design of material properties

abstract: Designing functional materials requires a deep search through multidimensional spaces for system parameters that yield desirable material properties. For cases where conventional parameter sweeps or trial-and-error sampling are impractical, inverse methods that frame design as a constrained optimization problem present an attractive alternative. However, even efficient algorithms require time- and resource-intensive characterization of material properties many times during optimization, imposing a design bottleneck. Approaches that incorporate machine learning can help address this limitation and accelerate the discovery of materials with targeted properties. In this article, we review how to leverage machine learning to reduce dimensionality in order to effectively explore design space, accelerate property evaluation, and generate unconventional material structures with optimal properties. We also discuss promising future directions, including integration of machine learning into multiple stages of a design algorithm and interpretation of machine learning models to understand how design parameters relate to material properties.


title: Closed Biconservative Hypersurfaces in Spheres

abstract: We characterise the profile curves of non-CMC biconservative rotational hypersurfaces of space forms $N^n(\rho)$ as $p$-elastic curves, for a suitable rational number $p\in[1/4,1)$ which depends on the dimension $n$ of the ambient space. Analysing the closure conditions of these $p$-elastic curves, we prove the existence of a discrete biparametric family of non-CMC closed (i.e., compact without boundary) biconservative hypersurfaces in $\mathbb{S}^n(\rho)$. None of these hypersurfaces can be embedded in $\mathbb{S}^n(\rho)$.


title: Classifying IGR J18007-4146 as an intermediate polar using XMM and NuSTAR

abstract: Many new and unidentified Galactic sources have recently been revealed by ongoing hard X-ray surveys. A significant fraction of these have been shown to be the type of accreting white dwarfs known as cataclysmic variables (CVs). Follow-up observations are often required to categorize and classify these sources, and may also identify potentially unique or interesting cases. One such case is IGR J18007-4146, which is likely a CV based on follow-up Chandra observations and constraints from optical/IR catalogs. Utilizing simultaneous XMM-Newton and NuSTAR observations, as well as the available optical/IR data, we confirm the nature of IGR J18007-4146 as an intermediate polar type CV. Timing analysis of the XMM data reveals a periodic signal at 424.4 +/- 0.7 s that we interpret as the spin period of the white dwarf. Modeling the 0.3-78 keV spectrum, we use a thermal bremsstrahlung continuum but require intrinsic absorption as well as a soft component and strong Fe lines between 6 and 7 keV. We model the soft component using a single-temperature blackbody with kT = 73 +8/-6 eV. From the X-ray spectrum, we are able to measure the mass of the white dwarf to be 1.06 +0.19/-0.10 Msun, which means IGR J18007-4146 is more massive than the average for magnetic CVs.


title: Extending the Use of MDL for High-Dimensional Problems: Variable Selection, Robust Fitting, and Additive Modeling

abstract: In the signal processing and statistics literature, the minimum description length (MDL) principle is a popular tool for choosing model complexity. Successful examples include signal denoising and variable selection in linear regression, for which the corresponding MDL solutions often enjoy consistent properties and produce very promising empirical results. This paper demonstrates that MDL can be extended naturally to the high-dimensional setting, where the number of predictors $p$ is larger than the number of observations $n$. It first considers the case of linear regression, then allows for outliers in the data, and lastly extends to the robust fitting of nonparametric additive models. Results from numerical experiments are presented to demonstrate the efficiency and effectiveness of the MDL approach.


title: Tackling data scarcity in speech translation using zero-shot multilingual machine translation techniques

abstract: Recently, end-to-end speech translation (ST) has gained significant attention as it avoids error propagation. However, the approach suffers from data scarcity. It heavily depends on direct ST data and is less efficient in making use of speech transcription and text translation data, which is often more easily available. In the related field of multilingual text translation, several techniques have been proposed for zero-shot translation. A main idea is to increase the similarity of semantically similar sentences in different languages. We investigate whether these ideas can be applied to speech translation, by building ST models trained on speech transcription and text translation data. We investigate the effects of data augmentation and auxiliary loss function. The techniques were successfully applied to few-shot ST using limited ST data, with improvements of up to +12.9 BLEU points compared to direct end-to-end ST and +3.1 BLEU points compared to ST models fine-tuned from ASR model.


title: Learning Noise via Dynamical Decoupling of Entangled Qubits

abstract: Noise in entangled quantum systems is difficult to characterize due to many-body effects involving multiple degrees of freedom. This noise poses a challenge to quantum computing, where two-qubit gate performance is critical. Here, we develop and apply multi-qubit dynamical decoupling sequences that characterize noise that occurs during two-qubit gates. In our superconducting system comprised of Transmon qubits with tunable couplers, we observe noise that is consistent with flux fluctuations in the coupler that simultaneously affects both qubits and induces noise in their entangling parameter. The effect of this noise on the qubits is very different from the well-studied single-qubit dephasing. Additionally, steps are observed in the decoupled signals, implying the presence of non-Gaussian noise.


title: Essential Minimum in Families of lines

abstract: We apply general methods to generate upper and lower bounds for the essential minimum of a specific family of height functions. In particular, the results shown in this article apply to the case of the Zhang-Zagier height. Furthermore, we can find intervals, where the images of these heights are dense. Our main tool to find upper bounds and intervals of density, is a refinement of the classical Fekete-Szego theorem due to Burgos Gil, Philippon, Rivera-Letelier and Sombra.


title: Some Motivic Properties of Gushel-Mukai Sixfolds

abstract: Gushel-Mukai sixfolds are an important class of so-called Fano-K3 varieties. In this paper we show that they admit a multiplicative Chow-K\"unneth decomposition modulo algebraic equivalence and that they have the Franchetta property. As side results, we show that double EPW sextics and cubes have the Franchetta property, modulo algebraic equivalence, and some vanishing results for the Chow ring of Gushel-Mukai sixfolds.


title: DiscoScore: Evaluating Text Generation with BERT and Discourse Coherence

abstract: Recently, there has been a growing interest in designing text generation systems from a discourse coherence perspective, e.g., modeling the interdependence between sentences. Still, recent BERT-based evaluation metrics are weak in recognizing coherence, and thus are not reliable in a way to spot the discourse-level improvements of those text generation systems. In this work, we introduce DiscoScore, a parametrized discourse metric, which uses BERT to model discourse coherence from different perspectives, driven by Centering theory. Our experiments encompass 16 non-discourse and discourse metrics, including DiscoScore and popular coherence models, evaluated on summarization and document-level machine translation (MT). We find that (i) the majority of BERT-based metrics correlate much worse with human rated coherence than early discourse metrics, invented a decade ago; (ii) the recent state-of-the-art BARTScore is weak when operated at system level -- which is particularly problematic as systems are typically compared in this manner. DiscoScore, in contrast, achieves strong system-level correlation with human ratings, not only in coherence but also in factual consistency and other aspects, and surpasses BARTScore by over 10 correlation points on average. Further, aiming to understand DiscoScore, we provide justifications to the importance of discourse coherence for evaluation metrics, and explain the superiority of one variant over another. Our code is available at \url{https://github.com/AIPHES/DiscoScore}.


title: Plug Disintegration in GRB Jet Eruption

abstract: In this work we consider the eruption of a tenuous relativistic hydrodynamic jet from a dense baryonic envelope. As the jet moves out and away, it carries along and continues to accelerate a layer of baryonic material which we refer to as the plug. We solve the relativistic equations of motion for the trajectory of the plug, and verify it using a relativistic hydrodynamic simulation. We show that under these conditions, the plug breaks up at a radius larger by a factor of a few from the radius of the envelope, due to the onset of the Rayleigh Taylor instability. After breakup the jet continues to accelerate to higher Lorentz factors while the plug fragments maintain a moderate Lorentz factor. The presence of slower moving ejecta can explain late time features of GRBs such as X ray flares without recourse to a long lived engine.


title: Rapid solution for searching similar audio items

abstract: A naive approach for finding similar audio items would be to compare each entry from the feature vector of the test example with each feature vector of the candidates in a k-nearest neighbors fashion. There are already two problems with this approach: audio signals are represented by high dimensional vectors and the number of candidates can be very large - think thousands. The search process would have a high complexity. Our paper will treat this problem through hashing methodologies more specifically the Locality Sensitive Hashing. This project will be in the spirit of classification and clustering problems. The computer sound production principles will be used to determine which features that describe an audio signal are the most useful. That will down-sample the size of the feature vectors and speed up the process subsequently.


title: Rotational symmetry of solutions of mean curvature flow coming out of a double cone II

abstract: We show that any integral Brakke flow coming out of a rotationally symmetric double cone with entropy at most two must stay rotationally symmetric for all time, provided the flow is smooth for a short time. We also show the existence of a non-self-similar flow coming out of a double cone with entropy at most two, and give an example of such a flow with a finite time singularity.


title: Dynamical Stabilization of Multiplet Supercurrents in Multi-terminal Josephson Junctions

abstract: The dynamical properties of multi-terminal Josephson junctions have recently attracted interest, driven by the promise of new insights into synthetic topological phases of matter and Floquet states. This effort has culminated in the discovery of Cooper multiplets, in which the splitting of a Cooper pair is enabled via a series of Andreev reflections that entangle four (or more) electrons. In this text, we show conclusively that multiplet resonances can also emerge as a consequence of the three terminal circuit model. The supercurrent appears due to the correlated phase dynamics at values that correspond to the multiplet condition $nV_1 = -mV_2$ of applied bias. The emergence of multiplet resonances is seen in i) a nanofabricated three-terminal graphene Josephson junction, ii) an analog three terminal Josephson junction circuit, and iii) a circuit simulation. The mechanism which stabilizes the state of the system under those conditions is purely dynamical, and a close analog to Kapitza's inverted pendulum problem. We describe parameter considerations that best optimize the detection of the multiplet lines both for design of future devices. Further, these supercurrents have a classically robust $\cos2\phi$ energy contribution, which can be used to engineer qubits based on higher harmonics.


title: Searching, Learning, and Subtopic Ordering: A Simulation-based Analysis

abstract: Complex search tasks - such as those from the Search as Learning (SAL) domain - often result in users developing an information need composed of several aspects. However, current models of searcher behaviour assume that individuals have an atomic need, regardless of the task. While these models generally work well for simpler informational needs, we argue that searcher models need to be developed further to allow for the decomposition of a complex search task into multiple aspects. As no searcher model yet exists that considers both aspects and the SAL domain, we propose, by augmenting the Complex Searcher Model (CSM), the Subtopic Aware Complex Searcher Model (SACSM) - modelling aspects as subtopics to the user's need. We then instantiate several agents (i.e., simulated users), with different subtopic selection strategies, which can be considered as different prototypical learning strategies (e.g., should I deeply examine one subtopic at a time, or shallowly cover several subtopics?). Finally, we report on the first large-scale simulated analysis of user behaviours in the SAL domain. Results demonstrate that the SACSM, under certain conditions, simulates user behaviours accurately.


title: Hyperparameter Tuning for Deep Reinforcement Learning Applications

abstract: Reinforcement learning (RL) applications, where an agent can simply learn optimal behaviors by interacting with the environment, are quickly gaining tremendous success in a wide variety of applications from controlling simple pendulums to complex data centers. However, setting the right hyperparameters can have a huge impact on the deployed solution performance and reliability in the inference models, produced via RL, used for decision-making. Hyperparameter search itself is a laborious process that requires many iterations and computationally expensive to find the best settings that produce the best neural network architectures. In comparison to other neural network architectures, deep RL has not witnessed much hyperparameter tuning, due to its algorithm complexity and simulation platforms needed. In this paper, we propose a distributed variable-length genetic algorithm framework to systematically tune hyperparameters for various RL applications, improving training time and robustness of the architecture, via evolution. We demonstrate the scalability of our approach on many RL problems (from simple gyms to complex applications) and compared with Bayesian approach. Our results show that with more generations, optimal solutions that require fewer training episodes and are computationally cheap while being more robust for deployment. Our results are imperative to advance deep reinforcement learning controllers for real-world problems.


title: A dual approach for federated learning

abstract: We study the federated optimization problem from a dual perspective and propose a new algorithm termed federated dual coordinate descent (FedDCD), which is based on a type of coordinate descent method developed by Necora et al.[Journal of Optimization Theory and Applications, 2017]. Additionally, we enhance the FedDCD method with inexact gradient oracles and Nesterov's acceleration. We demonstrate theoretically that our proposed approach achieves better convergence rates than the state-of-the-art primal federated optimization algorithms under certain situations. Numerical experiments on real-world datasets support our analysis.


title: Incremental Fermi Large Area Telescope Fourth Source Catalog

abstract: We present an incremental version (4FGL-DR3, for Data Release 3) of the fourth Fermi-LAT catalog of gamma-ray sources. Based on the first twelve years of science data in the energy range from 50 MeV to 1 TeV, it contains 6658 sources. The analysis improves on that used for the 4FGL catalog over eight years of data: more sources are fit with curved spectra, we introduce a more robust spectral parameterization for pulsars, and we extend the spectral points to 1 TeV. The spectral parameters, spectral energy distributions, and associations are updated for all sources. Light curves are rebuilt for all sources with 1 yr intervals (not 2 month intervals). Among the 5064 original 4FGL sources, 16 were deleted, 112 are formally below the detection threshold over 12 yr (but are kept in the list), while 74 are newly associated, 10 have an improved association, and seven associations were withdrawn. Pulsars are split explicitly between young and millisecond pulsars. Pulsars and binaries newly detected in LAT sources, as well as more than 100 newly classified blazars, are reported. We add three extended sources and 1607 new point sources, mostly just above the detection threshold, among which eight are considered identified, and 699 have a plausible counterpart at other wavelengths. We discuss degree-scale residuals to the global sky model and clusters of soft unassociated point sources close to the Galactic plane, which are possibly related to limitations of the interstellar emission model and missing extended sources.


title: The Polyhedral Tree Complex

abstract: The tree complex is a simplicial complex defined in recent work of Belk, Lanier, Margalit, and Winarski with natural applications to mapping class groups and complex dynamics. In this article, we connect this setting with the study of certain convex polytopes: associahedra and cyclohedra. Specifically, we describe a characterization of these polytopes using planar embeddings of trees and show that the tree complex is the barycentric subdivision of a polyhedral cell complex for which the cells are products of associahedra and cyclohedra.


title: Hochschild homology of twisted crossed products and twisted graded Hecke algebras

abstract: Let A be a \C-algebra with an action of a finite group G, let $\natural$ be a 2-cocycle on $G$ and consider the twisted crossed product $A \rtimes \C [G,\natural]$. We determine the Hochschild homology of $A \rtimes \C [G,\natural]$ for two classes of algebras A: - rings of regular functions on nonsingular affine varieties, - graded Hecke algebras. The results are achieved via algebraic families of (virtual) representations and include a description of the Hochschild homology as module over the centre of $A \rtimes \C [G,\natural]$. This paper prepares for a computation of the Hochschild homology of the Hecke algebra of a reductive p-adic group.


title: DIREG3D: DIrectly REGress 3D Hands from Multiple Cameras

abstract: In this paper, we present DIREG3D, a holistic framework for 3D Hand Tracking. The proposed framework is capable of utilizing camera intrinsic parameters, 3D geometry, intermediate 2D cues, and visual information to regress parameters for accurately representing a Hand Mesh model. Our experiments show that information like the size of the 2D hand, its distance from the optical center, and radial distortion is useful for deriving highly reliable 3D poses in camera space from just monocular information. Furthermore, we extend these results to a multi-view camera setup by fusing features from different viewpoints.


title: Crystal structure prediction with machine learning-based element substitution

abstract: The prediction of energetically stable crystal structures formed by a given chemical composition is a central problem in solid-state physics. In principle, the crystalline state of assembled atoms can be determined by optimizing the energy surface, which in turn can be evaluated using first-principles calculations. However, performing the iterative gradient descent on the potential energy surface using first-principles calculations is prohibitively expensive for complex systems, such as those with many atoms per unit cell. Here, we present a unique methodology for crystal structure prediction (CSP) that relies on a machine learning algorithm called metric learning. It is shown that a binary classifier, trained on a large number of already identified crystal structures, can determine the isomorphism of crystal structures formed by two given chemical compositions with an accuracy of approximately 96.4\%. For a given query composition with an unknown crystal structure, the model is used to automatically select from a crystal structure database a set of template crystals with nearly identical stable structures to which element substitution is to be applied. Apart from the local relaxation calculation of the identified templates, the proposed method does not use ab initio calculations. The potential of this substation-based CSP is demonstrated for a wide variety of crystal systems.


title: Coexisting Kondo hybridization and itinerant f-electron ferromagnetism in UGe2

abstract: Kondo hybridization in partially filled f-electron systems conveys significant amount of electronic states sharply near the Fermi energy leading to various instabilities from superconductivity to exotic electronic orders. UGe2 is a 5f heavy fermion system, where the Kondo hybridization is interrupted by the formation of two ferromagnetic phases below a 2nd order transition Tc ~ 52 K and a crossover transition Tx ~ 32 K. These two ferromagnetic phases are concomitantly related to a spin-triplet superconductivity that only emerges and persists inside the magnetically ordered phase at high pressure. The origin of the two ferromagnetic phases and how they form within a Kondo-lattice remain ambiguous. Using scanning tunneling microscopy and spectroscopy, we probe the spatial electronic states in the UGe2 as a function of temperature. We find a Kondo resonance and sharp 5f-electron states near the chemical potential that form at high temperatures above Tc in accordance with our density functional theory (DFT) + Gutzwiller calculations. As temperature is lowered below Tc, the resonance narrows and eventually splits below Tx dumping itinerant f-electron spectral weight right at the Fermi energy. Our findings suggest a Stoner mechanism forming the highly polarized ferromagnetic phase below Tx that itself sets the stage for the emergence of unconventional superconductivity at high pressure.


title: Sharp bounds for multiplicities of Bianchi modular forms

abstract: We prove a degree-one saving bound for the dimension of the space of cohomological automorphic forms of fixed level and growing weight on $\mathrm{SL}_2$ over any number field that is not totally real. In particular, we establish a sharp bound on the growth of cuspidal Bianchi modular forms. We transfer our problem into a question over the completed universal enveloping algebras by applying an algebraic microlocalisation of Ardakov and Wadsley to the completed homology. We prove finitely generated Iwasawa modules under the microlocalisation are generic, solving the representation theoretic question by estimating growth of Poincar\'e-Birkhoff-Witt filtrations on such modules.


title: Bohm criterion of plasma sheaths away from asymptotic limit

abstract: The plasma exit flow speed at the sheath entrance is constrained by the Bohm criterion. The so-called Bohm speed regulates the plasma particle and power exhaust fluxes to the wall, and it is commonly deployed as a boundary condition to exclude the sheath region in quasi-neutral plasma modeling. Here the Bohm criterion analysis is performed in the intermediate plasma regime away from the previously known limiting cases of adiabatic laws and the asymptotic limit of infinitesimal Debye length in a finite-size system, using the transport equations of an anisotropic plasma. The resulting Bohm speed has explicit dependence on local plasma heat flux, temperature isotropization, and thermal force. Comparison with kinetic simulations demonstrates its accuracy over the plasma-sheath transition region in which quasineutrality is weakly perturbed and Bohm criterion applies.


title: ReforesTree: A Dataset for Estimating Tropical Forest Carbon Stock with Deep Learning and Aerial Imagery

abstract: Forest biomass is a key influence for future climate, and the world urgently needs highly scalable financing schemes, such as carbon offsetting certifications, to protect and restore forests. Current manual forest carbon stock inventory methods of measuring single trees by hand are time, labour, and cost-intensive and have been shown to be subjective. They can lead to substantial overestimation of the carbon stock and ultimately distrust in forest financing. The potential for impact and scale of leveraging advancements in machine learning and remote sensing technologies is promising but needs to be of high quality in order to replace the current forest stock protocols for certifications. In this paper, we present ReforesTree, a benchmark dataset of forest carbon stock in six agro-forestry carbon offsetting sites in Ecuador. Furthermore, we show that a deep learning-based end-to-end model using individual tree detection from low cost RGB-only drone imagery is accurately estimating forest carbon stock within official carbon offsetting certification standards. Additionally, our baseline CNN model outperforms state-of-the-art satellite-based forest biomass and carbon stock estimates for this type of small-scale, tropical agro-forestry sites. We present this dataset to encourage machine learning research in this area to increase accountability and transparency of monitoring, verification and reporting (MVR) in carbon offsetting projects, as well as scaling global reforestation financing through accurate remote sensing.


title: The quantum jump method: photon statistics and macroscopic quantum jumps of two interacting atoms

abstract: We first use the quantum method to replicate the well-known results of a single atom relaxing, whilst demonstrating the intuitive picture it provides for dissipative dynamics. By use of individual "quantum trajectories", the method allows for simulation of systems inaccessible to ensemble treatments. This is shown by replicating resonance fluorescence, allowing us to concurrently demonstrate the method's facilitation of calculating photon statistics by the creation of discrete photon streams. To analyse these, we solidify the theoretical basis for, and implement, a computational method of calculating second-order coherence functions. A process by which to model interacting two-atom systems to allow for computation with the quantum jump method is then developed. Using this, we demonstrate cooperative effects leading to greatly modified emission spectra, before investigating the decoupling of states from dissipative and coherent interactions. Here, we find the novel insight provided by the quantum jump method both births and provides the tools with which to begin an investigation into the occurrence of macroscopic jumps and the formation of macroscopic dark periods in a system of two two-level dipole-dipole coupled atoms.


title: Attention cannot be an Explanation

abstract: Attention based explanations (viz. saliency maps), by providing interpretability to black box models such as deep neural networks, are assumed to improve human trust and reliance in the underlying models. Recently, it has been shown that attention weights are frequently uncorrelated with gradient-based measures of feature importance. Motivated by this, we ask a follow-up question: "Assuming that we only consider the tasks where attention weights correlate well with feature importance, how effective are these attention based explanations in increasing human trust and reliance in the underlying models?". In other words, can we use attention as an explanation? We perform extensive human study experiments that aim to qualitatively and quantitatively assess the degree to which attention based explanations are suitable in increasing human trust and reliance. Our experiment results show that attention cannot be used as an explanation.


title: Explaining Preferences by Multiple Patterns in Voters' Behavior

abstract: In some preference aggregation scenarios, voters' preferences are highly structured: e.g., the set of candidates may have one-dimensional structure (so that voters' preferences are single-peaked) or be described by a binary decision tree (so that voters' preferences are group-separable). However, sometimes a single axis or a decision tree is insufficient to capture the voters' preferences; rather, there is a small number $k$ of axes or decision trees such that each vote in the profile is consistent with one of these axes (resp., trees). In this work, we study the complexity of deciding whether voters' preferences can be explained in this manner. For $k=2$, we use the technique developed by Yang~[2020] in the context of single-peaked preferences to obtain a polynomial-time algorithm for several domains: value-restricted preferences, group-separable preferences, and a natural subdomain of group-separable preferences, namely, caterpillar group-separable preferences. For $k\ge 3$, the problem is known to be hard for single-peaked preferences; we show that this is also the case for value-restricted and group-separable preferences. Our positive results for $k=2$ make use of forbidden minor characterizations of the respective domains; in particular, we establish that the domain of caterpillar group-separable preferences admits a forbidden minor characterization.


title: IMACS: Image Model Attribution Comparison Summaries

abstract: Developing a suitable Deep Neural Network (DNN) often requires significant iteration, where different model versions are evaluated and compared. While metrics such as accuracy are a powerful means to succinctly describe a model's performance across a dataset or to directly compare model versions, practitioners often wish to gain a deeper understanding of the factors that influence a model's predictions. Interpretability techniques such as gradient-based methods and local approximations can be used to examine small sets of inputs in fine detail, but it can be hard to determine if results from small sets generalize across a dataset. We introduce IMACS, a method that combines gradient-based model attributions with aggregation and visualization techniques to summarize differences in attributions between two DNN image models. More specifically, IMACS extracts salient input features from an evaluation dataset, clusters them based on similarity, then visualizes differences in model attributions for similar input features. In this work, we introduce a framework for aggregating, summarizing, and comparing the attribution information for two models across a dataset; present visualizations that highlight differences between 2 image classification models; and show how our technique can uncover behavioral differences caused by domain shift between two models trained on satellite images.


title: Challenges and Opportunities for Machine Learning Classification of Behavior and Mental State from Images

abstract: Computer Vision (CV) classifiers which distinguish and detect nonverbal social human behavior and mental state can aid digital diagnostics and therapeutics for psychiatry and the behavioral sciences. While CV classifiers for traditional and structured classification tasks can be developed with standard machine learning pipelines for supervised learning consisting of data labeling, preprocessing, and training a convolutional neural network, there are several pain points which arise when attempting this process for behavioral phenotyping. Here, we discuss the challenges and corresponding opportunities in this space, including handling heterogeneous data, avoiding biased models, labeling massive and repetitive data sets, working with ambiguous or compound class labels, managing privacy concerns, creating appropriate representations, and personalizing models. We discuss current state-of-the-art research endeavors in CV such as data curation, data augmentation, crowdsourced labeling, active learning, reinforcement learning, generative models, representation learning, federated learning, and meta-learning. We highlight at least some of the machine learning advancements needed for imaging classifiers to detect human social cues successfully and reliably.


title: Implementation of Advanced Wind Turbine Controllers for Scaled Turbine Testing in a Wind Tunnel

abstract: Based on a series of two experimental campaigns testing advanced controllers on a scaled wind turbine operating in a wind tunnel, this contribution describes the overall experimental method, challenges faced, lessons learned, and opportunities for future work. The two campaigns, run in Fall 2018 and Fall 2019, tested unconstrained and constrained optimal blade pitch controllers, respectively, using preview disturbance measurements of the oncoming wind. Specifically, the first study considered an extension to the linear-quadratic regulator to include feedforward action, while the second deployed model predictive control to incorporate actuator constraints into the optimal control problem. The results of the campaigns have already been published in technical conference and journal papers on control systems; however, detail on how the controllers were implemented was not included in those works. We aim to fill that gap with this contribution, which is targeted at the wind energy community. We describe several aspects of the experimental setup, in particular providing details of the software and hardware used for the controller; share insight on several aspects of the procedure that were difficult and how we overcame those challenges; and summarize the key differences between simulation-based studies and physical testing. By doing so, we hope to share what we learned during our experimental campaigns and provide a point of reference for others looking to carry out experiments on scaled wind turbines operating in wind tunnel facilities.


title: Nonlinearity and wavelength control in ultrashort-pulse subsurface material processing

abstract: The pronounced dependence of the nonlinear parameters of both dielectric and semiconductor materials on the wavelength, and the nonlinear interaction between the ultra-short laser pulse and the material requires precise control of the wavelength of the pulse, in addition to the precise control of the pulse energy, pulse duration and focusing optics. This becomes particularly important for fine sub-wavelength single pulse sub-surface processing. Based on two different numerical models and taking Si as example material, we investigate the spatio-temporal behavior of a pulse propagating through the material while covering a broad range of parameters. The wavelength-dependence of material processing depends on the different contributions of two- and tree-photon absorption in combination with the Kerr effect which results in a particularly sharp nonlinear peak at ~2100 nm. We could show that in silicon this makes processing preferable close to this wavelength. The impact of the nonlinear nonparaxial propagation effects on spatio-temporal beam structure is also investigated. It could be shown that with increasing wavelength and large focusing angles the aberrations at the focal spot can be reduced, and thereby cleaner and more precise processing can be achieved. Finally, we could show that the optimum energy transfer from the pulse to the material is within a narrow window of pulse durations between 600 to 900 fs.


title: Memristive effects in nanopatterned permalloy Kagom\'{e} array

abstract: We study memristive effects in Kagom\'{e} nanopatterned permalloy. We observe that at low frequencies a thermistor effect is present, a phenomenon arising due to the lithography and absent in similar experiments for thin films. However, we also show via an independent anisotropic magnetoresistive study that a small hysteresis accounting for 1% of the effect is not attributable to a thermistive effect. Such effect is also confirmed by a careful subtraction scheme between nearby thermal hysteresis. In the millihertz regime, an effective model is provided to describe the experimental results for the thermistor, showing that there should be a crossover from the millihertz to the gigahertz, from a thermistor to an memresistive effect for nanopatterned permalloy.


title: Fractional defect charges in $p$-atic liquid crystals on cones

abstract: Conical surfaces, with a delta function of Gaussian curvature at the apex, are perhaps the simplest example of geometric frustration. We study two-dimensional liquid crystals with $p$-fold rotational symmetry ($p$-atics) on the surfaces of cones. For free boundary conditions at the base, we find both the ground state(s) and a discrete ladder of metastable states as a function of both the cone angle and the liquid crystal symmetry $p$. We find that these states are characterized by a set of fractional defect charges at the apex and that the ground states are in general frustrated due to effects of parallel transport along the azimuthal direction of the cone. We check our predictions for the ground state energies numerically for a set of commensurate cone angles (corresponding to a set of commensurate Gaussian curvatures concentrated at the cone apex), whose surfaces can be polygonized as a perfect triangular or square mesh, and find excellent agreement with our theoretical predictions.


title: Low-Resolution Precoding for Multi-Antenna Downlink Channels and OFDM

abstract: Downlink precoding is considered for multi-path multi-input single-output channels where the base station uses orthogonal frequency-division multiplexing and low-resolution signaling. A quantized coordinate minimization (QCM) algorithm is proposed and its performance is compared to other precoding algorithms including squared infinity-norm relaxation (SQUID), multi-antenna greedy iterative quantization (MAGIQ), and maximum safety margin precoding. MAGIQ and QCM achieve the highest information rates and QCM has the lowest complexity measured in the number of multiplications. The information rates are computed for pilot-aided channel estimation and data-aided channel estimation. Bit error rates for a 5G low-density parity-check code confirm the information-theoretic calculations. Simulations with imperfect channel knowledge at the transmitter show that the performance of QCM and SQUID degrades in a similar fashion as zero-forcing precoding with high resolution quantizers.


title: AI-Aided Mapping of the Structure-Composition-Conductivity Relationships of Glass-Ceramic Lithium Thiophosphate Electrolytes

abstract: Lithium thiophosphates (LPS) with the composition (Li$_2$S)$_x$(P$_2$S$_5$)$_{1-x}$ are among the most promising prospective electrolyte materials for solid-state batteries (SSBs), owing to their superionic conductivity at room temperature ($>10^{-3}$ S cm$^{-1}$), soft mechanical properties, and low grain boundary resistance. Several glass-ceramic (gc) LPS with different compositions and good Li conductivity have been previously reported, but the relationship between composition, atomic structure, stability, and Li conductivity remains unclear due to the challenges in characterizing non-crystalline phases in experiments or simulations. Here, we mapped the LPS phase diagram by combining first principles and artificial intelligence (AI) methods, integrating density functional theory, artificial neural network potentials, genetic-algorithm sampling, and ab initio molecular dynamics simulations. By means of an unsupervised structure-similarity analysis, the glassy/ceramic phases were correlated with the local structural motifs in the known LPS crystal structures, showing that the energetically most favorable Li environment varies with the composition. Based on the discovered trends in the LPS phase diagram, we propose a candidate solid-state electrolyte composition, (Li$_{2}$S)$_{x}$(P$_{2}$S$_{5}$)$_{1-x}$ ($x\sim{}0.725$), that exhibits high ionic conductivity ($>10^{-2}$ S cm$^{-1}$) in our simulations, thereby demonstrating a general design strategy for amorphous or glassy/ceramic solid electrolytes with enhanced conductivity and stability.


title: On the Convergence of mSGD and AdaGrad for Stochastic Optimization

abstract: As one of the most fundamental stochastic optimization algorithms, stochastic gradient descent (SGD) has been intensively developed and extensively applied in machine learning in the past decade. There have been some modified SGD-type algorithms, which outperform the SGD in many competitions and applications in terms of convergence rate and accuracy, such as momentum-based SGD (mSGD) and adaptive gradient algorithm (AdaGrad). Despite these empirical successes, the theoretical properties of these algorithms have not been well established due to technical difficulties. With this motivation, we focus on convergence analysis of mSGD and AdaGrad for any smooth (possibly non-convex) loss functions in stochastic optimization. First, we prove that the iterates of mSGD are asymptotically convergent to a connected set of stationary points with probability one, which is more general than existing works on subsequence convergence or convergence of time averages. Moreover, we prove that the loss function of mSGD decays at a certain rate faster than that of SGD. In addition, we prove the iterates of AdaGrad are asymptotically convergent to a connected set of stationary points with probability one. Also, this result extends the results from the literature on subsequence convergence and the convergence of time averages. Despite the generality of the above convergence results, we have relaxed some assumptions of gradient noises, convexity of loss functions, as well as boundedness of iterates.


title: Generative Trees: Adversarial and Copycat

abstract: While Generative Adversarial Networks (GANs) achieve spectacular results on unstructured data like images, there is still a gap on tabular data, data for which state of the art supervised learning still favours to a large extent decision tree (DT)-based models. This paper proposes a new path forward for the generation of tabular data, exploiting decades-old understanding of the supervised task's best components for DT induction, from losses (properness), models (tree-based) to algorithms (boosting). The \textit{properness} condition on the supervised loss -- which postulates the optimality of Bayes rule -- leads us to a variational GAN-style loss formulation which is \textit{tight} when discriminators meet a calibration property trivially satisfied by DTs, and, under common assumptions about the supervised loss, yields "one loss to train against them all" for the generator: the $\chi^2$. We then introduce tree-based generative models, \textit{generative trees} (GTs), meant to mirror on the generative side the good properties of DTs for classifying tabular data, with a boosting-compliant \textit{adversarial} training algorithm for GTs. We also introduce \textit{copycat training}, in which the generator copies at run time the underlying tree (graph) of the discriminator DT and completes it for the hardest discriminative task, with boosting compliant convergence. We test our algorithms on tasks including fake/real distinction, training from fake data and missing data imputation. Each one of these tasks displays that GTs can provide comparatively simple -- and interpretable -- contenders to sophisticated state of the art methods for data generation (using neural network models) or missing data imputation (relying on multiple imputation by chained equations with complex tree-based modeling).


title: Reward-Free RL is No Harder Than Reward-Aware RL in Linear Markov Decision Processes

abstract: Reward-free reinforcement learning (RL) considers the setting where the agent does not have access to a reward function during exploration, but must propose a near-optimal policy for an arbitrary reward function revealed only after exploring. In the the tabular setting, it is well known that this is a more difficult problem than reward-aware (PAC) RL -- where the agent has access to the reward function during exploration -- with optimal sample complexities in the two settings differing by a factor of $|\mathcal{S}|$, the size of the state space. We show that this separation does not exist in the setting of linear MDPs. We first develop a computationally efficient algorithm for reward-free RL in a $d$-dimensional linear MDP with sample complexity scaling as $\widetilde{\mathcal{O}}(d^2 H^5/\epsilon^2)$. We then show a lower bound with matching dimension-dependence of $\Omega(d^2 H^2/\epsilon^2)$, which holds for the reward-aware RL setting. To our knowledge, our approach is the first computationally efficient algorithm to achieve optimal $d$ dependence in linear MDPs, even in the single-reward PAC setting. Our algorithm relies on a novel procedure which efficiently traverses a linear MDP, collecting samples in any given ``feature direction'', and enjoys a sample complexity scaling optimally in the (linear MDP equivalent of the) maximal state visitation probability. We show that this exploration procedure can also be applied to solve the problem of obtaining ``well-conditioned'' covariates in linear MDPs.


title: Discovering Phonetic Inventories with Crosslingual Automatic Speech Recognition

abstract: The high cost of data acquisition makes Automatic Speech Recognition (ASR) model training problematic for most existing languages, including languages that do not even have a written script, or for which the phone inventories remain unknown. Past works explored multilingual training, transfer learning, as well as zero-shot learning in order to build ASR systems for these low-resource languages. While it has been shown that the pooling of resources from multiple languages is helpful, we have not yet seen a successful application of an ASR model to a language unseen during training. A crucial step in the adaptation of ASR from seen to unseen languages is the creation of the phone inventory of the unseen language. The ultimate goal of our work is to build the phone inventory of a language unseen during training in an unsupervised way without any knowledge about the language. In this paper, we 1) investigate the influence of different factors (i.e., model architecture, phonotactic model, type of speech representation) on phone recognition in an unknown language; 2) provide an analysis of which phones transfer well across languages and which do not in order to understand the limitations of and areas for further improvement for automatic phone inventory creation; and 3) present different methods to build a phone inventory of an unseen language in an unsupervised way. To that end, we conducted mono-, multi-, and crosslingual experiments on a set of 13 phonetically diverse languages and several in-depth analyses. We found a number of universal phone tokens (IPA symbols) that are well-recognized cross-linguistically. Through a detailed analysis of results, we conclude that unique sounds, similar sounds, and tone languages remain a major challenge for phonetic inventory discovery.


title: OpenEMS: an open-source Package for Two-Stage Stochastic and Robust Optimization for Ambulance Location and Routing with Applications to Austin-Travis County EMS Data

abstract: Emergency Medical Systems (EMS) provide crucial pre-hospital care and transportation. Faster EMS response time provides quicker pre-hospital care and thus increases survival rate. We reduce response time by providing optimal ambulance stationing and routing decisions by solving two stage stochastic and robust linear programs. Although operational research on ambulance systems is decades old, there is little open-source code and consistency in simulations. We begin to bridge this gap by publishing OpenEMS, in collaboration with the Austin-Travis County EMS (ATCEMS) in Texas, an end-to-end pipeline to optimize ambulance strategic decisions. It includes data handling, optimization, and a calibrated simulation. We hope this open source framework will foster future research with and for EMS. Finally, we provide a detailed case study on the city of Austin, Texas. We find that optimal stationing would increase response time by 88.02 seconds. Further, we design optimal strategies in the case where Austin EMS must permanently add or remove one ambulance from their fleet.


title: On The Energy Statistics of Feature Maps in Pruning of Neural Networks with Skip-Connections

abstract: We propose a new structured pruning framework for compressing Deep Neural Networks (DNNs) with skip connections, based on measuring the statistical dependency of hidden layers and predicted outputs. The dependence measure defined by the energy statistics of hidden layers serves as a model-free measure of information between the feature maps and the output of the network. The estimated dependence measure is subsequently used to prune a collection of redundant and uninformative layers. Model-freeness of our measure guarantees that no parametric assumptions on the feature map distribution are required, making it computationally appealing for very high dimensional feature space in DNNs. Extensive numerical experiments on various architectures show the efficacy of the proposed pruning approach with competitive performance to state-of-the-art methods.


title: Confidence Intervals for the Generalisation Error of Random Forests

abstract: Out-of-bag error is commonly used as an estimate of generalisation error in ensemble-based learning models such as random forests. We present confidence intervals for this quantity using the delta-method-after-bootstrap and the jackknife-after-bootstrap techniques. These methods do not require growing any additional trees. We show that these new confidence intervals have improved coverage properties over the naive confidence interval, in real and simulated examples.


title: Learning Mixtures of Linear Dynamical Systems

abstract: We study the problem of learning a mixture of multiple linear dynamical systems (LDSs) from unlabeled short sample trajectories, each generated by one of the LDS models. Despite the wide applicability of mixture models for time-series data, learning algorithms that come with end-to-end performance guarantees are largely absent from existing literature. There are multiple sources of technical challenges, including but not limited to (1) the presence of latent variables (i.e. the unknown labels of trajectories); (2) the possibility that the sample trajectories might have lengths much smaller than the dimension $d$ of the LDS models; and (3) the complicated temporal dependence inherent to time-series data. To tackle these challenges, we develop a two-stage meta-algorithm, which is guaranteed to efficiently recover each ground-truth LDS model up to error $\tilde{O}(\sqrt{d/T})$, where $T$ is the total sample size. We validate our theoretical studies with numerical experiments, confirming the efficacy of the proposed algorithm.

categories: stat.ML cs.LG cs.SY eess.SY math.ST stat.TH


title: Direct First PSP Observation of the Interaction of Two Successive Interplanetary Coronal Mass Ejections in November 2020

abstract: We investigate the effects of the evolutionary processes in the internal magnetic structure of two interplanetary coronal mass ejections (ICMEs) detected in situ between 2020 November 29 and December 1 by Parker Solar Probe (PSP). The sources of the ICMEs were observed remotely at the Sun in EUV and subsequently tracked to their coronal counterparts in white light. This period is of particular interest to the community since it has been identified as the first widespread solar energetic particle event of Solar Cycle 25. The distribution of various solar and heliospheric-dedicated spacecraft throughout the inner heliosphere during PSP observations of these large-scale magnetic structures enables a comprehensive analysis of the internal evolution and topology of such structures. By assembling different models and techniques, we identify the signatures of interaction between the two consecutive ICMEs and the implications for their internal structure. We use multispacecraft observations in combination with a remote-sensing forward modeling technique, numerical propagation models, and in-situ reconstruction techniques. The outcome, from the full reconciliations, demonstrates that the two CMEs are interacting in the vicinity of PSP. Thus, we identify the in-situ observations based on the physical processes that are associated with the interaction and collision of both CMEs. We also expand the flux rope modeling and in-situ reconstruction technique to incorporate the aging and expansion effects in a distorted internal magnetic structure and explore the implications of both effects in the magnetic configuration of the ICMEs.


title: Monte Carlo simulations in anomalous radiative transfer: a tutorial

abstract: Anomalous radiative transfer (ART) theory is a generalization of classical radiative transfer theory. The present tutorial wants to show how Monte Carlo (MC) codes describing photons transport in anomalous media can be implemented. It is shown that the heart of the method consists in suitably describing, in a "non-classical" manner, photons steps starting from fixed light sources or from boundaries separating regions of the medium with different optical properties. To give a better intuition of the importance of these particular photon step lengths, it is also shown numerically that the described approach is essential to preserve the invariance property for light propagation. An interesting byproduct of the MC method for ART, is that it allow us to simplify the structure of "classical" MC codes, utilized e.g. in biomedical optics.


title: Democratising Risk: In Search of a Methodology to Study Existential Risk

abstract: Studying potential global catastrophes is vital. The high stakes of existential risk studies (ERS) necessitate serious scrutiny and self-reflection. We argue that existing approaches to studying existential risk are not yet fit for purpose, and perhaps even run the risk of increasing harm. We highlight general challenges in ERS: accommodating value pluralism, crafting precise definitions, developing comprehensive tools for risk assessment, dealing with uncertainty, and accounting for the dangers associated with taking exceptional actions to mitigate or prevent catastrophes. The most influential framework for ERS, the 'techno-utopian approach' (TUA), struggles with these issues and has a unique set of additional problems: it unnecessarily combines the study of longtermism and longtermist ethics with the study of extinction, relies on a non-representative moral worldview, uses ambiguous and inadequate definitions, fails to incorporate insights from risk assessment in relevant fields, chooses arbitrary categorisations of risk, and advocates for dangerous mitigation strategies. Its moral and empirical assumptions might be particularly vulnerable to securitisation and misuse. We suggest several key improvements: separating the study of extinction ethics (ethical implications of extinction) and existential ethics (the ethical implications of different societal forms), from the analysis of human extinction and global catastrophe; drawing on the latest developments in risk assessment literature; diversifying the field, and; democratising its policy recommendations.


title: Predicting Succinylation Sites in Proteins with Improved Deep Learning Architecture

abstract: Post-translational modifications (PTMs) in proteins occur after the process of translation. PTMs account for many cellular processes such as deoxyribonucleic acid (DNA) repair, cell signaling and cell death. One of the recent PTMs is succinylation. Succinylation modifies lysine residue from $-1$ to $+1$. Locating succinylation sites using experimental methods, such as mass spectrometry is very laborious. Hence, computational methods are favored using machine learning techniques. This paper proposes a deep learning architecture to predict succinylation sites. The performance of the proposed architecture is compared to the state-of-the-art deep learning architecture and other traditional machine learning techniques for succinylation. It is shown from the performance metrics that the proposed architecture provides a good trade-off between speed of computation and classification accuracy.


title: Serverless Architecture for Bulk Email Management

abstract: Sending emails in large quantities can be tedious considering free services do not cover bulk email and paid services can be costly and are not easy to customize. Traditional email client used for basic emailing services fail to be useful in larger volumes of emails to target people or spread information to consented individuals. This paper proposes a serverless architecture to tackle such problems by using one such offering from the Amazon Web Services(AWS) API which can be easily replaced by a software architects choice of service. The constraints help to make an architecture using components that can fit most of the needs of a serverless backend and extend it to scenarios such mobile notifications, One Time Password (OTP) systems or other means of communication to minimize single point of failure and also decrease the dependency on physical servers for such operations offering a comparable solution within the cloud. The architecture proposed is tested to find the time taken to send the emails of various quantities and see how it affects the cost. The architecture was successful able to send multiple emails in a quick and single invocation and has demonstrated a higher level of scalability compared to conventional methods.


title: Individual element sensitivity for stellar evolutionary isochrones

abstract: Stellar evolution calculations with variable abundance ratios were used to gauge the effects on temperatures, luminosities, and lifetimes in various phases. Individual elements C, N, O, Mg, Si, and Fe were included. Most of the effect relevant to integrated light models is contained in the temperature variable, as opposed to the timescale or luminosity. We derive a recipe for including abundance-sensitive temperature effects that is applicable to existing isochrone grids. The resultant enhanced isochrones are incorporated into composite stellar population models and compared with galaxy data from the Sloan Digital Sky Survey. A severe oxygen-age degeneracy is apparent, 2 - 3 Gyr per 0.1 dex in [O/R], where R represents a heavy element such as Fe. Over the range of early-type galaxy velocity dispersion, the spans of all abundance ratios are reduced but the age range increases, systematically older. Allowing Fe-peak elements the freedom to vary accentuates this increase of age span. Overall, these results sharpen the age-mass correlation known as downsizing but decrease the steepness of abundance ratio gradients. Both of these observations, in turn, imply a more robust contribution from gas free mergers in the histories of typical elliptical galaxies.


title: DNNFuser: Generative Pre-Trained Transformer as a Generalized Mapper for Layer Fusion in DNN Accelerators

abstract: Dataflow/mapping decides the compute and energy efficiency of DNN accelerators. Many mappers have been proposed to tackle the intra-layer map-space. However, mappers for inter-layer map-space (aka layer-fusion map-space), have been rarely discussed. In this work, we propose a mapper, DNNFuser, specifically focusing on this layer-fusion map-space. While existing SOTA DNN mapping explorations rely on search-based mappers, this is the first work, to the best of our knowledge, to propose a one-shot inference-based mapper. We leverage Transformer as our DNN architecture to learn layer-fusion optimization as a sequence modeling problem. Further, the trained DNNFuser can generalize its knowledge and infer new solutions for unseen conditions. Within one inference pass, DNNFuser can infer solutions with compatible performance to the ones found by a highly optimized search-based mapper while being 66x-127x faster.


title: Radiative decay of edge states in Floquet media

abstract: We consider the effect of time-periodic forcing on a one-dimensional Schr{\"o}dinger equation with a topologically protected defect (edge) mode. The unforced system models a domain-wall or dislocation defect in a periodic structure, and it supports a defect mode which bifurcates from the Dirac point (linear band crossing) of the underlying bulk medium. We study the robustness of this state against time-periodic forcing of the type that arises in the study of Floquet Topological Insulators in condensed matter, photonics, and cold-atoms systems. Our numerical simulations demonstrate that under time-periodic forcing of sufficiently high frequency, the defect state undergoes radiative leakage of its energy away from the interface into the bulk; the time-decay is exponential on a time-scale proportional to the inverse square of the forcing amplitude. The envelope dynamics of our Floquet system are approximately governed, on long time scales, by an effective (homogenized) periodically-forced Dirac equation. Multiple scale analysis of the effective envelope dynamics yields an expansion of the radiating solution, which shows excellent agreement with our numerical simulations.


title: DiGamma: Domain-aware Genetic Algorithm for HW-Mapping Co-optimization for DNN Accelerators

abstract: The design of DNN accelerators includes two key parts: HW resource configuration and mapping strategy. Intensive research has been conducted to optimize each of them independently. Unfortunately, optimizing for both together is extremely challenging due to the extremely large cross-coupled search space. To address this, in this paper, we propose a HW-Mapping co-optimization framework, an efficient encoding of the immense design space constructed by HW and Mapping, and a domain-aware genetic algorithm, named DiGamma, with specialized operators for improving search efficiency. We evaluate DiGamma with seven popular DNNs models with different properties. Our evaluations show DiGamma can achieve (geomean) 3.0x and 10.0x speedup, comparing to the best-performing baseline optimization algorithms, in edge and cloud settings.


title: A linear linear lambda-calculus

abstract: We present a linearity theorem for a proof language of intuitionistic multiplicative additive linear logic, incorporating addition and scalar multiplication. The proofs in this language are linear in the algebraic sense. This work is part of a broader research program aiming to define a logic with a proof language that forms a quantum programming language.


title: Online Change Point Detection for Weighted and Directed Random Dot Product Graphs

abstract: Given a sequence of random (directed and weighted) graphs, we address the problem of online monitoring and detection of changes in the underlying data distribution. Our idea is to endow sequential change-point detection (CPD) techniques with a graph representation learning substrate based on the versatile Random Dot Product Graph (RDPG) model. We consider efficient, online updates of a judicious monitoring function, which quantifies the discrepancy between the streaming graph observations and the nominal RDPG. This reference distribution is inferred via spectral embeddings of the first few graphs in the sequence. We characterize the distribution of this running statistic to select thresholds that guarantee error-rate control, and under simplifying approximations we offer insights on the algorithm's detection resolution and delay. The end result is a lightweight online CPD algorithm, that is also explainable by virtue of the well-appreciated interpretability of RDPG embeddings. This is in stark contrast with most existing graph CPD approaches, which either rely on extensive computation, or they store and process the entire observed time series. An apparent limitation of the RDPG model is its suitability for undirected and unweighted graphs only, a gap we aim to close here to broaden the scope of the CPD framework. Unlike previous proposals, our non-parametric RDPG model for weighted graphs does not require a priori specification of the weights' distribution to perform inference and estimation. This network modeling contribution is of independent interest beyond CPD. We offer an open-source implementation of the novel online CPD algorithm for weighted and direct graphs, whose effectiveness and efficiency are demonstrated via (reproducible) synthetic and real network data experiments.


title: Directly Revealing Entanglement Dynamics through Quantum Correlation Transfer Functions with Resultant Demonstration of the Mechanism of Many-Body Localization

abstract: The fundamental link between entanglement dynamics and non-equilibrium statistics in isolated quantum systems has been established in theory and confirmed via experiment. However, the understanding of several consequential phenomena, such as the Many-Body Localization (MBL), has been obstructed by the lack of a systematic approach to obtain many-body entanglement dynamics. This paper introduces the Quantum Correlation Transfer Function (QCTF) approach to entanglement dynamics in many-body quantum systems and employs this new framework to demonstrate the mechanism of MBL in disordered spin chains. We show that in the QCTF framework, the entanglement dynamics of two-level constituent particles of a many-body quantum system can be fully characterized directly from the system's Hamiltonian, which circumvents the bottleneck of calculating the many-body system's time-evolution. By employing the QCTF-based approach to entanglement dynamics, we demonstrate MBL dynamics in disordered Heisenberg spin chains through the suppressed quasi-periodic spin's entanglement evolution after a quench from an anti-ferromagnetic state. Furthermore, we prove the validity of a previous fundamental conjecture regarding the MBL phase by showing that in strongly-disordered spin chains with short-range interactions, the quantum correlation between particles is exponentially attenuated with respect to the site-to-site distance. Moreover, we obtain the lowest possible amplitude of the quasi-periodic spin's entanglement as a function of disorder in the chain. The QCTF analysis is verified by exact numerical simulation of the system's evolution. We also show that QCTF provides a new foundation to study the Eigenstate Thermalization Hypothesis (ETH). The QCTF methodology can be extended in various ways to address general issues regarding non-equilibrium quantum thermodynamics in spin lattices with different geometries.


title: Mean-field model for the Curie-Weiss temperature dependence of coherence length in metallic liquids

abstract: The coherence length of the medium-range order (MRO) in metallic liquids is known to display a Curie-Weiss temperature dependence; its inverse is linearly related to temperature, and when extrapolated from temperatures above the glass transition, the coherence length diverges at a negative temperature with a critical exponent of unity. We propose a mean-field pseudospin model that explains this behavior. Specifically, we model the atoms and their local environment as Ising spins with antiferromagnetic exchange interactions. We further superimpose an exchange interaction between dynamical heterogeneities, or clusters of atoms undergoing cooperative motion. The coherence length in the metallic liquid is thus the correlation length between dynamical heterogeneities. Our results reaffirm the idea that the MRO coherence length is a measure of point-to-set correlations, and that local frustrations in the interatomic interactions are prominent in metallic liquids.

categories: cond-mat.soft cond-mat.dis-nn cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.stat-mech


title: Multiple feedback based wavefront shaping method to retrieve hidden signal

abstract: We present an optical wavefront shaping approach that allows tracking and localization of signal hidden inside or behind a scattering medium. The method combines traditional feedback based wavefront shaping together with a switch function, controlled by two different signals. A simple, in transmission imaging system is used with two detectors: one monitors the speckle signature and the other tracks the fully hidden signal (e.g., fluorescent beads). The algorithm initially finds the optimal incident wavefront to maximize light transmission to generate a focus in the scattering medium. This modulation process redirects the scattered input signal inducing instantaneous changes in both monitored signals, which in turn locates the hidden objects. Once the response from the hidden target becomes distinct, the algorithm switches to use this signal as the feedback. We provide experimental demonstrations as a proof of concept of our approach. Potential applications of our method include extracting information from biological samples and developing non-invasive diagnosis methods.


title: An Exploration of Captioning Practices and Challenges of Individual Content Creators on YouTube for People with Hearing Impairments

abstract: Deaf and Hard-of-Hearing (DHH) audiences have long complained about caption qualities for many online videos created by individual content creators on video-sharing platforms (e.g., YouTube). However, there lack explorations of practices, challenges, and perceptions of online video captions from the perspectives of both individual content creators and DHH audiences. In this work, we first explore DHH audiences' feedback on and reactions to YouTube video captions through interviews with 13 DHH individuals, and uncover DHH audiences' experiences, challenges, and perceptions on watching videos created by individual content creators (e.g., manually added caption tags could create additional confidence and trust in caption qualities for DHH audiences). We then discover individual content creators' practices, challenges, and perceptions on captioning their videos (e.g., back-captioning problems) by conducting a YouTube video analysis with 189 captioning-related YouTube videos, followed by a survey with 62 individual content creators. Overall, our findings provide an in-depth understanding of captions generated by individual content creators and bridge the knowledge gap mutually between content creators and DHH audiences on captions.


title: Synchromesh: Reliable code generation from pre-trained language models

abstract: Large pre-trained language models have been used to generate code,providing a flexible interface for synthesizing programs from natural language specifications. However, they often violate syntactic and semantic rules of their output language, limiting their practical usability. In this paper, we propose Synchromesh: a framework for substantially improving the reliability of pre-trained models for code generation. Synchromesh comprises two components. First, it retrieves few-shot examples from a training bank using Target Similarity Tuning (TST), a novel method for semantic example selection. TST learns to recognize utterances that describe similar target programs despite differences in surface natural language features. Then, Synchromesh feeds the examples to a pre-trained language model and samples programs using Constrained Semantic Decoding (CSD): a general framework for constraining the output to a set of valid programs in the target language. CSD leverages constraints on partial outputs to sample complete correct programs, and needs neither re-training nor fine-tuning of the language model. We evaluate our methods by synthesizing code from natural language descriptions using GPT-3 and Codex in three real-world languages: SQL queries, Vega-Lite visualizations and SMCalFlow programs. These domains showcase rich constraints that CSD is able to enforce, including syntax, scope, typing rules, and contextual logic. We observe substantial complementary gains from CSD and TST in prediction accuracy and in effectively preventing run-time errors.


title: Continuous Examination by Automatic Quiz Assessment Using Spiral Codes and Image Processing

abstract: We describe a technical solution implemented at Halmstad University to automatise assessment and reporting of results of paper-based quiz exams. Paper quizzes are affordable and within reach of campus education in classrooms. Offering and taking them is accepted as they cause fewer issues with reliability and democratic access, e.g. a large number of students can take them without a trusted mobile device, internet, or battery. By contrast, correction of the quiz is a considerable obstacle. We suggest mitigating the issue by a novel image processing technique using harmonic spirals that aligns answer sheets in sub-pixel accuracy to read student identity and answers and to email results within minutes, all fully automatically. Using the described method, we carry out regular weekly examinations in two master courses at the mentioned centre without a significant workload increase. The employed solution also enables us to assign a unique identifier to each quiz (e.g. week 1, week 2. . . ) while allowing us to have an individualised quiz for each student.


title: On the absence of global weak solutions for a nonlinear time-fractional Schr\"odinger equation

abstract: In this paper, an initial value problem for a nonlinear time-fractional Schr\"odinger equation with a singular logarithmic potential term is investigated. The considered problem involves the left/forward Hadamard-Caputo fractional derivative with respect to the time variable. Using the test function method with a judicious choice of the test function, we obtain sufficient criteria for the absence of global weak solutions.


title: Objective Prediction of Tomorrow's Affect Using Multi-Modal Physiological Data and Personal Chronicles: A Study of Monitoring College Student Well-being in 2020

abstract: Monitoring and understanding affective states are important aspects of healthy functioning and treatment of mood-based disorders. Recent advancements of ubiquitous wearable technologies have increased the reliability of such tools in detecting and accurately estimating mental states (e.g., mood, stress, etc.), offering comprehensive and continuous monitoring of individuals over time. Previous attempts to model an individual's mental state were limited to subjective approaches or the inclusion of only a few modalities (i.e., phone, watch). Thus, the goal of our study was to investigate the capacity to more accurately predict affect through a fully automatic and objective approach using multiple commercial devices. Longitudinal physiological data and daily assessments of emotions were collected from a sample of college students using smart wearables and phones for over a year. Results showed that our model was able to predict next-day affect with accuracy comparable to state of the art methods.


title: Gap Minimization for Knowledge Sharing and Transfer

abstract: Learning from multiple related tasks by knowledge sharing and transfer has become increasingly relevant over the last two decades. In order to successfully transfer information from one task to another, it is critical to understand the similarities and differences between the domains. In this paper, we introduce the notion of \emph{performance gap}, an intuitive and novel measure of the distance between learning tasks. Unlike existing measures which are used as tools to bound the difference of expected risks between tasks (e.g., $\mathcal{H}$-divergence or discrepancy distance), we theoretically show that the performance gap can be viewed as a data- and algorithm-dependent regularizer, which controls the model complexity and leads to finer guarantees. More importantly, it also provides new insights and motivates a novel principle for designing strategies for knowledge sharing and transfer: gap minimization. We instantiate this principle with two algorithms: 1. gapBoost, a novel and principled boosting algorithm that explicitly minimizes the performance gap between source and target domains for transfer learning; and 2. gapMTNN, a representation learning algorithm that reformulates gap minimization as semantic conditional matching for multitask learning. Our extensive evaluation on both transfer learning and multitask learning benchmark data sets shows that our methods outperform existing baselines.


title: Assessment of Sustainable Funding Impact by Exploiting Research Performance Indicators and Semantic Techniques

abstract: This paper deploys bibliometric indices and semantic techniques for understanding to what extent research grants are likely to impact publications, research direction, and co-authorship rate of principal investigators. The novelty of this paper lies within the fact that it includes semantic analysis in the research funding evaluation process in order to effectively study short-term and long-term funding impact in terms of publication outputs. Our dataset consists of researchers that receive research grants from the National ICT Research and Development funding program of Pakistan. We show a number of interesting case studies to conclude that bibliometric-based quantitative assessment combined with semantics can lead to building better sustainable pathways to deploy evaluation frameworks for research funding effectively.


title: Stochastic Identification-based Active Sensing Acousto-Ultrasound SHM Using Stationary Time Series Models

abstract: In this work, a probabilistic damage detection and identification scheme using stochastic time series models in the context of acousto-ultrasound guided wave-based SHM is proposed, and its performance is assessed experimentally. In order to simplify the damage detection and identification process, model parameters are modified based on the singular value decomposition (SVD) as well as the principal component analysis (PCA)-based truncation approach. The modified model parameters are then used to estimate a statistical characteristic quantity that follows a chi-squared distribution. A probabilistic threshold is used instead of a user-defined margin to facilitate automatic damage detection. The method's effectiveness is assessed via multiple experiments using both metallic and composite coupons and under various damage scenarios using damage intersecting and damage non-intersecting paths. The results of the study confirm the high potential and effectiveness of the stochastic time series methods for guided wave-based damage detection and identification in a potentially automated way.


title: From the separable Tammes problem to extremal distributions of great circles in the unit sphere

abstract: A family of spherical caps of the 2-dimensional unit sphere $\mathbb{S}^2$ is called a totally separable packing in short, a TS-packing if any two spherical caps can be separated by a great circle which is disjoint from the interior of each spherical cap in the packing. The separable Tammes problem asks for the largest density of given number of congruent spherical caps forming a TS-packing in $\mathbb{S}^2$. We solve this problem up to $8$ spherical caps and upper bound the density of any TS-packing of congruent spherical caps in terms of their angular radius. Based on this, we show that the centered separable kissing number of $3$-dimensional Euclidean balls is $8$. Furthermore, we prove bounds for the maximum of the smallest inradius of the cells of the tilings generated by $n>1$ great circles in $\mathbb{S}^2$. Next, we prove dual bounds for TS-coverings of $\mathbb{S}^2$ by congruent spherical caps. Here a covering of $\mathbb{S}^2$ by spherical caps is called a totally separable covering in short, a TS-covering if there exists a tiling generated by finitely many great circles of $\mathbb{S}^2$ such that the cells of the tiling are covered by pairwise distinct spherical caps of the covering. Finally, we extend some of our bounds on TS-coverings to spherical spaces of dimension $>2$.


title: Galois cohomology of $p$-adic fields and $(\varphi, \tau)$-modules

abstract: We construct various explicit Herr complexes that compute the Galois cohomology of a $p$-adic representation of the absolute Galois group of a complete discrete valuation field of characteristic $0$ with a perfect residue field of characteristic $p$, using the associated $(\varphi,\tau)$-modules (defined by Xavier Caruso), instead of $(\varphi,\Gamma)$-modules. We also give an application to $p$-divisible groups.


title: Restricted Variable Chevalley-Warning Theorems

abstract: We pursue various restricted variable generalizations of the Chevalley-Warning theorem for low degree polynomial systems over a finite field. Our first such result involves variables restricted to Cartesian products of the Vandermonde subsets of $\F_q$ defined by G\'acs-Weiner and Sziklai-Tak\'ats. We then define an invariant $\uomega(X)$ of a nonempty subset of $\F_q^n$. Our second result involves $X$-restricted variables when the degrees of the polynomials are small compared to $\uomega(X)$. We end by exploring various classes of subsets for which $\uomega(X)$ can be bounded from below.


title: Wigner-Weyl calculus in description of non-dissipative transport phenomena

abstract: Application of Wigner-Weyl calculus to the investigation of non-dissipative transport phenomena is reviewed. We focus on the quantum Hall effect, Chiral Magnetic effect, and Chiral separation effect, and discuss the role of interactions, inhomogeneity, and deviations from equilibrium.


title: Two New Black Widow Millisecond Pulsars In M28

abstract: We report the discovery of two Black Widow millisecond pulsars in the globular cluster M28 with the MeerKAT telescope. PSR J1824$-$2452M (M28M) is a 4.78-ms pulsar in a $5.82\,$hour orbit and PSR J1824$-$2452N (M28N) is a 3.35-ms pulsar in a $4.76\,$hour orbit. Both pulsars have dispersion measures near $119.30\,$pc$\,$cm$^{-3}$ and have low mass companion stars ($\sim$$0.01-0.03\,$M$_\odot$), which do not cause strong radio eclipses or orbital variations. Including these systems, there are now five known black widow pulsars in M28. The pulsar searches were conducted as a part of an initial phase of MeerKAT's globular cluster census (within the TRAPUM Large Survey Project). These faint discoveries demonstrate the advantages of MeerKAT's survey sensitivity over previous searches and we expect to find additional pulsars in continued searches of this cluster.


title: Diagnosing AI Explanation Methods with Folk Concepts of Behavior

abstract: We investigate a formalism for the conditions of a successful explanation of AI. We consider "success" to depend not only on what information the explanation contains, but also on what information the human explainee understands from it. Theory of mind literature discusses the folk concepts that humans use to understand and generalize behavior. We posit that folk concepts of behavior provide us with a "language" that humans understand behavior with. We use these folk concepts as a framework of social attribution by the human explainee - the information constructs that humans are likely to comprehend from explanations - by introducing a blueprint for an explanatory narrative (Figure 1) that explains AI behavior with these constructs. We then demonstrate that many XAI methods today can be mapped to folk concepts of behavior in a qualitative evaluation. This allows us to uncover their failure modes that prevent current methods from explaining successfully - i.e., the information constructs that are missing for any given XAI method, and whose inclusion can decrease the likelihood of misunderstanding AI behavior.


title: Unlikely intersections in the Torelli locus and the G-functions method

abstract: Consider a smooth irreducible Hodge generic curve $S$ defined over $\bar{\Q}$ in the Torelli locus $T_g\subset \mathcal{A}_g$. We establish Zilber-Pink-type statements for such curves depending on their intersection with the boundary of the Baily-Borel compactification of $\mathcal{A}_g$. For example, when our curve intersects the $0$-dimensional stratum of this boundary and $g$ is odd, we show that there are only finitely many points in the curve for which the corresponding Jacobian variety is non-simple. These results follow as a special case of height bounds for exceptional points in $1$-parameter variations of geometric Hodge structures via Andr\'e's G-functions method, which we extend here to the setting of such variations of odd weight.


title: Stochastic Local Volatility models and the Wei-Norman factorization method

abstract: In this paper, we show that a time-dependent local stochastic volatility (SLV) model can be reduced to a system of autonomous PDEs that can be solved using the Heat kernel, by means of the Wei-Norman factorization method and Lie algebraic techniques. Then, we compare the results of traditional Monte Carlo simulations with the explicit solutions obtained by said techniques. This approach is new in the literature and, in addition to reducing a non-autonomous problem into an autonomous one, allows for reduced time in numerical computations.


title: Heterogeneous Peer Effects in the Linear Threshold Model

abstract: The Linear Threshold Model is a widely used model that describes how information diffuses through a social network. According to this model, an individual adopts an idea or product after the proportion of their neighbors who have adopted it reaches a certain threshold. Typical applications of the Linear Threshold Model assume that thresholds are either the same for all network nodes or randomly distributed, even though some people may be more susceptible to peer pressure than others. To address individual-level differences, we propose causal inference methods for estimating individual thresholds that can more accurately predict whether and when individuals will be affected by their peers. We introduce the concept of heterogeneous peer effects and develop a Structural Causal Model which corresponds to the Linear Threshold Model and supports heterogeneous peer effect identification and estimation. We develop two algorithms for individual threshold estimation, one based on causal trees and one based on causal meta-learners. Our experimental results on synthetic and real-world datasets show that our proposed models can better predict individual-level thresholds in the Linear Threshold Model and thus more precisely predict which nodes will get activated over time.


title: Slow spin dynamics in the hyper-honeycomb Lattice [(C2H5)3NH]2Cu2(C2O4)3 revealed by 1H NMR studies

abstract: We report the results of magnetic susceptibility $\chi$ and $^1$H nuclear magnetic resonance (NMR) measurements on a three-dimensional hyper-honeycomb lattice compound [(C$_2$H$_5$)$_3$NH]$_2$Cu$_2$(C$_2$O$_4$)$_3$ (CCCO). The average value of the antiferromagnetic (AFM) exchange coupling between the Cu$^{2+}$ ($S$ = 1/2) spins was determined to be $J$~$\sim$~50 K from the $\chi$ measurements. No long-range magnetic ordering has been observed down to $T$ = 50 mK, although NMR lines become slightly broader at low temperatures below 1 K. The broadening of the NMR spectrum observed below 1 K reveals that the Cu spin moments remain at this temperature, suggesting a non-spin-singlet ground state. The temperature and magnetic field dependence of 1/$T_1$ at temperatures above 20 K is well explained by paramagnetic thermal spin fluctuations where the fluctuation frequency of Cu$^{2+}$ spins is higher than the NMR frequency of the order of MHz. However, a clear signature of the slowing down of the Cu$^{2+}$ spin fluctuations was observed at low temperatures where 1/$T_1$ shows a thermally-activated behavior. The magnetic field dependence of the magnitude of the spin excitation gap suggests that the magnetic behaviors of CCCO are characterized as an AFM chain at low temperatures.


title: A Sharp Inequality Relating Yamabe Invariants on Asymptotically Poincare-Einstein Manifolds with a Ricci Curvature Lower Bound

abstract: For an asymptotically Poincare-Einstein manifold with a lower Ricci curvature bound, we establish a sharp inequality relating the type II Yamabe invariant of the interior and the Yamabe invariant of its conformal infinity


title: Bonds intersecting long paths in $k$-connected graphs

abstract: A well-known question of Gallai (1966) asked whether there is a vertex which passes through all longest paths of a connected graph. Although this has been verified for some special classes of graphs such as outerplanar graphs, circular arc graphs, and series-parallel graphs, the answer is negative for general graphs. In this paper, we prove among other results that if we replace the vertex by a bond, then the answer is affirmative. A bond of a graph is a minimal nonempty edge-cut. In particular, in any 2-connected graph, the set of all edges incident to a vertex is a bond, called a vertex-bond. Clearly, for a 2-connected graph, a path passes through a vertex $v$ if and only if it meets the vertex-bond with respect to $v$. Therefore, a very natural approach to Gallai's question is to study whether there is a bond meeting all longest paths. Let $p$ denote the length of a longest path of connected graphs. We show that for any 2-connected graph, there is a bond meeting all paths of length at least $p-1$. We then prove that for any 3-connected graph, there is a bond meeting all paths of length at least $p-2$. For a $k$-connected graph $(k\ge3)$, we show that there is a bond meeting all paths of length at least $p-t+1$, where $t=\Big\lfloor\sqrt{\frac{k-2}{2}}\Big\rfloor$ if $p$ is even and $t=\Big\lceil\sqrt{\frac{k-2}{2}}\Big\rceil$ if $p$ is odd. Our results provide analogs of the corresponding results of P. Wu and S. McGuinness [Bonds intersecting cycles in a graph, Combinatorica 25 (4) (2005), 439-450] also.


title: HistoKT: Cross Knowledge Transfer in Computational Pathology

abstract: The lack of well-annotated datasets in computational pathology (CPath) obstructs the application of deep learning techniques for classifying medical images. %Since pathologist time is expensive, dataset curation is intrinsically difficult. Many CPath workflows involve transferring learned knowledge between various image domains through transfer learning. Currently, most transfer learning research follows a model-centric approach, tuning network parameters to improve transfer results over few datasets. In this paper, we take a data-centric approach to the transfer learning problem and examine the existence of generalizable knowledge between histopathological datasets. First, we create a standardization workflow for aggregating existing histopathological data. We then measure inter-domain knowledge by training ResNet18 models across multiple histopathological datasets, and cross-transferring between them to determine the quantity and quality of innate shared knowledge. Additionally, we use weight distillation to share knowledge between models without additional training. We find that hard to learn, multi-class datasets benefit most from pretraining, and a two stage learning framework incorporating a large source domain such as ImageNet allows for better utilization of smaller datasets. Furthermore, we find that weight distillation enables models trained on purely histopathological features to outperform models using external natural image data.


title: Data-Quality Based Scheduling for Federated Edge Learning

abstract: FEderated Edge Learning (FEEL) has emerged as a leading technique for privacy-preserving distributed training in wireless edge networks, where edge devices collaboratively train machine learning (ML) models with the orchestration of a server. However, due to frequent communication, FEEL needs to be adapted to the limited communication bandwidth. Furthermore, the statistical heterogeneity of local datasets' distributions, and the uncertainty about the data quality pose important challenges to the training's convergence. Therefore, a meticulous selection of the participating devices and an analogous bandwidth allocation are necessary. In this paper, we propose a data-quality based scheduling (DQS) algorithm for FEEL. DQS prioritizes reliable devices with rich and diverse datasets. In this paper, we define the different components of the learning algorithm and the data-quality evaluation. Then, we formulate the device selection and the bandwidth allocation problem. Finally, we present our DQS algorithm for FEEL, and we evaluate it in different data poisoning scenarios.


title: Electrical Load Forecasting Using Edge Computing and Federated Learning

abstract: In the smart grid, huge amounts of consumption data are used to train deep learning models for applications such as load monitoring and demand response. However, these applications raise concerns regarding security and have high accuracy requirements. In one hand, the data used is privacy-sensitive. For instance, the fine-grained data collected by a smart meter at a consumer's home may reveal information on the appliances and thus the consumer's behaviour at home. On the other hand, the deep learning models require big data volumes with enough variety and to be trained adequately. In this paper, we evaluate the use of Edge computing and federated learning, a decentralized machine learning scheme that allows to increase the volume and diversity of data used to train the deep learning models without compromising privacy. This paper reports, to the best of our knowledge, the first use of federated learning for household load forecasting and achieves promising results. The simulations were done using Tensorflow Federated on the data from 200 houses from Texas, USA.


title: Jointly Learning Knowledge Embedding and Neighborhood Consensus with Relational Knowledge Distillation for Entity Alignment

abstract: Entity alignment aims at integrating heterogeneous knowledge from different knowledge graphs. Recent studies employ embedding-based methods by first learning the representation of Knowledge Graphs and then performing entity alignment via measuring the similarity between entity embeddings. However, they failed to make good use of the relation semantic information due to the trade-off problem caused by the different objectives of learning knowledge embedding and neighborhood consensus. To address this problem, we propose Relational Knowledge Distillation for Entity Alignment (RKDEA), a Graph Convolutional Network (GCN) based model equipped with knowledge distillation for entity alignment. We adopt GCN-based models to learn the representation of entities by considering the graph structure and incorporating the relation semantic information into GCN via knowledge distillation. Then, we introduce a novel adaptive mechanism to transfer relational knowledge so as to jointly learn entity embedding and neighborhood consensus. Experimental results on several benchmarking datasets demonstrate the effectiveness of our proposed model.


title: Neuro-Symbolic Entropy Regularization

abstract: In structured prediction, the goal is to jointly predict many output variables that together encode a structured object -- a path in a graph, an entity-relation triple, or an ordering of objects. Such a large output space makes learning hard and requires vast amounts of labeled data. Different approaches leverage alternate sources of supervision. One approach -- entropy regularization -- posits that decision boundaries should lie in low-probability regions. It extracts supervision from unlabeled examples, but remains agnostic to the structure of the output space. Conversely, neuro-symbolic approaches exploit the knowledge that not every prediction corresponds to a valid structure in the output space. Yet, they does not further restrict the learned output distribution. This paper introduces a framework that unifies both approaches. We propose a loss, neuro-symbolic entropy regularization, that encourages the model to confidently predict a valid object. It is obtained by restricting entropy regularization to the distribution over only valid structures. This loss is efficiently computed when the output constraint is expressed as a tractable logic circuit. Moreover, it seamlessly integrates with other neuro-symbolic losses that eliminate invalid predictions. We demonstrate the efficacy of our approach on a series of semi-supervised and fully-supervised structured-prediction experiments, where we find that it leads to models whose predictions are more accurate and more likely to be valid.


title: Reinforcement Learning Based Query Vertex Ordering Model for Subgraph Matching

abstract: Subgraph matching is a fundamental problem in various fields that use graph structured data. Subgraph matching algorithms enumerate all isomorphic embeddings of a query graph q in a data graph G. An important branch of matching algorithms exploit the backtracking search approach which recursively extends intermediate results following a matching order of query vertices. It has been shown that the matching order plays a critical role in time efficiency of these backtracking based subgraph matching algorithms. In recent years, many advanced techniques for query vertex ordering (i.e., matching order generation) have been proposed to reduce the unpromising intermediate results according to the preset heuristic rules. In this paper, for the first time we apply the Reinforcement Learning (RL) and Graph Neural Networks (GNNs) techniques to generate the high-quality matching order for subgraph matching algorithms. Instead of using the fixed heuristics to generate the matching order, our model could capture and make full use of the graph information, and thus determine the query vertex order with the adaptive learning-based rule that could significantly reduces the number of redundant enumerations. With the help of the reinforcement learning framework, our model is able to consider the long-term benefits rather than only consider the local information at current ordering step.Extensive experiments on six real-life data graphs demonstrate that our proposed matching order generation technique could reduce up to two orders of magnitude of query processing time compared to the state-of-the-art algorithms.


title: Semantic Code Classification for Automated Machine Learning

abstract: A range of applications for automatic machine learning need the generation process to be controllable. In this work, we propose a way to control the output via a sequence of simple actions, that are called semantic code classes. Finally, we present a semantic code classification task and discuss methods for solving this problem on the Natural Language to Machine Learning (NL2ML) dataset.