title: Cross-Domain Imitation Learning via Optimal Transport

abstract: Cross-domain imitation learning studies how to leverage expert demonstrations of one agent to train an imitation agent with a different embodiment or morphology. Comparing trajectories and stationary distributions between the expert and imitation agents is challenging because they live on different systems that may not even have the same dimensionality. We propose Gromov-Wasserstein Imitation Learning (GWIL), a method for cross-domain imitation that uses the Gromov-Wasserstein distance to align and compare states between the different spaces of the agents. Our theory formally characterizes the scenarios where GWIL preserves optimality, revealing its possibilities and limitations. We demonstrate the effectiveness of GWIL in non-trivial continuous control domains ranging from simple rigid transformation of the expert domain to arbitrary transformation of the state-action space.


title: Adjustment of force-gradient operator in symplectic methods

abstract: Many force-gradient explicit symplectic integration algorithms have been designed for the Hamiltonian $H=T (\mathbf{p})+V(\mathbf{q})$ with kinetic energy $T(\mathbf{p})=\mathbf{p}^2/2$ in the existing references. When the force-gradient operator is appropriately adjusted as a new operator, they are still suitable for a class of Hamiltonian problems $H=K(\mathbf{p},\mathbf{q})+V(\mathbf{q})$ with \emph{integrable} part $K(\mathbf{p},\mathbf{q}) = \sum_{i=1}^{n} \sum_{j=1}^{n}a_{ij}p_ip_j+\sum_{i=1}^{n} b_ip_i$, where $a_{ij}=a_{ij}(\textbf{q})$ and $b_i=b_i(\textbf{q})$ are functions of coordinates $\textbf{q}$. The newly adjusted operator is not a force-gradient operator but is similar to the momentum-version operator associated to the potential $V$. The newly extended (or adjusted) algorithms are no longer solvers of the original Hamiltonian, but are solvers of slightly modified Hamiltonians. They are explicit symplectic integrators with symmetry or time-reversibility. Numerical tests show that the standard symplectic integrators without the new operator are generally poorer than the corresponding extended methods with the new operator in computational accuracies and efficiencies. The optimized methods have better accuracies than the corresponding non-optimized counterparts. Among the tested symplectic methods, the two extended optimized seven-stage fourth-order methods of Omelyan, Mryglod and Folk exhibit the best numerical performance. As a result, one of the two optimized algorithms is used to study the orbital dynamical features of a modified H\'{e}non-Heiles system and a spring pendulum. These extended integrators allow for integrations in Hamiltonian problems, such as the spiral structure in self-consistent models of rotating galaxies and the spiral arms in galaxies.


title: Angular momenta in fields from a rotational mechanical antenna

abstract: Mechanic antennas provide opportunities for human portable, VLF communications, where a rotational dipole emits EM signals with angular momenta. In this paper we analytically derive the electromagnetic fields from a rotational electric dipole using Fourier transform method, and find that the radiated fields from the rotational electric dipole carries nonzero energy flow density in both orbital and spin angular momentum (AM) parts by AM flux tensors. Intuitively, a rotation of a dipole induces a longitudinal orbital angular momentum and a longitudinal spin angular momentum both circulating in the rotation direction. And the binding force for the rotational electric dipole is then shown to result mainly from the Coulomb fields. We believe that our work can provide novel communication designs for portable mechanic antennas.


title: Protecting Retail Investors from Order Book Spoofing using a GRU-based Detection Model

abstract: Market manipulation is tackled through regulation in traditional markets because of its detrimental effect on market efficiency and many participating financial actors. The recent increase of private retail investors due to new low-fee platforms and new asset classes such as decentralised digital currencies has increased the number of vulnerable actors due to lack of institutional sophistication and strong regulation. This paper proposes a method to detect illicit activity and inform investors on spoofing attempts, a well-known market manipulation technique. Our framework is based on a highly extendable Gated Recurrent Unit (GRU) model and allows the inclusion of market variables that can explain spoofing and potentially other illicit activities. The model is tested on granular order book data, in one of the most unregulated markets prone to spoofing with a large number of non-institutional traders. The results show that the model is performing well in an early detection context, allowing the identification of spoofing attempts soon enough to allow investors to react. This is the first step to a fully comprehensive model that will protect investors in various unregulated trading environments and regulators to identify illicit activity.


title: Predicting Chemical Hazard across Taxa through Machine Learning

abstract: We applied machine learning methods to predict chemical hazards focusing on fish acute toxicity across taxa. We analyzed the relevance of taxonomy and experimental setup, showing that taking them into account can lead to considerable improvements in the classification performance. We quantified the gain obtained throught the introduction of taxonomic and experimental information, compared to classification based on chemical information alone. We used our approach with standard machine learning models (K-nearest neighbors, random forests and deep neural networks), as well as the recently proposed Read-Across Structure Activity Relationship (RASAR) models, which were very successful in predicting chemical hazards to mammals based on chemical similarity. We were able to obtain accuracies of over 93% on datasets where, due to noise in the data, the maximum achievable accuracy was expected to be below 96%. The best performances were obtained by random forests and RASAR models. We analyzed metrics to compare our results with animal test reproducibility, and despite most of our models "outperform animal test reproducibility" as measured through recently proposed metrics, we showed that the comparison between machine learning performance and animal test reproducibility should be addressed with particular care. While we focused on fish mortality, our approach, provided that the right data is available, is valid for any combination of chemicals, effects and taxa.


title: DeepECMP: Predicting Extracellular Matrix Proteins using Deep Learning

abstract: Introduction: The extracellular matrix (ECM) is a networkof proteins and carbohydrates that has a structural and bio-chemical function. The ECM plays an important role in dif-ferentiation, migration and signaling. Several studies havepredicted ECM proteins using machine learning algorithmssuch as Random Forests, K-nearest neighbours and supportvector machines but is yet to be explored using deep learn-ing. Method: DeepECMP was developed using several previ-ously used ECM datasets, asymmetric undersampling andan ensemble of 11 feed-forward neural networks. Results: The performance of DeepECMP was 83.6% bal-anced accuracy which outperformed several algorithms. Inaddition, the pipeline of DeepECMP has been shown to behighly efficient. Conclusion: This paper is the first to focus on utilizingdeep learning for ECM prediction. Several limitations areovercome by DeepECMP such as computational expense,availability to the public and usability outside of the humanspecies


title: Learning Higher-Order Dynamics in Video-Based Cardiac Measurement

abstract: Computer vision methods typically optimize for first-order dynamics (e.g., optical flow). However, in many cases the properties of interest are subtle variations in higher-order changes, such as acceleration. This is true in the cardiac pulse, where the second derivative can be used as an indicator of blood pressure and arterial disease. Recent developments in camera-based vital sign measurement have shown that cardiac measurements can be recovered with impressive accuracy from videos; however, most of the research has focused on extracting summary statistics such as heart rate. Less emphasis has been put on the accuracy of waveform morphology that is necessary for many clinically meaningful assessments. In this work, we provide evidence that higher-order dynamics are better estimated by neural models when explicitly optimized for in the loss function. Furthermore, adding second-derivative inputs also improves performance when estimating second-order dynamics. We illustrate this, by showing that incorporating the second derivative of both the input frames and the target vital sign signals into the training procedure, models are better able to estimate left ventricle ejection time (LVET) intervals.


title: Direct design of biquad filter cascades with deep learning by sampling random polynomials

abstract: Designing infinite impulse response filters to match an arbitrary magnitude response requires specialized techniques. Methods like modified Yule-Walker are relatively efficient, but may not be sufficiently accurate in matching high order responses. On the other hand, iterative optimization techniques often enable superior performance, but come at the cost of longer run-times and are sensitive to initial conditions, requiring manual tuning. In this work, we address some of these limitations by learning a direct mapping from the target magnitude response to the filter coefficient space with a neural network trained on millions of random filters. We demonstrate our approach enables both fast and accurate estimation of filter coefficients given a desired response. We investigate training with different families of random filters, and find training with a variety of filter families enables better generalization when estimating real-world filters, using head-related transfer functions and guitar cabinets as case studies. We compare our method against existing methods including modified Yule-Walker and gradient descent and show our approach is, on average, both faster and more accurate.


title: Shining ALP Dark Radiation

abstract: String scenarios typically not only predict axion-like particles (ALPs) but also significant amounts of ALP dark radiation originating from the decay of the inflaton or a more general modulus. In this paper, we study the decay of such non-thermally produced relativistic (but massive) ALPs to photons. If the ALPs are sufficiently highly energetic, contribute to $\Delta N_{\rm eff} \gtrsim {\cal O}(0.001)$ and have a mass $m_a\gtrsim$ MeV we find that, using observations of X-, and $\gamma$-rays, the CMB and BBN, very small values of the ALP-photon coupling can be probed, corresponding to an origin of this coupling at the string (or even Planck) scale.


title: 3D MHD Simulation of a Pulsationally-Driven MRI Decretion Disc

abstract: We explore the pulsationally driven orbital mass ejection mechanism for Be star disc formation using isothermal, 3D magnetohydrodynamic (MHD) and hydrodynamic simulations. Non-radial pulsations are added to a star rotating at 95\% of critical as an inner boundary condition that feeds gas into the domain. In MHD, the initial magnetic field within the star is weak. The hydrodynamics simulation has limited angular momentum transport, resulting in repeating cycles of mass accumulation into a rotationally-supported disc at small radii followed by fall-back onto the star. The MHD simulation, conversely, has efficient (Maxwell $\alpha_{\rm M}$ $\sim$ 0.04) angular momentum transport provided by both of turbulent and coherent magnetic fields; a slowly decreting midplane driven by the magnetorotational instability and a supersonic wind on the surface of the disc driven by global magnetic torques. The angle and time-averaged properties near the midplane agree reasonably well with a 1D viscous decretion disc model with a modified $\tilde\alpha=0.5$, in which the gas transitions from a subsonic thin disc to a supersonic spherical wind at the critical point. 1D models, however, cannot capture the multi-phase decretion/angular structure seen in our simulations. Our results demonstrate that, at least under certain conditions, non-radial pulsations on the surface of a rapidly rotating, weakly magnetized star can drive a Keplerian disc with the basic properties of the viscous decretion disc paradigm, albeit coupled to a laminar wind away from the midplane. Future modeling of Be star discs should consider the possible existence of such a surface wind.


title: Higgs decays to two leptons and a photon beyond leading order in the SMEFT

abstract: We present the three-body decay of the Higgs boson into two leptons and a photon to dimension-eight in the Standard Model Effective Field Theory (SMEFT). In order to obtain this result we interfere the full one-loop Standard Model result with the tree-level result in the SMEFT. This is the first calculation of the partial width of the Higgs boson into two leptons and a photon in the SMEFT to incorporate the full one-loop dependence for the Standard Model as well as the full tree level dimension-eight dependence in the SMEFT. We find that this channel can aid in distinguishing strongly interacting and weakly interacting UV completions of the SMEFT under standard assumptions. We also find that this channel presents the opportunity to distinguish different operator Classes within the SMEFT, potentially including contact $H\bar\ell\ell\gamma$ operators which are first generated only at dimension-eight in the SMEFT.


title: Magnetic Archaeology of Early-Type Stellar Dynamos

abstract: Early-type stars show a bimodal distribution of magnetic field strengths, with some showing very strong fields ($\gtrsim 1\,\mathrm{kG}$) and others very weak fields ($\lesssim 10\,\mathrm{G}$). Recently, we proposed that this reflects the processing or lackthereof of fossil fields by subsurface convection zones. Stars with weak fossil fields process these at the surface into even weaker dynamo-generated fields, while in stars with stronger fossil fields magnetism inhibits convection, allowing the fossil field to remain as-is. We now expand on this theory and explore the time-scales involved in the evolution of near-surface magnetic fields. We find that mass loss strips near-surface regions faster than magnetic fields can diffuse through them. As a result, observations of surface magnetism directly probe the frozen-in remains of the convective dynamo. This explains the slow evolution of magnetism in stars with very weak fields: these dynamo-\emph{generated} magnetic fields evolve on the time-scale of the mass loss, not that of the dynamo.


title: 2d $\mathcal{N}=(0,1)$ Gauge Theories and Spin(7) Orientifolds

abstract: We initiate the geometric engineering of 2d $\mathcal{N}=(0,1)$ gauge theories on D1-branes probing singularities. To do so, we introduce a new class of backgrounds obtained as quotients of Calabi-Yau 4-folds by a combination of an anti-holomorphic involution leading to a Spin(7) cone and worldsheet parity. We refer to such constructions as Spin(7) orientifolds. Spin(7) orientifolds explicitly realize the perspective on 2d $\mathcal{N}=(0,1)$ theories as real slices of $\mathcal{N}=(0,2)$ ones. Remarkably, this projection is geometrically realized as Joyce's construction of Spin(7) manifolds via quotients of Calabi-Yau 4-folds by anti-holomorphic involutions. We illustrate this construction in numerous examples with both orbifold and non-orbifold parent singularities, discuss the role of the choice of vector structure in the orientifold quotient, and study partial resolutions.


title: Real corrections to Higgs boson pair production at NNLO in the large top quark mass limit

abstract: In this paper we consider the next-to-next-to-leading order total cross section of Higgs boson pair production in the large top quark mass limit and compute four expansion terms in $1/m_t^2$. Good convergence is observed below the top quark threshold, which makes our results a valuable input for approximation methods which aim for next-to-next-to-leading order corrections over the whole kinematic range. We present details on various steps of our calculation; in particular, we provide results for three- and four-particle phase-space master integrals and describe in detail the evaluation of the collinear counterterms.


title: Symmetry Breaking in Dynamical Encounters in the Disks of Active Galactic Nuclei

abstract: Active galactic nucleus (AGN) disks may be important sites of binary black hole (BBH) mergers. Here we show via numerical experiments with the high-accuracy, high precision code {\tt SpaceHub} that broken symmetry in dynamical encounters in AGN disks can lead to an asymmetry between prograde and retrograde BBH mergers. The direction of the hardening asymmetry depends on the initial binary semi-major axis. An asymmetric distribution of mass-weighted projected spin $\chi_{\rm eff}$ should therefore be expected in LIGO-Virgo detections of BBH mergers from AGN disks. This channel further predicts that negative $\chi_{\rm eff}$ BBH mergers are most likely for massive binaries.


title: A semi-numerical method for one-scale problems applied to the $\overline{\rm MS}$-on-shell relation

abstract: We discuss a practical approach to compute master integrals entering physical quantities which depend on one parameter. As an example we consider four-loop QCD corrections to the relation between a heavy quark mass defined in the $\overline{\rm MS}$ and on-shell scheme in the presence of a second heavy quark.


title: Lowest Landau level theory of the bosonic Jain states

abstract: Quantum Hall systems offer the most familiar setting where strong inter-particle interactions combine with the topology of single particle states to yield novel phenomena. Despite our mature understanding of these systems, an open challenge has been to to develop a microscopic theory capturing both their universal and non-universal properties, when the Hamiltonian is restricted to the non-commutative space of the lowest Landau level. Here we develop such a theory for the Jain sequence of bosonic fractional quantum Hall states at fillings $\nu={p\over p+1}$. Building on a lowest Landau level description of a parent composite fermi liquid at $\nu = 1$, we describe how to dope the system to reach the Jain states. Upon doping, the composite fermions fill non-commutative generalizations of Landau levels, and the Jain states correspond to integer composite fermion filling. Using this approach, we obtain an approximate expression for the bosonic Jain sequence gaps with no reference to any long-wavelength approximation. Furthermore, we show that the universal properties, such as Hall conductivity, are encoded in an effective non-commutative Chern-Simons theory, which is obtained on integrating out the composite fermions. This theory has the same topological content as the familiar Abelian Chern-Simons theory on commutative space.


title: Toward Accurate Modeling of Galaxy Clustering on Small Scales: Constraining the Galaxy-Halo Connection with Optimal Statistics

abstract: Applying halo models to analyze the small-scale clustering of galaxies is a proven method for characterizing the connection between galaxies and their host halos. Such works are often plagued by systematic errors or are limited to clustering statistics which can be predicted analytically. In this work, we employ a numerical mock-based modeling procedure to examine the clustering of SDSS DR7 galaxies. We apply a standard halo occupation distribution (HOD) model to dark-matter-only simulations with a LCDM cosmology. To constrain the theoretical models, we utilize a combination of galaxy number density and selected scales of the projected correlation function, redshift-space correlation function, group multiplicity function, average group velocity dispersion, mark correlation function, and counts-in-cells statistics. We design an algorithm to choose an optimal combination of measurements that yields tight and accurate constraints on our model parameters. Compared to previous work using fewer clustering statistics, we find significant improvement in the constraints on all parameters of our halo model for two different luminosity-threshold galaxy samples. Most interestingly, we obtain unprecedented high-precision constraints on the scatter in the relationship between galaxy luminosity and halo mass. However, our best-fit model results in significant tension (>4 sigma) for both samples, indicating the need to add second-order features to the standard HOD model. To guarantee the robustness of these results, we perform an extensive analysis of the systematic and statistical errors in our modeling procedure, including a first-of-its-kind study of the sensitivity of our constraints to changes in the halo mass function due to baryonic physics.


title: Gas flows in galaxy mergers: supersonic turbulence in bridges, accretion from the circumgalactic medium, and metallicity dilution

abstract: In major galaxy mergers, the orbits of stars are violently perturbed, and gas is torqued to the centre, diluting the gas metallicity and igniting a starburst. In this paper, we study the gas dynamics in and around merging galaxies using a series of cosmological magneto-hydrodynamical (MHD) zoom-in simulations. We find that the gas bridge connecting the merging galaxies pre-coalescence is dominated by turbulent pressure, with turbulent Mach numbers peaking at values of 1.6-3.3. This implies that bridges are dominated by supersonic turbulence, and are thus ideal candidates for studying the impact of extreme environments on star formation. We also find that gas accreted from the circumgalactic medium (CGM) during the merger significantly contributes (27-51 per cent) to the star formation rate (SFR) at the time of coalescence and drives the subsequent reignition of star formation in the merger remnant. Indeed, 19-53 per cent of the SFR at z=0 originates from gas belonging to the CGM prior the merger. Finally, we investigate the origin of the metallicity-diluted gas at the centre of merging galaxies. We show that this gas is rapidly accreted onto the galactic centre with a time-scale much shorter than that of normal star-forming galaxies. This explains why coalescing galaxies are not well-captured by the fundamental metallicity relation.


title: From the Fire: A Deeper Look at the Phoenix Stream

abstract: We use six years of data from the Dark Energy Survey to perform a detailed photometric characterization of the Phoenix stellar stream, a 15-degree long, thin, dynamically cold, low-metallicity stellar system in the southern hemisphere. We use natural splines, a non-parametric modeling technique, to simultaneously fit the stream track, width, and linear density. This updated stream model allows us to improve measurements of the heliocentric distance ($17.4 \pm 0.1\,{\rm (stat.)} \pm 0.8\,{\rm (sys.)}$ kpc) and distance gradient ($-0.009 \pm 0.006$ kpc deg$^{-1}$) of Phoenix, which corresponds to a small change of $0.13 \pm 0.09$ kpc in heliocentric distance along the length of the stream. We measure linear intensity variations on degree scales, as well as deviations in the stream track on $\sim 2$-degree scales, suggesting that the stream may have been disturbed during its formation and/or evolution. We recover three peaks and one gap in linear intensity along with fluctuations in the stream track. Compared to other thin streams, the Phoenix stream shows more fluctuations and, consequently, the study of Phoenix offers a unique perspective on gravitational perturbations of stellar streams. We discuss possible sources of perturbations to Phoenix including baryonic structures in the Galaxy and dark matter subhalos.


title: Generalized Fresnel-Floquet equations for driven quantum materials

abstract: Optical drives at terahertz and mid-infrared frequencies in quantum materials are increasingly used to reveal the nonlinear dynamics of collective modes in correlated many-body systems and their interplay with electromagnetic waves. Recent experiments demonstrated several surprising optical properties of transient states induced by driving, including the appearance of photo-induced edges in the reflectivity in cuprate superconductors, observed both below and above the equilibrium transition temperature. Furthermore, in other driven materials, reflection coefficients larger than unity have been observed. In this paper we demonstrate that unusual optical properties of photoexcited systems can be understood from the perspective of a Floquet system; a system with periodically modulated system parameters originating from pump-induced oscillations of a collective mode. We present a general phenomenological model of reflectivity from Floquet materials, which takes into account parametric generation of excitation pairs. We find a universal phase diagram of drive induced features in reflectivity which evidence a competition between driving and dissipation. To illustrate our general analysis we apply our formalism to two concrete examples motivated by recent experiments: a single plasmon band, which describes Josephson plasmons in layered superconductors, and a phonon-polariton system, which describes upper and lower polaritons in materials such as insulating SiC. Finally we demonstrate that our model can be used to provide an accurate fit to results of phonon-pump - terahertz-probe experiments in the high temperature superconductor $\rm{YBa_2Cu_3O_{6.5}}$. Our model explains the appearance of a pump-induced edge, which is higher in energy than the equilibrium Josephson plasmon edge, even if the interlayer Josephson coupling is suppressed by the pump pulse.


title: Two striking head-tail galaxies in the galaxy cluster IIZW108: insights into transition to turbulence, magnetic fields and particle re-acceleration

abstract: We present deep JVLA observations at 1.4 GHz and 2.7 GHz (full polarization), as well as optical OmegaWINGS/WINGS and X-ray observations of two extended radio galaxies in the IIZW108 galaxy cluster at z = 0.04889. They show a bent tail morphology in agreement with a radio lobed galaxy falling into the cluster potential. Both galaxies are found to possess properties comparable with {narrow-angle} tail galaxies in the literature even though they are part of a low mass cluster. We find a spectral index steepening and an increase in fractional polarization through the galaxy jets and an ordered magnetic field component mostly aligned with the jet direction. This is likely caused by either shear due to the velocity difference of the intracluster medium and the jet fluid and/or magnetic draping of the intracluster medium across the galaxy jets. We find clear evidence that one source is showing two active galactic nuclei (AGN) outbursts from which we expect the AGN has never turned off completely. We show that pure standard electron cooling cannot explain the jet length. We demonstrate therefore that these galaxies can be used as a laboratory to study gentle re-acceleration of relativistic electrons in galaxy jets via transition from laminar to turbulent motion.


title: SVG-Net: An SVG-based Trajectory Prediction Model

abstract: Anticipating motions of vehicles in a scene is an essential problem for safe autonomous driving systems. To this end, the comprehension of the scene's infrastructure is often the main clue for predicting future trajectories. Most of the proposed approaches represent the scene with a rasterized format and some of the more recent approaches leverage custom vectorized formats. In contrast, we propose representing the scene's information by employing Scalable Vector Graphics (SVG). SVG is a well-established format that matches the problem of trajectory prediction better than rasterized formats while being more general than arbitrary vectorized formats. SVG has the potential to provide the convenience and generality of raster-based solutions if coupled with a powerful tool such as CNNs, for which we introduce SVG-Net. SVG-Net is a Transformer-based Neural Network that can effectively capture the scene's information from SVG inputs. Thanks to the self-attention mechanism in its Transformers, SVG-Net can also adequately apprehend relations amongst the scene and the agents. We demonstrate SVG-Net's effectiveness by evaluating its performance on the publicly available Argoverse forecasting dataset. Finally, we illustrate how, by using SVG, one can benefit from datasets and advancements in other research fronts that also utilize the same input format. Our code is available at https://vita-epfl.github.io/SVGNet/.


title: Reflecting on chirality: CP-violating extensions of the single scalar-leptoquark solutions for the $(g-2)_{e,\mu}$ puzzles and their implications for lepton EDMs

abstract: We study the two scalar leptoquarks capable of generating chirally-enhanced, sign-dependent contributions to lepton magnetic dipole moments (MDMs) and electric dipole moments (EDMs), $R_2\sim (\mathbf{3}, \mathbf{2}, 7/6)$ and $S_1\sim (\mathbf{3}, \mathbf{1}, -1/3)$. We consider the case in which the electron and muon sectors are decoupled, and leptoquark couplings are assigned complex values. Adopting the coupling ansatz that the electron dipole operator is generated by charm-containing loops, and muon dipole operator by top-containing loops, we find that both minimal leptoquark models remain viable solutions for reconciling anomalies in the muon and electron MDMs, accounting for either of the two current (disparate) electron MDM results from Cs and Rb interferometry experiments. We also examine the correlated corrections to the muon and electron masses generated by these models, and argue that to minimise fine-tuning this introduces an upper bound on viable leptoquark ($\phi$) masses, $m_{\phi}<\mathcal{O}(4)$ TeV. Similar arguments allow us to make a prediction for the upper bound of the muon EDM generated by these models, $|d_\mu|< \mathcal{O}(10^{-22})\; e$ cm, which could be within reach of upcoming experimental programs, including Muon g$-$2 at Fermilab (FNAL), and muEDM at Paul Scherrer Institute (PSI).


title: The PHANGS-MUSE survey -- Probing the chemo-dynamical evolution of disc galaxies

abstract: We present the PHANGS-MUSE survey, a programme using the MUSE IFS at the ESO VLT to map 19 massive $(9.4 < \log(M_{*}/M_\odot) < 11.0)$ nearby (D < 20 Mpc) star-forming disc galaxies. The survey consists of 168 MUSE pointings (1'x1' each), a total of nearly 15 Million spectra, covering ~1.5 Million independent spectra. PHANGS-MUSE provides the first IFS view of star formation across different local environments (including galaxy centres, bars, spiral arms) in external galaxies at a median resolution of 50~pc, better than the mean inter-cloud distance in the ionised interstellar medium. This `cloud-scale' resolution allows detailed demographics and characterisations of HII regions and other ionised nebulae. PHANGS-MUSE further delivers a unique view on the associated gas and stellar kinematics, and provides constraints on the star formation history. The PHANGS-MUSE survey is complemented by dedicated ALMA CO(2-1) and multi-band HST observations, therefore allowing us to probe the key stages of the star formation process from molecular clouds to HII regions and star clusters. This paper describes the scientific motivation, sample selection, observational strategy, data reduction and analysis process of the PHANGS-MUSE survey. We present our bespoke automated data-reduction framework, which is built on the reduction recipes provided by ESO, but additionally allows for mosaicking and homogenisation of the point spread function. We further present a detailed quality assessment and a brief illustration of the potential scientific applications of the large set of PHANGS-MUSE data products generated by our data analysis framework. The data cubes and analysis data products described in this paper represent the basis for the first PHANGS-MUSE public data release and are available in the ESO archive and via the Canadian Astronomy Data Centre.


title: Variational determination of multi-qubit geometrical entanglement in NISQ computers

abstract: Current noise levels in physical realizations of qubits and quantum operations limit the applicability of conventional methods to characterize entanglement. In this adverse scenario, we follow a quantum variational approach to estimate the geometric measure of entanglement of multiqubit pure states. The algorithm requires only single-qubit gates and measurements, so it is well suited for NISQ devices. This is demonstrated by successfully implementing the method on IBM Quantum devices for Greenberger-Horne-Zeilinger states of $3$, $4$, and $5$ qubits. Numerical simulations with random states show the robustness and accuracy of the method. The scalability of the protocol is numerically demonstrated via matrix product states techniques up to $25$ qubits.


title: Theory of superconductivity in doped quantum paraelectrics

abstract: Recent experiments on Nb-doped SrTiO$_3$ have shown that the superconducting energy gap to the transition temperature ratio maintains the Bardeen-Cooper-Schrieffer (BCS) value throughout its superconducting dome. Motivated by these and related studies, we show that the Cooper pairing mediated by a single soft transverse-optical phonon is the most natural mechanism for such a superconducting dome given experimental constraints, and present the microscopic theory for this pairing mechanism. Furthermore, we show that this mechanism is consistent with the $T^2$ resistivity in the normal state. Lastly, we discuss what physical insights SrTiO$_3$ provides for superconductivity in other quantum paraelectrics such as KTaO$_3$.


title: Lepton flavor violation in the Littlest Higgs Model with T parity realizing an inverse seesaw

abstract: We study lepton flavor violation (LFV) within the Littlest Higgs Model with T parity (LHT) realizing an inverse seesaw (ISS) mechanism of type I. With respect to the traditional LHT, there appear new $\mathcal{O}$(\textcolor{black}{10} TeV) Majorana neutrinos, driving LFV. For $\tau\to\ell\ell'\bar{\ell}"$ (including wrong-sign, $\ell=e, \mu$) decays and $\mu\to e$ conversion in Ti, we get typical rates only one order of magnitude below present bounds ($\ell\to\ell'\gamma$ can reach the current upper limit) and for $Z\to\bar{\tau}\ell$, $\mu\to e e \bar{e}$ and conversion in Au, results are within two orders of magnitude from present limits. Correlations among modes are drastically different to the traditional LHT and other models, which would ease the confrontation of this scenario to eventual measurements of LFV processes involving charged leptons.


title: Gaussian Process for Trajectories

abstract: The Gaussian process is a powerful and flexible technique for interpolating spatiotemporal data, especially with its ability to capture complex trends and uncertainty from the input signal. This chapter describes Gaussian processes as an interpolation technique for geospatial trajectories. A Gaussian process models measurements of a trajectory as coming from a multidimensional Gaussian, and it produces for each timestamp a Gaussian distribution as a prediction. We discuss elements that need to be considered when applying Gaussian process to trajectories, common choices for those elements, and provide a concrete example of implementing a Gaussian process.


title: The population of M dwarfs observed at low radio frequencies

abstract: Coherent low-frequency ($\lesssim 200$ MHz) radio emission from stars encodes the conditions of the outer corona, mass-ejection events, and space weather. Previous low-frequency searches for radio emitting stellar systems have lacked the sensitivity to detect the general population, instead largely focusing on targeted studies of anomalously active stars. Here we present 19 detections of coherent radio emission associated with known M~dwarfs from a blind flux-limited low-frequency survey. Our detections show that coherent radio emission is ubiquitous across the M~dwarf main sequence, and that the radio luminosity is independent of known coronal and chromospheric activity indicators. While plasma emission can generate the low-frequency emission from the most chromospherically active stars of our sample, the origin of the radio emission from the most quiescent sources is yet to be ascertained. Large-scale analogues of the magnetospheric processes seen in gas-giant planets likely drive the radio emission associated with these quiescent stars. The slowest-rotating stars of this sample are candidate systems to search for star-planet interaction signatures.


title: One-loop electroweak Sudakov logarithms: a revisitation and automation

abstract: In this work we revisit the algorithm of Denner and Pozzorini for the calculation of one-loop electroweak Sudakov logarithms and we automate it in the MadGraph5_aMC@NLO framework. We adapt the formulas for modern calculations, keeping light-quarks and photons strictly massless and dealing with infrared divergences via dimensional regularisation. We improve the approximation by taking into account additional logarithms that are angular dependent. We prove that an imaginary term has been previously omitted and we show that it cannot be in general neglected for $2\rightarrow n$ processes with $n> 2$. We extend the algorithm to NLO EW corrections to squared matrix-elements that involve also QCD corrections on top of subleading LO terms. Furthermore, we discuss the usage of this algorithm for approximating physical observables and cross sections. We propose a new approach in which the QED component is consistently removed and we show how it can be superior to the commonly used approaches. The relevance of all the novelties introduced in this work is corroborated by numerical results obtained for several processes in a completely automated way. We thoroughly compare exact NLO EW corrections and their Sudakov approximations both at the amplitude level and for physical observables in high-energy hadronic collisions.


title: PEAF: Learnable Power Efficient Analog Acoustic Features for Audio Recognition

abstract: At the end of Moore's law, new computing paradigms are required to prolong the battery life of wearable and IoT smart audio devices. Theoretical analysis and physical validation have shown that analog signal processing (ASP) can be more power-efficient than its digital counterpart in the realm of low-to-medium signal-to-noise ratio applications. In addition, ASP allows a direct interface with an analog microphone without a power-hungry analog-to-digital converter. Here, we present power-efficient analog acoustic features (PEAF) that are validated by fabricated CMOS chips for running audio recognition. Linear, non-linear, and learnable PEAF variants are evaluated on two speech processing tasks that are demanded in many battery-operated devices: wake word detection (WWD) and keyword spotting (KWS). Compared to digital acoustic features, higher power efficiency with competitive classification accuracy can be obtained. A novel theoretical framework based on information theory is established to analyze the information flow in each individual stage of the feature extraction pipeline. The analysis identifies the information bottleneck and helps improve the KWS accuracy by up to 7%. This work may pave the way to building more power-efficient smart audio devices with best-in-class inference performance.


title: Atom probe analysis of battery materials: challenges and ways forward

abstract: The worldwide developments of electric vehicles, as well as large-scale or grid-scale energy storage to compensate the intermittent nature of renewable energy generation has generated a surge of interest in battery technology. Understanding the factors controlling battery capacity and, critically, their degradation mechanisms to ensure long-term, sustainable and safe operation requires detailed knowledge of their microstructure and chemistry, and their evolution under operating conditions, on the nanoscale. Atom probe tomography (APT) provides compositional mapping of materials in three-dimensions with sub-nanometre resolution, and is poised to play a key role in battery research. However, APT is underpinned by an intense electric-field that can drive lithium migration, and many battery materials are reactive oxides, requiring careful handling and sample transfer. Here, we report on the analysis of both anode and cathode materials, and show that electric-field driven migration can be suppressed by using shielding by embedding powder particles in a metallic matrix or by using a thin conducting surface layer. We demonstrate that for a typical cathode material, cryogenic specimen preparation and transport under ultra-high vacuum leads to major delithiation of the specimen during the analysis. In contrast, transport of specimens through air enables analysis of the material. Finally, we discuss the possible physical underpinnings and discuss ways forward to enable shield of the electric field, which helps address the challenges inherent to the APT analysis of battery materials.


title: Exploring the Voids: Luminosity Functions and Magnetic Field

abstract: We present semi-analytical models for magnetisation of the void inter-galactic medium (IGM) by outflows from void galaxies. The number density of dark matter haloes in an under-dense region (i.e., void) is obtained using the excursion set method extended for such low density environment. The star formation in such haloes has been estimated, taking account of the negative feedback by supernovae. The galaxy formation/evolution model is tuned to provide the $r$-band luminosity function, the stellar mass function and also the color of void galaxies as obtained from recent observations. This star formation model is used to study possible outflows from void galaxies driven by the hot thermal gas and cosmic ray pressures. These outflows drag the magnetic fields present in those galaxies to the void IGM. We show that such a model can magnetise $\sim 30\%$ of the void IGM with the magnetic field strength of $10^{-12}-10^{-10}$ G while considering only magnetic flux freezing condition. Along with this, the megapersec size of individual outflows can explain the non-detection of GeV photons in TeV blazars that put a lower limit of $10^{-16}$ G for void IGM magnetic field with a Mpc coherent length scale.


title: Tritium beta decay with modified neutrino dispersion relations: KATRIN in the dark sea

abstract: We explore beta decays in a dark background field, which could be formed by dark matter, dark energy or a fifth force potential. In such scenarios, the neutrino's dispersion relation will be modified by its collective interaction with the dark field, which can have interesting consequences in experiments using tritium beta decays to determine the absolute neutrino mass. Among the most general interaction forms, the (pseudo)scalar and (axial-)vector ones are found to have interesting effects on the spectrum of beta decays. In particular, the vector and axial-vector potentials can induce distinct signatures by shifting the overall electron energy scale, possibly beyond the usually defined endpoint. The scalar and pseudoscalar potentials are able to mimic a neutrino mass beyond the cosmological bounds. We have placed stringent constraints on the dark potentials based on the available experimental data of KATRIN. The sensitivity of future KATRIN runs is also discussed.


title: Mass Transport in a Moist Planetary Climate Model

abstract: Planetary Climate Models (PCMs) are developed to explore planetary climates other than the Earth. Therefore, the methods implemented need to be suitable for a large diversity of conditions. Every planet with a significant atmosphere has condensible cycles (e.g., hydrological cycle), which can play an essential role in the planet's appearance and environment. We must accurately represent a condensible cycle in our planet simulations to build a powerful planetary climate predictor. OASIS is a 3D PCM capable of self-consistently representing the main physical processes that drive a planet's environment. In this work, we improve the representation of mass transport in OASIS, which is the first step towards a complete and flexible implementation of a condensible cycle. We implement an upwind-biased scheme on a piece-wise linear approximation with a flux-limiter to solve the mass transport equation. We first benchmark the new scheme on a 2D problem that confirms the superior properties of the new method over the central finite-volume method in terms of performance, accuracy and shape-preserving mass distribution. Due to the new scheme's less dispersive nature, we do not have to apply any unphysical diffusion to maintain the model stable. OASIS includes the new improved solver in the total mass and the tracers (e.g., clouds/hazes and individual gas chemical species) transport. We couple the new formulation with physical schemes and validate the new code on two 3D simulations of an ocean Earth-like planet and an ocean tidally-locked planet. The new OASIS simulations are robust and do not show any known problems from the dynamics-physics coupling. We show that the two simulations capture the main characteristics of ocean planet atmospheres and are easy to set up. We propose these two simulations to be the first standard benchmark tests for models built to explore moist planetary environments.


title: Robustness to Incorrect Priors and Controlled Filter Stability in Partially Observed Stochastic Control

abstract: We study controlled filter stability and its effects on the robustness properties of optimal control policies designed for systems with incorrect priors applied to a true system. Filter stability refers to the correction of an incorrectly initialized filter for a partially observed stochastic dynamical system (controlled or control-free) with increasing measurements. This problem has been studied extensively in the control-free context, and except for the standard machinery for linear Gaussian systems involving the Kalman Filter, few studies exist for the controlled setup. One of the main differences between control-free and controlled partially observed Markov chains is that the filter is always Markovian under the former, whereas under a controlled model the filter process may not be Markovian since the control policy may depend on past measurements in an arbitrary (measurable) fashion. This complicates the dependency structure and therefore results from the control-free literature do not directly apply to the controlled setup. In this paper, we study the filter stability problem for controlled stochastic dynamical systems, and provide sufficient conditions for when a falsely initialized filter merges with the correctly initialized filter over time. These stability results are applied to robust stochastic control problems: under filter stability, we bound the difference in the expected cost incurred for implementing an incorrectly designed control policy compared to an optimal policy. A conclusion is that filter stability leads to stronger robustness results to incorrect priors (compared with setups without controlled filter stability). Furthermore, if the optimum cost is that same for each prior, the cost of mismatch between the true prior and the assumed prior is zero.


title: Interaction-induced wavefunction collapse

abstract: Almost a century after the development of quantum mechanics, we still do not have a consensus on the process of collapse of wavefunctions. Some theories require the intervention of a conscious observer while some see it as a stochastic process, and most theories violate energy conservation. In this paper we hypothesise that the collapse of wavefunctions can be caused by interactions with other objects (macroscopic or microscopic) and energy is conserved in that process. To test various hypotheses regarding collapse of wavefunctions, we propose a model system which is the quantum analogue of a classical soft-impact oscillator. We propose some alternative postulates regarding the conditions for and the result of a collapse, and obtain the implication of each on the behavior of observable quantities, which can possibly be experimentally tested.


title: A Meta-learning Approach to Reservoir Computing: Time Series Prediction with Limited Data

abstract: Recent research has established the effectiveness of machine learning for data-driven prediction of the future evolution of unknown dynamical systems, including chaotic systems. However, these approaches require large amounts of measured time series data from the process to be predicted. When only limited data is available, forecasters are forced to impose significant model structure that may or may not accurately represent the process of interest. In this work, we present a Meta-learning Approach to Reservoir Computing (MARC), a data-driven approach to automatically extract an appropriate model structure from experimentally observed "related" processes that can be used to vastly reduce the amount of data required to successfully train a predictive model. We demonstrate our approach on a simple benchmark problem, where it beats the state of the art meta-learning techniques, as well as a challenging chaotic problem.


title: Finite solvable groups whose Gruenberg-Kegel graph has a cut-set

abstract: Let $\Gamma(G)$ be the Gruenberg-Kegel graph of a finite group $G$. We prove that if $G$ is solvable and $\sigma$ is a cut-set for $\Gamma(G)$, then $G$ has a $\sigma$-series of length $5$ whose factors are controlled. As a consequence, we prove that if $G$ is a solvable group and $\Gamma(G)$ has a cut-vertex $p$, then the Fitting length $\ell_F(G)$ of $G$ is bounded and the bound obtained is the best possible. A cut-set is said \emph{minimal} if it does not contain any other proper subset that is a cut-set for the graph. For a finite solvable group $G$, we give a geometrical description of $\Gamma(G)$ when it has a minimal cut-set of size $2$, for a finite solvable group $G$.


title: Defect-driven antiferromagnetic domain walls in CuMnAs films

abstract: Efficient manipulation of antiferromagnetic (AF) domains and domain walls has opened up new avenues of research towards ultrafast, high-density spintronic devices. AF domain structures are known to be sensitive to magnetoelastic effects, but the microscopic interplay of crystalline defects, strain and magnetic ordering remains largely unknown. Here, we reveal, using photoemission electron microscopy combined with scanning X-ray diffraction imaging and micromagnetic simulations, that the AF domain structure in CuMnAs thin films is dominated by nanoscale structural twin defects. We demonstrate that microtwin defects, which develop across the entire thickness of the film and terminate on the surface as characteristic lines, determine the location and orientation of 180 degree and 90 degree domain walls. The results emphasize the crucial role of nanoscale crystalline defects in determining the AF domains and domain walls, and provide a route to optimizing device performance.


title: Energy preserving multiphase flows: Application to falling films

abstract: The numerical simulation of multiphase flows presents several challenges, namely the transport of different phases within de domain and the inclusion of capillary effects. Here, these are approached by enforcing a discrete physics-compatible solution. Extending our previous work on the discretization of surface tension [N. Valle, F. X. Trias, and J. Castro. An energy-preserving level set method for multiphase flows. J. Comput. Phys., 400:108991, 2020] with a consistent mass and momentum transfer a fully energy-preserving multiphase flow method is presented. This numerical technique is showcased within the simulation of a falling film under several working conditions related to the normal operation of LiBr absorption chillers.


title: Bisimulations for Neural Network Reduction

abstract: We present a notion of bisimulation that induces a reduced network which is semantically equivalent to the given neural network. We provide a minimization algorithm to construct the smallest bisimulation equivalent network. Reductions that construct bisimulation equivalent neural networks are limited in the scale of reduction. We present an approximate notion of bisimulation that provides semantic closeness, rather than, semantic equivalence, and quantify semantic deviation between the neural networks that are approximately bisimilar. The latter provides a trade-off between the amount of reduction and deviations in the semantics.


title: Contextual Sentence Classification: Detecting Sustainability Initiatives in Company Reports

abstract: We introduce the novel task of detecting sustainability initiatives in company reports. Given a full report, the aim is to automatically identify mentions of practical activities that a company has performed in order to tackle specific societal issues. New methods for identifying continuous sentence spans need to be developed for capturing the multi-sentence structure of individual sustainability initiatives. We release a new dataset of company reports in which the text has been manually annotated with sustainability initiatives. We also evaluate different models for initiative detection, introducing a novel aggregation and evaluation methodology. Our proposed architecture uses sequences of consecutive sentences to account for contextual information when making classification decisions at the individual sentence level.


title: HABCSm: A Hamming Based t-way Strategy Based on Hybrid Artificial Bee Colony for Variable Strength Test Sets Generation

abstract: Search-based software engineering that involves the deployment of meta-heuristics in applicable software processes has been gaining wide attention. Recently, researchers have been advocating the adoption of meta-heuristic algorithms for t-way testing strategies (where t points the interaction strength among parameters). Although helpful, no single meta-heuristic based t-way strategy can claim dominance over its counterparts. For this reason, the hybridization of meta-heuristic algorithms can help to ascertain the search capabilities of each by compensating for the limitations of one algorithm with the strength of others. Consequently, a new meta-heuristic based t-way strategy called Hybrid Artificial Bee Colony (HABCSm) strategy, based on merging the advantages of the Artificial Bee Colony (ABC) algorithm with the advantages of a Particle Swarm Optimization (PSO) algorithm is proposed in this paper. HABCSm is the first t-way strategy to adopt Hybrid Artificial Bee Colony (HABC) algorithm with Hamming distance as its core method for generating a final test set and the first to adopt the Hamming distance as the final selection criterion for enhancing the exploration of new solutions. The experimental results demonstrate that HABCSm provides superior competitive performance over its counterparts. Therefore, this finding contributes to the field of software testing by minimizing the number of test cases required for test execution.


title: Space Weathering of the 3-micron Phyllosilicate Feature induced by Pulsed Laser Irradiation

abstract: Here we present results from pulsed laser irradiation of CI and CM simulant samples in an effort to simulate space weathering on airless bodies via micrometeorite impacts. For this study, we focused on determining what type of alteration occurs in the 3-micron absorption region, as this region will be critical to ascertain compositional information of the surface regolith of hydrated asteroids. Generally, using entirely in situ spectral analysis, we find that the laser produces similar effects in both samples. Specifically, irradiation causes the blue spectral slope to decrease until it is relatively flat and that the sample darkens initially with laser irradiation but brightens back to about half of its original level by the end of the irradiation. Furthermore, we also find that laser irradiation causes the band depth on the 3-micron absorption band to increase by as much as 30%, yet the shape of the entire absorption band does not change and the band minima of the 2.72 micron shifts less than 0.001 micron after laser irradiation. The constancy of the latter two parameters, which will be most critical to compositional analysis, suggests that this spectral region could be very useful to determine the asteroid composition on surfaces on hydrated asteroids that have undergone extensive aqueous alteration even if the surface had been subject to a significant amount of space weathering. Whether the same conclusion will be generally applicable to other surfaces containing minerals with a wide range of aqueous alteration is currently unclear but will be tested in future studies.


title: UoB at SemEval-2021 Task 5: Extending Pre-Trained Language Models to Include Task and Domain-Specific Information for Toxic Span Prediction

abstract: Toxicity is pervasive in social media and poses a major threat to the health of online communities. The recent introduction of pre-trained language models, which have achieved state-of-the-art results in many NLP tasks, has transformed the way in which we approach natural language processing. However, the inherent nature of pre-training means that they are unlikely to capture task-specific statistical information or learn domain-specific knowledge. Additionally, most implementations of these models typically do not employ conditional random fields, a method for simultaneous token classification. We show that these modifications can improve model performance on the Toxic Spans Detection task at SemEval-2021 to achieve a score within 4 percentage points of the top performing team.


title: Di-$\pi^0$ correlations in $p+$$p$, $p+$$\mathrm{Al}$ and $p+$$\mathrm{Au}$ collisions at $\sqrt{s_{\mathrm{_{NN}}}}$ = 200 GeV at STAR

abstract: The STAR Collaboration reports measurements of back-to-back azimuthal correlations of di-$\pi^0$ produced at forward pseudorapidity ($2.6<\eta<4.0$) in $p+$$p$, $p+$$\mathrm{Al}$ and $p+$$\mathrm{Au}$ collisions at a center-of-mass energy per nucleon-nucleon pair of 200 GeV. A clear suppression of the correlated away-side yields is observed in $p+$$\mathrm{Au}$ and for the first time in $p+$$\mathrm{Al}$ collisions, compared with the $p$$+$$p$ data. The enhanced suppression found in $p+$$\mathrm{Au}$ with respect to $p+$$\mathrm{Al}$ collisions exhibits the saturation scale ($Q_s^2$) dependence on the mass number $A$. The observed suppression of back-to-back pairs as a function of event activity and transverse momentum points to non-linear gluon dynamics arising at high parton densities.


title: An extension of Gmunu: General-relativistic resistive magnetohydrodynamics based on staggered-meshed constrained transport with elliptic cleaning

abstract: We present the implementation of general-relativistic resistive magnetohydrodynamics solvers and three divergence-free handling approaches adopted in the General-relativistic multigrid numerical (Gmunu) code. In particular, implicit-explicit Runge-Kutta schemes are used to deal with the stiff terms in the evolution equations for small resistivity. Three divergence-free handling methods are (i) hyperbolic divergence cleaning through a generalised Lagrange multiplier (GLM); (ii) staggered-meshed constrained transport (CT) schemes and (iii) elliptic cleaning though multigrid (MG) solver which is applicable in both cell-centred and face-centred (stagger grid) magnetic field. The implementation has been test with a number of numerical benchmarks from special-relativistic to general-relativistic cases. We demonstrate that our code can robustly recover a very wide range of resistivity. We also illustrate the applications in modelling magnetised neutron stars, and compare how different divergence-free handling affects the evolution of the stars. Furthermore, we show that the preservation of the divergence-free condition of magnetic field when staggered-meshed constrained transport schemes can be significantly improved by applying elliptic cleaning.


title: Chromatic convergence for the algebraic K-theory of the sphere spectrum

abstract: We show that the map from $K({\mathbb S})$ to its chromatic completion is a connective cover and identify the fiber in $K$-theoretic terms. We combine this with recent work of Land-Mathew-Meier-Tamme to prove a form of "Waldhausen's Chromatic Convergence Conjecture": we show that the map $K({\mathbb S}_{(p)})_{(p)}\to \mathop{\rm holim} K(L^{f}_{n}{\mathbb S})_{(p)}$ is the inclusion of a wedge summand.


title: Spectral instability of small-amplitude periodic waves for hyperbolic non-Fickian diffusion advection models with logistic source

abstract: A hyperbolic model for diffusion, nonlinear transport (or advection) and production of a scalar quantity, is considered. The model is based on a constitutive law of Cattaneo-Maxwell type expressing non-Fickian diffusion by means of a relaxation time relation. The production or source term is assumed to be of logistic type. This paper studies the existence and spectral stability properties of spatially periodic traveling wave solutions to this system. It is shown that a family of subcharacteristic periodic waves emerges from a local Hopf bifurcation around a critical value of the wave speed. These waves have bounded fundamental period and small-amplitude. In addition, it is shown that these waves are spectrally unstable as solutions to the hyperbolic system. For that purpose, it is proved that the Floquet spectrum of the linearized operator around a wave can be approximated by a linear operator whose point spectrum intersects the unstable half plane of complex numbers with positive real part.


title: Adversarial Unlearning of Backdoors via Implicit Hypergradient

abstract: We propose a minimax formulation for removing backdoors from a given poisoned model based on a small set of clean data. This formulation encompasses much of prior work on backdoor removal. We propose the Implicit Bacdoor Adversarial Unlearning (I-BAU) algorithm to solve the minimax. Unlike previous work, which breaks down the minimax into separate inner and outer problems, our algorithm utilizes the implicit hypergradient to account for the interdependence between inner and outer optimization. We theoretically analyze its convergence and the generalizability of the robustness gained by solving minimax on clean data to unseen test data. In our evaluation, we compare I-BAU with six state-of-art backdoor defenses on seven backdoor attacks over two datasets and various attack settings, including the common setting where the attacker targets one class as well as important but underexplored settings where multiple classes are targeted. I-BAU's performance is comparable to and most often significantly better than the best baseline. Particularly, its performance is more robust to the variation on triggers, attack settings, poison ratio, and clean data size. Moreover, I-BAU requires less computation to take effect; particularly, it is more than $13\times$ faster than the most efficient baseline in the single-target attack setting. Furthermore, it can remain effective in the extreme case where the defender can only access 100 clean samples -- a setting where all the baselines fail to produce acceptable results.


title: Coupled interaction between acoustics and unsteady flame dynamics during the transition to thermoacoustic instability in a multi-element rocket combustor

abstract: Rocket engine combustors are prone to transverse instabilities that are characterized by large amplitude high frequency oscillations in the acoustic pressure and the heat release rate. We study the coupled interaction between the acoustic pressure and the CH* intensity oscillations in a 2D multi-element self-excited model rocket combustor during the transition from a stable state to thermoacoustic instability through intermittency. We show the emergence of synchronization between these oscillations from desynchronization through intermittent phase synchronization during the onset of thermoacoustic instability. We find substantial evidence that the intensities of the jet flames close to the end wall is higher than that observed near the center of the combustor as a result of its strong coupling to the local acoustic field. Using concepts from recurrence theory, we distinguish the type of synchronization between the acoustic pressure and the CH* intensity oscillations at the end wall and the center of the combustor during thermoacoustic instability. Analyzing the local CH* intensity oscillations, we observe that the longitudinally propagating jet flames experience substantial transverse displacement with flame merging effects during thermoacoustic instability. Furthermore, we differentiate the interaction of the jet flames with the shock wave during intermittency and thermoacoustic instability at both the end wall and the center of the combustor. We also discerned the change from stochastic to deterministic nature in the local CH* intensity oscillations during the transition to thermoacoustic instability. Our results demonstrate that only the first few transverse modes contribute to the generation of acoustic power from the reacting flow, in spite of the pressure oscillations featuring several harmonics.


title: Flavor violating muon decay into an electron and a light gauge boson

abstract: We analyze the flavor violating muon decay $\mu\rightarrow e\chi$, where $\chi$ is a massive gauge boson, with emphasis in the regime where $\chi$ is ultralight. We first study this process from an effective field theory standpoint in terms of form factors. We then present two explicit models where $\mu\rightarrow e\chi$ is generated at tree level and at the one-loop level. We also comment on the prospects of observing the process $\mu\rightarrow e\chi$ in view of the current limits on $\mu\rightarrow 3e$ from the SINDRUM collaboration.


title: Phase diffusion and noise temperature of a microwave amplifier based on single unshunted Josephson junction

abstract: High-gain microwave amplifiers operating near quantum limit are crucial for development of quantum technology. However, a systematic theoretical modeling and simulations of their performance represent rather challenging tasks due to the occurrence of colored noises and nonlinearities in the underlying circuits. Here, we develop a response theory for such an amplifier whose circuit dynamics is based on nonlinear oscillations of an unshunted Josephson junction. The theory accounts for a subtle interplay between exponentially damped fluctuations around the stable limit cycle and the nonlinear dynamics of the limit cycle phase. The amplifier gain and noise spectrum are derived assuming a colored voltage noise at the circuit resistor. The derived expressions are generally applicable to any system whose limit cycle dynamics is perturbed by a colored noise and a harmonic signal. We also critically assess reliabilities of numerical methods of simulations of the corresponding nonlinear Langevin equations, where even reliable discretization schemes might introduce errors significantly affecting simulated characteristics at the peak performance.


title: Lagrangian descriptors for the Bunimovich stadium billiard

abstract: We apply the concept of Lagrangian descriptors to the dynamics on the Bunimovich stadium billiard, a 2D ergodic system with singular families of trajectories, namely, the bouncing ball and the whispering gallery orbits. They play a central role in structuring the phase space, which is unveiled here by means of the Lagrangian descriptors applied to the associated map on the boundary. More interestingly, we also consider the open stadium, which in the optical case (Fresnel's laws) can be directly related to recent microlaser experiments. We find that the structure of the emission profile of these systems can be easily described thanks to the open version of the Lagrangian descriptors.


title: Adaptive Early-Learning Correction for Segmentation from Noisy Annotations

abstract: Deep learning in the presence of noisy annotations has been studied extensively in classification, but much less in segmentation tasks. In this work, we study the learning dynamics of deep segmentation networks trained on inaccurately-annotated data. We discover a phenomenon that has been previously reported in the context of classification: the networks tend to first fit the clean pixel-level labels during an "early-learning" phase, before eventually memorizing the false annotations. However, in contrast to classification, memorization in segmentation does not arise simultaneously for all semantic categories. Inspired by these findings, we propose a new method for segmentation from noisy annotations with two key elements. First, we detect the beginning of the memorization phase separately for each category during training. This allows us to adaptively correct the noisy annotations in order to exploit early learning. Second, we incorporate a regularization term that enforces consistency across scales to boost robustness against annotation noise. Our method outperforms standard approaches on a medical-imaging segmentation task where noises are synthesized to mimic human annotation errors. It also provides robustness to realistic noisy annotations present in weakly-supervised semantic segmentation, achieving state-of-the-art results on PASCAL VOC 2012. Code is available at https://github.com/Kangningthu/ADELE


title: Starfall: A heavy rain of stars in 'turning on' AGN

abstract: As active galactic nuclei (AGN) `turn on', some stars end up embedded in accretion disks around supermassive black holes (SMBHs) on retrograde orbits. Such stars experience strong headwinds, aerodynamic drag, ablation and orbital evolution on short timescales. Loss of orbital angular momentum in the first $\sim 0.1$~Myr of an AGN leads to a heavy rain of stars (`starfall') into the inner disk and onto the SMBH. A large AGN loss cone ($\theta_{\rm AGN,lc}$) can result from binary scatterings in the inner disk and yield tidal disruption events (TDEs). Signatures of starfall include optical/UV flares that rise in luminosity over time, particularly in the inner disk. If the SMBH mass is $M_{\rm SMBH} \ge 10^{8}M_{\odot}$, flares truncate abruptly and the star is swallowed. If $M_{\rm SMBH}<10^{8}M_{\odot}$, and if the infalling orbit lies within $\theta_{\rm AGN,lc}$, the flare is followed by a TDE which can be prograde or retrograde relative to the AGN inner disk. Retrograde AGN TDEs are over-luminous and short-lived as in-plane ejecta collide with the inner disk and a lower AGN state follows. Prograde AGN TDEs add angular momentum to inner disk gas and so start off looking like regular TDEs but are followed by an AGN high state. Searches for such flare signatures test models of AGN `turn on', SMBH mass, as well as disk properties and the embedded population.


title: Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference

abstract: Sparse Mixture-of-Experts (MoE) has been a successful approach for scaling multilingual translation models to billions of parameters without a proportional increase in training computation. However, MoE models are prohibitively large and practitioners often resort to methods such as distillation for serving. In this work, we investigate routing strategies at different granularity (token, sentence, task) in MoE models to bypass distillation. Experiments on WMT and a web-scale dataset suggest that task-level routing (task-MoE) enables us to extract smaller, ready-to-deploy sub-networks from large sparse models. On WMT, our task-MoE with 32 experts (533M parameters) outperforms the best performing token-level MoE model (token-MoE) by +1.0 BLEU on average across 30 language pairs. The peak inference throughput is also improved by a factor of 1.9x when we route by tasks instead of tokens. While distilling a token-MoE to a smaller dense model preserves only 32% of the BLEU gains, our sub-network task-MoE, by design, preserves all the gains with the same inference cost as the distilled student model. Finally, when scaling up to 200 language pairs, our 128-expert task-MoE (13B parameters) performs competitively with a token-level counterpart, while improving the peak inference throughput by a factor of 2.6x.


title: Reinforcement Learning in Reward-Mixing MDPs

abstract: Learning a near optimal policy in a partially observable system remains an elusive challenge in contemporary reinforcement learning. In this work, we consider episodic reinforcement learning in a reward-mixing Markov decision process (MDP). There, a reward function is drawn from one of multiple possible reward models at the beginning of every episode, but the identity of the chosen reward model is not revealed to the agent. Hence, the latent state space, for which the dynamics are Markovian, is not given to the agent. We study the problem of learning a near optimal policy for two reward-mixing MDPs. Unlike existing approaches that rely on strong assumptions on the dynamics, we make no assumptions and study the problem in full generality. Indeed, with no further assumptions, even for two switching reward-models, the problem requires several new ideas beyond existing algorithmic and analysis techniques for efficient exploration. We provide the first polynomial-time algorithm that finds an $\epsilon$-optimal policy after exploring $\tilde{O}(poly(H,\epsilon^{-1}) \cdot S^2 A^2)$ episodes, where $H$ is time-horizon and $S, A$ are the number of states and actions respectively. This is the first efficient algorithm that does not require any assumptions in partially observed environments where the observation space is smaller than the latent state space.


title: Voice Reenactment with F0 and timing constraints and adversarial learning of conversions

abstract: This paper introduces voice reenactement as the task of voice conversion (VC) in which the expressivity of the source speaker is preserved during conversion while the identity of a target speaker is transferred. To do so, an original neural- VC architecture is proposed based on sequence-to-sequence voice conversion (S2S-VC) in which the speech prosody of the source speaker is preserved during conversion. First, the S2S-VC architecture is modified so as to synchronize the converted speech with the source speech by mean of phonetic duration encoding; second, the decoder is conditioned on the desired sequence of F0- values and an explicit F0-loss is formulated between the F0 of the source speaker and the one of the converted speech. Besides, an adversarial learning of conversions is integrated within the S2S-VC architecture so as to exploit both advantages of reconstruction of original speech and converted speech with manipulated attributes during training and then reducing the inconsistency between training and conversion. An experimental evaluation on the VCTK speech database shows that the speech prosody can be efficiently preserved during conversion, and that the proposed adversarial learning consistently improves the conversion and the naturalness of the reenacted speech.


title: Adversarial Attack by Limited Point Cloud Surface Modifications

abstract: Recent research has revealed that the security of deep neural networks that directly process 3D point clouds to classify objects can be threatened by adversarial samples. Although existing adversarial attack methods achieve high success rates, they do not restrict the point modifications enough to preserve the point cloud appearance. To overcome this shortcoming, two constraints are proposed. These include applying hard boundary constraints on the number of modified points and on the point perturbation norms. Due to the restrictive nature of the problem, the search space contains many local maxima. The proposed method addresses this issue by using a high step-size at the beginning of the algorithm to search the main surface of the point cloud fast and effectively. Then, in order to converge to the desired output, the step-size is gradually decreased. To evaluate the performance of the proposed method, it is run on the ModelNet40 and ScanObjectNN datasets by employing the state-of-the-art point cloud classification models; including PointNet, PointNet++, and DGCNN. The obtained results show that it can perform successful attacks and achieve state-of-the-art results by only a limited number of point modifications while preserving the appearance of the point cloud. Moreover, due to the effective search algorithm, it can perform successful attacks in just a few steps. Additionally, the proposed step-size scheduling algorithm shows an improvement of up to $14.5\%$ when adopted by other methods as well. The proposed method also performs effectively against popular defense methods.


title: Properties of the Digital Root and its Extension to Rational Numbers -- an Algebraic Approach

abstract: This paper contains an algebraic constructive and self-contained account of the invariance rule of the digital root under division for an arbitrary natural basis representation. Both the cases of repeating and non-repeating fractionals are treated. In the preliminary section some known results such as the uniqueness in the representation of a fraction are discussed for both the finite and infinite bases cases. Simple examples are introduced throughout the text for illustrative purposes.


title: Fixed-Order H2-Conic Control

abstract: H2-conic controller design seeks to minimize the closed-loop H2-norm for a nominal linear system while satisfying the Conic Sector Theorem for nonlinear stability. This problem has only been posed with limited design freedom, as opposed to fixed-order design where all controller parameters except the number of state estimates are free variables. Here, the fixed-order H2-conic design problem is reformulated as a convergent series of convex approximations using iterative convex overbounding. A synthesis algorithm and various initializations are proposed. The synthesis is applied to a passivity-violated system with uncertain parameters and compared to benchmark controller designs.


title: Optimizing Oil and Gas Acquisitions Using Recommender Systems

abstract: Well acquisition in the oil and gas industry can often be a hit or miss process, with a poor purchase resulting in substantial loss. Recommender systems suggest items (wells) that users (companies) are likely to buy based on past activity, and applying this system to well acquisition can increase company profits. While traditional recommender systems are impactful enough on their own, they are not optimized. This is because they ignore many of the complexities involved in human decision-making, and frequently make subpar recommendations. Using a preexisting Python implementation of a Factorization Machine results in more accurate recommendations based on a user-level ranking system. We train a Factorization Machine model on oil and gas well data that includes features such as elevation, total depth, and location. The model produces recommendations by using similarities between companies and wells, as well as their interactions. Our model has a hit rate of 0.680, reciprocal rank of 0.469, precision of 0.229, and recall of 0.463. These metrics imply that while our model is able to recommend the correct wells in a general sense, it does not match exact wells to companies via relevance. To improve the model's accuracy, future models should incorporate additional features such as the well's production data and ownership duration as these features will produce more accurate recommendations.


title: Global sensitivity analysis in probabilistic graphical models

abstract: We show how to apply Sobol's method of global sensitivity analysis to measure the influence exerted by a set of nodes' evidence on a quantity of interest expressed by a Bayesian network. Our method exploits the network structure so as to transform the problem of Sobol index estimation into that of marginalization inference. This way, we can efficiently compute indices for networks where brute-force or Monte Carlo based estimators for variance-based sensitivity analysis would require millions of costly samples. Moreover, our method gives exact results when exact inference is used, and also supports the case of correlated inputs. The proposed algorithm is inspired by the field of tensor networks, and generalizes earlier tensor sensitivity techniques from the acyclic to the cyclic case. We demonstrate the method on three medium to large Bayesian networks that cover the areas of project risk management and reliability engineering.


title: Higher order quantization conditions for two spinless particles

abstract: Lattice QCD calculations of scattering phaseshifts and resonance parameters in the two-body sector are becoming precision studies. Early calculations employed L\"uscher's formula for extracting these quantities at lowest order. As the calculations become more ambitious, higher-order relations are required. In this study we derive higher-order quantization conditions and introduce a method to transparently cross-check our results. This is an important step given the involved derivations of these formulae. We derive quantization conditions up to $\ell=5$ partial waves in both cubic and elongated geometries, and for states with zero and non-zero total momentum. All 45 quantization conditions we include here (22 in cubic box, 23 in elongated box) pass our cross-check test.


title: Discomfort Monitoring System for Residential Electrical Water Heater

abstract: An approach is described in this work for detecting discomfort moments during electrical water heater daily usage. The approach employs chromatic analyzing sensors signals of electrical water heater systems for producing distinguishable mapping to characterize and identify selected discomfort moments. The preliminary results obtained indicate that it is possible to distinguish such events in a non-intrusive approach. Hot water comfort detection and classification intelligently through human behavior monitoring and analyses plays an important role in both, energy saving and energy management. The focus is on recording the discomfort situations followed by merging system outcomes with efficiency evaluation will be used to provide helpful recommendations for selecting appropriate operating strategy.


title: A new approach to slice analysis via slice topology

abstract: In this paper we summarize some known facts on slice topology in the quaternionic case, and we deepen some of them by proving new results and discussing some examples. We then show, following [18], how this setting allows us to generalize slice analysis to the general case of functions with values in a real left alternative algebra, which includes the case of slice monogenic functions with values in Clifford algebra. Moreover, we further extend slice analysis, in one and several variables, to functions with values in a Euclidean space of even dimension. In this framework, we study the domains of slice regularity, we prove some extension properties and the validity of a Taylor expansion for a slice regular function.


title: From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awareness

abstract: Message Passing Neural Networks (MPNNs) are a common type of Graph Neural Network (GNN), in which each node's representation is computed recursively by aggregating representations (messages) from its immediate neighbors akin to a star-shaped pattern. MPNNs are appealing for being efficient and scalable, how-ever their expressiveness is upper-bounded by the 1st-order Weisfeiler-Lehman isomorphism test (1-WL). In response, prior works propose highly expressive models at the cost of scalability and sometimes generalization performance. Our work stands between these two regimes: we introduce a general framework to uplift any MPNN to be more expressive, with limited scalability overhead and greatly improved practical performance. We achieve this by extending local aggregation in MPNNs from star patterns to general subgraph patterns (e.g.,k-egonets):in our framework, each node representation is computed as the encoding of a surrounding induced subgraph rather than encoding of immediate neighbors only (i.e. a star). We choose the subgraph encoder to be a GNN (mainly MPNNs, considering scalability) to design a general framework that serves as a wrapper to up-lift any GNN. We call our proposed method GNN-AK(GNN As Kernel), as the framework resembles a convolutional neural network by replacing the kernel with GNNs. Theoretically, we show that our framework is strictly more powerful than 1&2-WL, and is not less powerful than 3-WL. We also design subgraph sampling strategies which greatly reduce memory footprint and improve speed while maintaining performance. Our method sets new state-of-the-art performance by large margins for several well-known graph ML tasks; specifically, 0.08 MAE on ZINC,74.79% and 86.887% accuracy on CIFAR10 and PATTERN respectively.


title: Process Extraction from Text: Benchmarking the State of the Art and Paving the Way for Future Challenges

abstract: The extraction of process models from text refers to the problem of turning the information contained in an unstructured textual process descriptions into a formal representation,i.e.,a process model. Several automated approaches have been proposed to tackle this problem, but they are highly heterogeneous in scope and underlying assumptions,i.e., differences in input, target output, and data used in their evaluation.As a result, it is currently unclear how well existing solutions are able to solve the model-extraction problem and how they compare to each other.We overcome this issue by comparing 10 state-of-the-art approaches for model extraction in a systematic manner, covering both qualitative and quantitative aspects.The qualitative evaluation compares the analysis of the primary studies on: 1 the main characteristics of each solution;2 the type of process model elements extracted from the input data;3 the experimental evaluation performed to evaluate the proposed framework.The results show a heterogeneity of techniques, elements extracted and evaluations conducted, that are often impossible to compare.To overcome this difficulty we propose a quantitative comparison of the tools proposed by the papers on the unifying task of process model entity and relation extraction so as to be able to compare them directly.The results show three distinct groups of tools in terms of performance, with no tool obtaining very good scores and also serious limitations.Moreover, the proposed evaluation pipeline can be considered a reference task on a well-defined dataset and metrics that can be used to compare new tools. The paper also presents a reflection on the results of the qualitative and quantitative evaluation on the limitations and challenges that the community needs to address in the future to produce significant advances in this area.


title: Fast and stable approximation of analytic functions from equispaced samples via polynomial frames

abstract: We consider approximating analytic functions on the interval $[-1,1]$ from their values at a set of $m+1$ equispaced nodes. A result of Platte, Trefethen \& Kuijlaars states that fast and stable approximation from equispaced samples is generally impossible. In particular, any method that converges exponentially fast must also be exponentially ill-conditioned. We prove a positive counterpart to this `impossibility' theorem. Our `possibility' theorem shows that there is a well-conditioned method that provides exponential decay of the error down to a finite, but user-controlled tolerance $\epsilon > 0$, which in practice can be chosen close to machine epsilon. The method is known as \textit{polynomial frame} approximation or \textit{polynomial extensions}. It uses algebraic polynomials of degree $n$ on an extended interval $[-\gamma,\gamma]$, $\gamma > 1$, to construct an approximation on $[-1,1]$ via a SVD-regularized least-squares fit. A key step in the proof of our main theorem is a new result on the maximal behaviour of a polynomial of degree $n$ on $[-1,1]$ that is simultaneously bounded by one at a set of $m+1$ equispaced nodes in $[-1,1]$ and $1/\epsilon$ on the extended interval $[-\gamma,\gamma]$. We show that linear oversampling, i.e., $m = c n \log(1/\epsilon) / \sqrt{\gamma^2-1}$, is sufficient for uniform boundedness of any such polynomial on $[-1,1]$. This result aside, we also prove an extended impossibility theorem, which shows that such a possibility theorem (and consequently the method of polynomial frame approximation) is essentially optimal.


title: Sonorant spectra and coarticulation distinguish speakers with different dialects

abstract: The aim of this study is to determine the effect of language varieties on the spectral distribution of stressed and unstressed sonorants (nasals /m, n/, lateral approximants /l/, and rhotics /r/) and on their coarticulatory effects on adjacent sounds. To quantify the shape of the spectral distribution, we calculated the spectral moments from the sonorant spectra of nasals /m, n/, lateral approximants /l/, and rhotics /r/ produced by Athenian Greek and Cypriot Greek speakers. To estimate the co-articulatory effects of sonorants on the adjacent vowels' F1 - F4 formant frequencies, we developed polynomial models of the adjacent vowel's formant contours. We found significant effects of language variety (sociolinguistic information) on the spectral moments of each sonorant /m/, /n/, /l/, /r/ (except between /m/ and /n/) and on the formant contours of the adjacent vowel. All sonorants (including /m/ and /n/) had distinct effects on adjacent vowel's formant contours, especially for F3 and F4. The study highlights that the combination of spectral moments and coarticulatory effects of sonorants determines linguistic (stress and phonemic category) and sociolinguistic (language variety) characteristics of sonorants. It also provides the first comparative acoustic analysis of Athenian Greek and Cypriot Greek sonorants.


title: Predictive Maintenance for General Aviation Using Convolutional Transformers

abstract: Predictive maintenance systems have the potential to significantly reduce costs for maintaining aircraft fleets as well as provide improved safety by detecting maintenance issues before they come severe. However, the development of such systems has been limited due to a lack of publicly labeled multivariate time series (MTS) sensor data. MTS classification has advanced greatly over the past decade, but there is a lack of sufficiently challenging benchmarks for new methods. This work introduces the NGAFID Maintenance Classification (NGAFID-MC) dataset as a novel benchmark in terms of difficulty, number of samples, and sequence length. NGAFID-MC consists of over 7,500 labeled flights, representing over 11,500 hours of per second flight data recorder readings of 23 sensor parameters. Using this benchmark, we demonstrate that Recurrent Neural Network (RNN) methods are not well suited for capturing temporally distant relationships and propose a new architecture called Convolutional Multiheaded Self Attention (Conv-MHSA) that achieves greater classification performance at greater computational efficiency. We also demonstrate that image inspired augmentations of cutout, mixup, and cutmix, can be used to reduce overfitting and improve generalization in MTS classification. Our best trained models have been incorporated back into the NGAFID to allow users to potentially detect flights that require maintenance as well as provide feedback to further expand and refine the NGAFID-MC dataset.


title: Taming the time evolution in overdamped systems: shortcuts elaborated from fast-forward and time-reversed protocols

abstract: Using a reverse-engineering approach on the time-distorted solution in a reference potential, we work out the external driving potential to be applied to a Brownian system in order to slow or accelerate the dynamics, or even to invert the arrow of time. By welding a direct and time-reversed evolution towards a well chosen common intermediate state, we derive analytically a smooth protocol to connect two \emph{arbitrary} states in an arbitrarily short amount of time. Not only does the reverse-engineering approach proposed in this Letter contain the current -- rather limited -- catalogue of explicit protocols but it also provides a systematic strategy to build the connection between arbitrary states with a physically admissible driving. Optimization and further generalizations are also discussed.


title: Explanation as a process: user-centric construction of multi-level and multi-modal explanations

abstract: In the last years, XAI research has mainly been concerned with developing new technical approaches to explain deep learning models. Just recent research has started to acknowledge the need to tailor explanations to different contexts and requirements of stakeholders. Explanations must not only suit developers of models, but also domain experts as well as end users. Thus, in order to satisfy different stakeholders, explanation methods need to be combined. While multi-modal explanations have been used to make model predictions more transparent, less research has focused on treating explanation as a process, where users can ask for information according to the level of understanding gained at a certain point in time. Consequently, an opportunity to explore explanations on different levels of abstraction should be provided besides multi-modal explanations. We present a process-based approach that combines multi-level and multi-modal explanations. The user can ask for textual explanations or visualizations through conversational interaction in a drill-down manner. We use Inductive Logic Programming, an interpretable machine learning approach, to learn a comprehensible model. Further, we present an algorithm that creates an explanatory tree for each example for which a classifier decision is to be explained. The explanatory tree can be navigated by the user to get answers of different levels of detail. We provide a proof-of-concept implementation for concepts induced from a semantic net about living beings.


title: Design Strategy Network: A deep hierarchical framework to represent generative design strategies in complex action spaces

abstract: Generative design problems often encompass complex action spaces that may be divergent over time, contain state-dependent constraints, or involve hybrid (discrete and continuous) domains. To address those challenges, this work introduces Design Strategy Network (DSN), a data-driven deep hierarchical framework that can learn strategies over these arbitrary complex action spaces. The hierarchical architecture decomposes every action decision into first predicting a preferred spatial region in the design space and then outputting a probability distribution over a set of possible actions from that region. This framework comprises a convolutional encoder to work with image-based design state representations, a multi-layer perceptron to predict a spatial region, and a weight-sharing network to generate a probability distribution over unordered set-based inputs of feasible actions. Applied to a truss design study, the framework learns to predict the actions of human designers in the study, capturing their truss generation strategies in the process. Results show that DSNs significantly outperform non-hierarchical methods of policy representation, demonstrating their superiority in complex action space problems.


title: A simple equivariant machine learning method for dynamics based on scalars

abstract: Physical systems obey strict symmetry principles. We expect that machine learning methods that intrinsically respect these symmetries should have higher prediction accuracy and better generalization in prediction of physical dynamics. In this work we implement a principled model based on invariant scalars, and release open-source code. We apply this Scalars method to a simple chaotic dynamical system, the springy double pendulum. We show that the Scalars method outperforms state-of-the-art approaches for learning the properties of physical systems with symmetries, both in terms of accuracy and speed. Because the method incorporates the fundamental symmetries, we expect it to generalize to different settings, such as changes in the force laws in the system.


title: Group-based Delivery of Critical Traffic in Cellular IoT Networks

abstract: Fifth generation (5G) networks are expected to connect a huge number of Internet of Things (IoT) devices in many usage scenarios. The challenges of typical massive IoT applications with sporadic and short packet uplink transmissions are well studied, while not enough attention is given to the delivery of content of common interest, such as software/firmware updates and remote control, towards IoT devices in emerging point-to-multipoint scenarios. Moreover, the delivery of delay-sensitive IoT traffic is not sufficiently addressed in the literature. In this work we (i) identify the drawbacks of the current Single-Cell Point-to-Multipoint (SC-PTM) solution for unplanned critical traffic delivery in cellular IoT (cIoT) networks, and (ii) propose paging and multicast schemes for a fast distribution of critical updates after, e.g., bug fixes or system failures. We benchmark the performance of the proposed paging scheme against similar solutions available in the literature. Our extended SC-PTM framework is energy efficient and guarantees low service latency, as demonstrated both analytically and by simulations.