title: RNTrajRec: Road Network Enhanced Trajectory Recovery with Spatial-Temporal Transformer

abstract: GPS trajectories are the essential foundations for many trajectory-based applications, such as travel time estimation, traffic prediction and trajectory similarity measurement. Most applications require a large amount of high sample rate trajectories to achieve a good performance. However, many real-life trajectories are collected with low sample rate due to energy concern or other constraints.We study the task of trajectory recovery in this paper as a means for increasing the sample rate of low sample trajectories. Currently, most existing works on trajectory recovery follow a sequence-to-sequence diagram, with an encoder to encode a trajectory and a decoder to recover real GPS points in the trajectory. However, these works ignore the topology of road network and only use grid information or raw GPS points as input. Therefore, the encoder model is not able to capture rich spatial information of the GPS points along the trajectory, making the prediction less accurate and lack spatial consistency. In this paper, we propose a road network enhanced transformer-based framework, namely RNTrajRec, for trajectory recovery. RNTrajRec first uses a graph model, namely GridGNN, to learn the embedding features of each road segment. It next develops a spatial-temporal transformer model, namely GPSFormer, to learn rich spatial and temporal features along with a Sub-Graph Generation module to capture the spatial features for each GPS point in the trajectory. It finally forwards the outputs of encoder model into a multi-task decoder model to recover the missing GPS points. Extensive experiments based on three large-scale real-life trajectory datasets confirm the effectiveness of our approach.


title: Unified Multimodal Model with Unlikelihood Training for Visual Dialog

abstract: The task of visual dialog requires a multimodal chatbot to answer sequential questions from humans about image content. Prior work performs the standard likelihood training for answer generation on the positive instances (involving correct answers). However, the likelihood objective often leads to frequent and dull outputs and fails to exploit the useful knowledge from negative instances (involving incorrect answers). In this paper, we propose a Unified Multimodal Model with UnLikelihood Training, named UniMM-UL, to tackle this problem. First, to improve visual dialog understanding and generation by multi-task learning, our model extends ViLBERT from only supporting answer discrimination to holding both answer discrimination and answer generation seamlessly by different attention masks. Specifically, in order to make the original discriminative model compatible with answer generation, we design novel generative attention masks to implement the autoregressive Masked Language Modeling (autoregressive MLM) task. And to attenuate the adverse effects of the likelihood objective, we exploit unlikelihood training on negative instances to make the model less likely to generate incorrect answers. Then, to utilize dense annotations, we adopt different fine-tuning methods for both generating and discriminating answers, rather than just for discriminating answers as in the prior work. Finally, on the VisDial dataset, our model achieves the best generative results (69.23 NDCG score). And our model also yields comparable discriminative results with the state-of-the-art in both single-model and ensemble settings (75.92 and 76.17 NDCG scores).


title: MEGAN: Multi-Explanation Graph Attention Network

abstract: We propose a multi-explanation graph attention network (MEGAN). Unlike existing graph explainability methods, our network can produce node and edge attributional explanations along multiple channels, the number of which is independent of task specifications. This proves crucial to improve the interpretability of graph regression predictions, as explanations can be split into positive and negative evidence w.r.t to a reference value. Additionally, our attention-based network is fully differentiable and explanations can actively be trained in an explanation-supervised manner. We first validate our model on a synthetic graph regression dataset with known ground-truth explanations. Our network outperforms existing baseline explainability methods for the single- as well as the multi-explanation case, achieving near-perfect explanation accuracy during explanation supervision. Finally, we demonstrate our model's capabilities on multiple real-world datasets. We find that our model produces sparse high-fidelity explanations consistent with human intuition about those tasks.


title: Maximum mass of relativistic self-gravitating Bose-Einstein condensates with repulsive or attractive $|\varphi|^4$ self-interaction

abstract: We derive an approximate analytical expression of the maximum mass of relativistic self-gravitating Bose-Einstein condensates with repulsive or attractive $|\varphi|^4$ self-interaction. This expression interpolates between the general relativistic maximum mass of noninteracting bosons stars, the general relativistic maximum mass of bosons stars with a repulsive self-interaction in the Thomas-Fermi limit, and the Newtonian maximum mass of dilute axion stars with an attractive self-interaction [P.H. Chavanis, Phys. Rev. D {\bf 84}, 043531 (2011)]. We obtain the general structure of our formula from simple considerations and determine the numerical coefficients in order to recover the exact asymptotic expressions of the maximum mass in particular limits. As a result, our formula should provide a relevant approximation of the maximum mass of relativistic boson stars for any value (positive and negative) of the self-interaction parameter. We discuss the evolution of the system above the maximum mass and consider application of our results to dark matter halos and inflaton clusters. We also make a short review of boson stars and Bose-Einstein condensate dark matter halos, and point out analogies with models of extended elementary particles.


title: ProstAttention-Net: A deep attention model for prostate cancer segmentation by aggressiveness in MRI scans

abstract: Multiparametric magnetic resonance imaging (mp-MRI) has shown excellent results in the detection of prostate cancer (PCa). However, characterizing prostate lesions aggressiveness in mp-MRI sequences is impossible in clinical practice, and biopsy remains the reference to determine the Gleason score (GS). In this work, we propose a novel end-to-end multi-class network that jointly segments the prostate gland and cancer lesions with GS group grading. After encoding the information on a latent space, the network is separated in two branches: 1) the first branch performs prostate segmentation 2) the second branch uses this zonal prior as an attention gate for the detection and grading of prostate lesions. The model was trained and validated with a 5-fold cross-validation on an heterogeneous series of 219 MRI exams acquired on three different scanners prior prostatectomy. In the free-response receiver operating characteristics (FROC) analysis for clinically significant lesions (defined as GS > 6) detection, our model achieves 69.0% $\pm$14.5% sensitivity at 2.9 false positive per patient on the whole prostate and 70.8% $\pm$14.4% sensitivity at 1.5 false positive when considering the peripheral zone (PZ) only. Regarding the automatic GS group


title: Relating Regularization and Generalization through the Intrinsic Dimension of Activations

abstract: Given a pair of models with similar training set performance, it is natural to assume that the model that possesses simpler internal representations would exhibit better generalization. In this work, we provide empirical evidence for this intuition through an analysis of the intrinsic dimension (ID) of model activations, which can be thought of as the minimal number of factors of variation in the model's representation of the data. First, we show that common regularization techniques uniformly decrease the last-layer ID (LLID) of validation set activations for image classification models and show how this strongly affects generalization performance. We also investigate how excessive regularization decreases a model's ability to extract features from data in earlier layers, leading to a negative effect on validation accuracy even while LLID continues to decrease and training accuracy remains near-perfect. Finally, we examine the LLID over the course of training of models that exhibit grokking. We observe that well after training accuracy saturates, when models ``grok'' and validation accuracy suddenly improves from random to perfect, there is a co-occurent sudden drop in LLID, thus providing more insight into the dynamics of sudden generalization.


title: Matrix Models and Holography: Mass Deformations of Long Quiver Theories in 5d and 3d

abstract: We enlarge the dictionary between matrix models for long linear quivers preserving eight supercharges in $d=5$ and $d=3$ and type IIB supergravity backgrounds with AdS$_{d+1}$ factors. We introduce mass deformations of the field theory that break the quiver into a collection of interacting linear quivers, which are decoupled at the end of the RG flow. We find and solve a Laplace problem in supergravity which realises these deformations holographically. The free energy and expectation values of antisymmetric Wilson loops are calculated on both sides of the proposed duality, finding agreement. Our matching procedure sheds light on the F-theorem in five dimensions.


title: Consistent Truncations and Dualities

abstract: Recent progress in generalised geometry and extended field theories suggests a deep connection between consistent truncations and dualities, which is not immediately obvious. A prime example is generalised Scherk-Schwarz reductions in double field theory, which have been shown to be in one-to-one correspondence with Poisson-Lie T-duality. Here we demonstrate that this relation is only the tip of the iceberg. Currently, the most general known classes of T-dualities (excluding mirror symmetry) are based on dressing cosets. But as we discuss, they can be further extended to the even larger class of generalised cosets. We prove that the latter give rise to consistent truncations for which the ansatz can be constructed systematically. Hence, we pave the way for many new examples of T-dualities and consistent truncations. The arising structures result in covariant tensors with more than two derivatives and we argue how they might be key to understand generalised T-dualities and consistent truncations beyond the leading two derivative level.


title: Deterministic generation of qudit photonic graph states from quantum emitters

abstract: We propose and analyze deterministic protocols to generate qudit photonic graph states from quantum emitters. We show that our approach can be applied to generate any qudit graph state, and we exemplify it by constructing protocols to generate one- and two-dimensional qudit cluster states, absolutely maximally entangled states, and logical states of quantum error correcting codes. Some of these protocols make use of time-delayed feedback, while others do not. The only additional resource requirement compared to the qubit case is the ability to control multi-level emitters. These results significantly broaden the range of multi-photon entangled states that can be produced deterministically from quantum emitters.


title: Generalized quotients and holographic duals for 5d S-fold SCFTs

abstract: $\mathbb{Z}_n$ S-folds of 5d SCFTs, including $T_N$, which lead to brane webs with $E_{6,7,8}$ 7-branes were discussed recently. We generalize the construction to `fractional quotients', which are based on $\mathbb{Z}_n$ actions linking multiple copies of the seed theory and lead to $H_{0,1,2}$ 7-branes. We provide the holographic duals for both classes. This expands the space of explicitly known Type IIB $\rm AdS_6$ solutions by incorporating F-theory 7-branes of type $E_{6,7,8}$ and $H_{0,1,2}$, extending previous constructions for O7-planes. We discuss observables including the free energies and link the results to matrix model descriptions.


title: The most massive stars in very young star clusters with a limited mass: Evidence favours significant self-regulation in the star formation processes

abstract: The stellar initial mass function (IMF) is commonly interpreted to be a scale-invariant probability density distribution function (PDF) such that many small clusters yield the same IMF as one massive cluster of the same combined number of stars. Observations of the galaxy-wide IMF challenge this as dwarf galaxies do not form as many massive stars as expected. This indicates a highly self-regulated star formation process in which stellar masses are not stochastically sampled from the IMF and are instead related to the environment of star formation. Here, the nature of star formation is studied using the relation between the most massive star born in a star cluster and its parental stellar cluster mass (the $m_{\rm max}$--$M_{\rm ecl}$ relation). This relation has been argued to be a statistical effect if stars are sampled randomly from the IMF. By comparing the tightness of the observed $m_{\rm max}$--$M_{\rm ecl}$ distribution with synthetic star clusters with stochastically sampled stellar masses, we find that the expected dispersion of the mock observations is much larger than the observed dispersion. Assuming that $m_{\rm max}$ and $M_{\rm ecl}$ uncertainties from the literature are correct, our test rejects the hypothesis that the IMF is a PDF at a more than $4.5\sigma$ confidence level. Alternatively, we provide a deterministic stellar mass sampling tool which reproduces the observed $m_{\rm max}$--$M_{\rm ecl}$ distribution and compares well with the luminosities of star-forming molecular clumps. In addition, we find that there is a significant flattening of the $m_{\rm max}$--$M_{\rm ecl}$ relation near $m_{\rm max}=13~M_\odot$. This may suggest strong feedback of stars more massive than about $13~M_\odot$ and/or the ejections of the most massive stars from young clusters in the mass range 63 to $400~M_\odot$ to be likely important physical processes in forming clusters.


title: Phonon-mediated Hydrodynamic Transport in a Weyl Semimetal

abstract: We analyze from a microscopic point of view the feasibility of a hydrodynamic regime in a type-I Weyl semimetal driven by electron-electron interactions mediated by virtual phonons. Considering also the effects of of impurities and the absorption/emission of real phonons, the electric and thermal conductivities are derived. At temperatures $T$ above the Bloch-Gr\"uneisen temperature $T_\textrm{BG}$, virtual phonons behave similarly to real phonons, but the Lorenz ratio is modified by a constant prefactor dependent on the Fermi surface geometry. For temperatures below $T_\textrm{BG}$, processes that do not conserve chirality induce a $T^2$ dependence in the electric resistivity, opening a window where momentum-conserving interactions dominate transport signatures. We quantitatively discuss this hydrodynamic window and put it into context with recent experimental literature on the subject.


title: Reflected Entropy for Communicating Black Holes I: Karch-Randall Braneworlds

abstract: We obtain the reflected entropy for bipartite mixed state configurations of two adjacent and disjoint intervals at a finite temperature in $BCFT_2$s with two distinct boundaries through a replica technique in the large central charge limit. Subsequently these field theory results are reproduced from bulk computations involving the entanglement wedge cross section in the dual BTZ black hole geometry truncated by two Karch-Randall branes. Our result confirms the holographic duality between the reflected entropy and the bulk entanglement wedge cross section in the context of the $AdS_3/BCFT_2$ scenario. We further investigate the critical issue of the holographic Markov gap between the reflected entropy and the mutual information for these configurations from the bulk braneworld geometry and study its variation with subsystem sizes and time.


title: A study of the relativistic corrections to polarized tritium $\beta$-decay

abstract: Forthcoming experiments like Project8 and Ptolemy aim at investigating with high precision the end-point of the tritium $\beta$-decay spectrum sensitive to the neutrino mass. In light of this, using the standard parametrization in terms of nuclear polar form factors, we analyze the complete relativistic expression for the spectrum of the $\beta$-electron emitted by a tritium nucleus. Given the small parameters in the problem, we systematically discuss the approximations that can be made, and present the first two corrections to the standard lowest order formula. We particularly discuss the case of an initially polarized target, and the consequences on the spectrum as a function of the neutrino mass. We show that, while it induces an angular anisotropy that can be measured by future experiments, such anisotropy cannot be used as an additional handle to constrain the neutrino mass.


title: Designing dynamically corrected gates robust to multiple noise sources using geometric space curves

abstract: Noise-induced gate errors remain one of the main obstacles to realizing a broad range of quantum information technologies. Dynamical error suppression using carefully designed control schemes is critical for overcoming this challenge. Such schemes must be able to correct against multiple noise sources simultaneously afflicting a qubit in order to reach error correction thresholds. Here, we present a general framework for designing control fields that simultaneous suppress both noise in the fields themselves as well as transverse dephasing noise. Using the recently developed Space Curve Quantum Control formalism, in which robust quantum evolution is mapped to closed geometric curves in a multidimensional Euclidean space, we derive necessary and sufficient conditions that guarantee the cancellation of both types of noise to leading order. We present several techniques for solving these conditions and provide explicit examples of error-resistant control fields. Our work also sheds light on the relation between holonomic evolution and the suppression of control field errors.


title: Identifying unbound strong bunching and the breakdown of the Rotating Wave Approximation in the quantum Rabi model

abstract: We use a recently derived gauge-invariant formulation of the problem of a two-level system coupled to an optical cavity, to explore the transition between the weak, and the ultra-strong coupling regimes of light-matter interaction. We explore this transition using the intensity correlations $g^{(2)}(\tau)$ of the emitted light, and find strong, unbounded bunching of the emission from systems governed by the Rabi Hamiltonian. Surprisingly, this effect is observed not only in the ultra-strong coupling regime, but also for weakly coupled systems, where the Jaynes-Cummings Hamiltonian would predict the opposite, antibunched emission. This suggests that the higher-order correlations are a particularly sensitive probe of the divergence between the Jaynes-Cummings and Rabi Hamiltonians, and can serve as an indicator of the breakdown of the rotating wave approximation. Our findings indicate also that the boundary between the weakly, strongly, and ultra-strongly coupled dynamics, is much richer than currently accepted.


title: Lempel-Ziv Networks

abstract: Sequence processing has long been a central area of machine learning research. Recurrent neural nets have been successful in processing sequences for a number of tasks; however, they are known to be both ineffective and computationally expensive when applied to very long sequences. Compression-based methods have demonstrated more robustness when processing such sequences -- in particular, an approach pairing the Lempel-Ziv Jaccard Distance (LZJD) with the k-Nearest Neighbor algorithm has shown promise on long sequence problems (up to $T=200,000,000$ steps) involving malware classification. Unfortunately, use of LZJD is limited to discrete domains. To extend the benefits of LZJD to a continuous domain, we investigate the effectiveness of a deep-learning analog of the algorithm, the Lempel-Ziv Network. While we achieve successful proof of concept, we are unable to improve meaningfully on the performance of a standard LSTM across a variety of datasets and sequence processing tasks. In addition to presenting this negative result, our work highlights the problem of sub-par baseline tuning in newer research areas.


title: CGOF++: Controllable 3D Face Synthesis with Conditional Generative Occupancy Fields

abstract: Capitalizing on the recent advances in image generation models, existing controllable face image synthesis methods are able to generate high-fidelity images with some levels of controllability, e.g., controlling the shapes, expressions, textures, and poses of the generated face images. However, previous methods focus on controllable 2D image generative models, which are prone to producing inconsistent face images under large expression and pose changes. In this paper, we propose a new NeRF-based conditional 3D face synthesis framework, which enables 3D controllability over the generated face images by imposing explicit 3D conditions from 3D face priors. At its core is a conditional Generative Occupancy Field (cGOF++) that effectively enforces the shape of the generated face to conform to a given 3D Morphable Model (3DMM) mesh, built on top of EG3D [1], a recent tri-plane-based generative model. To achieve accurate control over fine-grained 3D face shapes of the synthesized images, we additionally incorporate a 3D landmark loss as well as a volume warping loss into our synthesis framework. Experiments validate the effectiveness of the proposed method, which is able to generate high-fidelity face images and shows more precise 3D controllability than state-of-the-art 2D-based controllable face synthesis methods.


title: Mask the Correct Tokens: An Embarrassingly Simple Approach for Error Correction

abstract: Text error correction aims to correct the errors in text sequences such as those typed by humans or generated by speech recognition models. Previous error correction methods usually take the source (incorrect) sentence as encoder input and generate the target (correct) sentence through the decoder. Since the error rate of the incorrect sentence is usually low (e.g., 10\%), the correction model can only learn to correct on limited error tokens but trivially copy on most tokens (correct tokens), which harms the effective training of error correction. In this paper, we argue that the correct tokens should be better utilized to facilitate effective training and then propose a simple yet effective masking strategy to achieve this goal. Specifically, we randomly mask out a part of the correct tokens in the source sentence and let the model learn to not only correct the original error tokens but also predict the masked tokens based on their context information. Our method enjoys several advantages: 1) it alleviates trivial copy; 2) it leverages effective training signals from correct tokens; 3) it is a plug-and-play module and can be applied to different models and tasks. Experiments on spelling error correction and speech recognition error correction on Mandarin datasets and grammar error correction on English datasets with both autoregressive and non-autoregressive generation models show that our method improves the correction accuracy consistently.


title: Model Agnostic Probes of Dark Sectors at Neutrino Experiments

abstract: Present and upcoming neutrino experiments can have considerable sensitivity to dark sectors that interact feebly with the Standard Model. We consider dark sectors interacting with the SM through irrelevant portals that are motivated on general principles. We derive bounds on such scenarios by considering decays of dark sector excitations inside the neutrino detector, placed downstream from the target. Our approach is model agnostic and applies to a wide range of dark sector models, both strongly and weakly coupled. In this approach, the dark sector is characterized by two scales: $\Lambda_\text{UV}$ (mass of mediators generating the portals) and $\Lambda_\text{IR}$ (mass gap of the dark sector). At intermediate energies, far away from these scales, the theory is approximately scale-invariant. This allows the calculation of production rates independent of the threshold corrections, although some mild model-dependent assumptions are needed. We look at various dark sector production processes relevant at neutrino experiments such as meson decays, direct partonic production, and dark bremsstrahlung. We consider representative experiments from past (CHARM), present (ICARUS, NOvA, MicroBooNE), and upcoming future (DUNE-MPD), and compare their reach to existing bounds from high energy experiments (LHC and LEP) and dedicated future LLP experiments (SHiP). We find that the upcoming DUNE-MPD can probe $\Lambda_\text{UV}$ in the TeV range, and $\Lambda_\text{IR}$ in the 0.1-1 GeV range, covering parts of parameter space currently inaccessible in high energy experiments and fixed-target/beam-dump experiments, and is comparable to future LLP experiments. In general, future neutrino experiments can be an efficient probe of dark sectors, providing complementary as well as new reach in parameter space.


title: Space-efficient RLZ-to-LZ77 conversion

abstract: Consider a text $T [1..n]$ prefixed by a reference sequence $R = T [1..\ell]$. We show how, given $R$ and the $z'$-phrase relative Lempel-Ziv parse of $T [\ell + 1..n]$ with respect to $R$, we can build the LZ77 parse of $T$ in $n\,\mathrm{polylog} (n)$ time and $O (\ell + z')$ total space.


title: Maximum distance between consecutive primes and other related questions

abstract: The paper considers the asymptotic of the ratio of the number of primes not exceeding the primorial and the number of residues in the reduced system of residues for the given primorial. We study the relationship between asymptotic lower bounds for the values of the Jacobstal function and the maximum distance between successive primes. One algorithm for computing the Jacobstal function is given. The substantiation of the conjectures about the upper estimate of the maximum distance between successive prime numbers is given.


title: Approximation by Power Series of Functions

abstract: Derivative-matching approximations are constructed as power series built from functions. The method assumes the knowledge of special values of the Bell polynomials of the second kind, for which we refer to the literature. The presented ideas may have applications in numerical mathematics.


title: Representation Learning for Continuous Action Spaces is Beneficial for Efficient Policy Learning

abstract: Deep reinforcement learning (DRL) breaks through the bottlenecks of traditional reinforcement learning (RL) with the help of the perception capability of deep learning and has been widely applied in real-world problems.While model-free RL, as a class of efficient DRL methods, performs the learning of state representations simultaneously with policy learning in an end-to-end manner when facing large-scale continuous state and action spaces. However, training such a large policy model requires a large number of trajectory samples and training time. On the other hand, the learned policy often fails to generalize to large-scale action spaces, especially for the continuous action spaces. To address this issue, in this paper we propose an efficient policy learning method in latent state and action spaces. More specifically, we extend the idea of state representations to action representations for better policy generalization capability. Meanwhile, we divide the whole learning task into learning with the large-scale representation models in an unsupervised manner and learning with the small-scale policy model in the RL manner.The small policy model facilitates policy learning, while not sacrificing generalization and expressiveness via the large representation model. Finally,the effectiveness of the proposed method is demonstrated by MountainCar,CarRacing and Cheetah experiments.


title: Online Dynamic Reliability Evaluation of Wind Turbines based on Drone-assisted Monitoring

abstract: The offshore wind energy is increasingly becoming an attractive source of energy due to having lower environmental impact. Effective operation and maintenance that ensures the maximum availability of the energy generation process using offshore facilities and minimal production cost are two key factors to improve the competitiveness of this energy source over other traditional sources of energy. Condition monitoring systems are widely used for health management of offshore wind farms to have improved operation and maintenance. Reliability of the wind farms are increasingly being evaluated to aid in the maintenance process and thereby to improve the availability of the farms. However, much of the reliability analysis is performed offline based on statistical data. In this article, we propose a drone-assisted monitoring based method for online reliability evaluation of wind turbines. A blade system of a wind turbine is used as an illustrative example to demonstrate the proposed approach.


title: Strategy Complexity of Threshold Payoff with Applications to Optimal Expected Payoff

abstract: We study Markov decision processes (MDPs) with a countably infinite number of states and transitions and transition-based rewards. The $\limsup$ (resp. $\liminf$) threshold objective is to maximize the probability that the $\limsup$ (resp. $\liminf$) of the infinite sequence of seen transition rewards is non-negative. We establish the complete picture of the strategy complexity of these objectives, i.e., the upper and lower bounds on the memory required by $\varepsilon$-optimal (resp. optimal) strategies. We then apply these results to solve two open problems from (Sudderth, Decisions in Economics and Finance, 2020) about the strategy complexity of optimal strategies for the expected $\limsup$ (resp. $\liminf$) payoff.


title: Actively Learning Costly Reward Functions for Reinforcement Learning

abstract: Transfer of recent advances in deep reinforcement learning to real-world applications is hindered by high data demands and thus low efficiency and scalability. Through independent improvements of components such as replay buffers or more stable learning algorithms, and through massively distributed systems, training time could be reduced from several days to several hours for standard benchmark tasks. However, while rewards in simulated environments are well-defined and easy to compute, reward evaluation becomes the bottleneck in many real-world environments, e.g., in molecular optimization tasks, where computationally demanding simulations or even experiments are required to evaluate states and to quantify rewards. Therefore, training might become prohibitively expensive without an extensive amount of computational resources and time. We propose to alleviate this problem by replacing costly ground-truth rewards with rewards modeled by neural networks, counteracting non-stationarity of state and reward distributions during training with an active learning component. We demonstrate that using our proposed ACRL method (Actively learning Costly rewards for Reinforcement Learning), it is possible to train agents in complex real-world environments orders of magnitudes faster. By enabling the application of reinforcement learning methods to new domains, we show that we can find interesting and non-trivial solutions to real-world optimization problems in chemistry, materials science and engineering.


title: Kinematic Lie Algebras From Twistor Spaces

abstract: We analyze theories with color-kinematics duality from an algebraic perspective and find that any such theory has an underlying BV${}^{\color{gray} \blacksquare}$-algebra structure, extending the ideas of arXiv:1912.03110. Conversely, we show that any theory with a BV${}^{\color{gray} \blacksquare}$-algebra features a kinematic Lie algebra that controls interaction vertices, both on- and off-shell. We explain that the archetypal example of a theory with BV${}^{\color{gray} \blacksquare}$-algebra is Chern-Simons theory, for which the resulting kinematic Lie algebra is isomorphic to the Schouten-Nijenhuis algebra on multivector fields. The BV${}^{\color{gray} \blacksquare}$-algebra implies the known color-kinematics duality of Chern-Simons theory. Similarly, we show that holomorphic and Cauchy-Riemann (CR) Chern-Simons theories come with BV${}^{\color{gray} \blacksquare}$-algebras and that, on the appropriate twistor spaces, these theories organize and identify kinematic Lie algebras for self-dual and full Yang-Mills theories, as well as the currents of any field theory with a twistorial description. We show that this result extends to the loop level under certain assumptions.


title: Worldsheet traversable wormholes

abstract: We construct worldsheet traversable wormholes by considering the effects of a double-trace deformation, $\delta\mathcal{L}\sim h\partial\phi_L\partial\phi_R$, coupling the endpoints of an open string in AdS space. The operator deforming the theory is irrelevant and makes the boundaries bend inward toward the IR. This effect, reminiscent of two-dimensional dilaton gravities, renders the teleportation protocol more efficient and facilitates the transfer of information between the members of the dual Bell pair. We compare our results with those obtained with the standard double-trace deformation, $\delta\mathcal{L}\sim h\phi_L\phi_R$, introduced by Gao, Jafferis and Wall.


title: Internal stresses analysis on welded joint in Grade 91 steel under creep test: synchrotron DRX tests and modelling

abstract: The analysis and understanding of creep damage of Grade 91 steel welded joints is an important topic in the energy industry. Creep tests on welded joints were carried out at 600$^{\circ}$C, 100MPa and then interrupted at 0%, 10%, 30%, 50%, 80% of the expected life and after failure. Creep damage is characterised by cavity bands located exclusively in the core of the sample in the InterCritical Heat Affected Zone (ICHAZ). These samples were tested using \textit{in situ} synchrotron XRD along the welded joint under creep conditions for the different creep life time. The experimental results show a significant strain evolution and creep damage characteristic on the welded joint, with a local maximum at the Heat Affected Zone (HAZ). Following this, a finite element creep strain analysis was performed for comparison with the experimental results.


title: Distilling Knowledge from Self-Supervised Teacher by Embedding Graph Alignment

abstract: Recent advances have indicated the strengths of self-supervised pre-training for improving representation learning on downstream tasks. Existing works often utilize self-supervised pre-trained models by fine-tuning on downstream tasks. However, fine-tuning does not generalize to the case when one needs to build a customized model architecture different from the self-supervised model. In this work, we formulate a new knowledge distillation framework to transfer the knowledge from self-supervised pre-trained models to any other student network by a novel approach named Embedding Graph Alignment. Specifically, inspired by the spirit of instance discrimination in self-supervised learning, we model the instance-instance relations by a graph formulation in the feature embedding space and distill the self-supervised teacher knowledge to a student network by aligning the teacher graph and the student graph. Our distillation scheme can be flexibly applied to transfer the self-supervised knowledge to enhance representation learning on various student networks. We demonstrate that our model outperforms multiple representative knowledge distillation methods on three benchmark datasets, including CIFAR100, STL10, and TinyImageNet. Code is here: https://github.com/yccm/EGA.


title: Impact of physicality on network structure

abstract: The emergence of detailed maps of physical networks, like the brain connectome, vascular networks, or composite networks in metamaterials, whose nodes and links are physical entities, have demonstrated the limits of the current network science toolset. Link physicality imposes a non-crossing condition that affects both the evolution and the structure of a network, in a way that the adjacency matrix alone -- the starting point of all graph-based approaches -- cannot capture. Here, we introduce a meta-graph that helps us discover an exact mapping between linear physical networks and independent sets, a central concept in graph theory. The mapping allows us to analytically derive both the onset of physical effects and the emergence of a jamming transition, and show that physicality impacts the network structure even when the total volume of the links is negligible. Finally, we construct the meta-graphs of several real physical networks, which allows us to predict functional features, such as synapse formation in the brain connectome, that agree with empirical data. Overall, our results show that, in order to understand the evolution and behavior of real complex networks, the role of physicality must be fully quantified.


title: On $\kappa$-pseudocompactess and uniform homeomorphisms of function spaces

abstract: A Tychonoff space $X$ is called $\kappa$-pseudocompact if for every continuous mapping $f$ of $X$ into $\mathbb{R}^\kappa$ the image $f(X)$ is compact. This notion generalizes pseudocompactness and gives a stratification of spaces lying between pseudocompact and compact spaces. It is well known that pseudocompactness of $X$ is determined by the uniform structure of the function space $C_p(X)$ of continuous real-valued functions on $X$ endowed with the pointwise topology. In respect of that A.V. Arhangel'skii asked in [Topology Appl., 89 (1998)] if analogous assertion is true for $\kappa$-pseudocompactness. We provide an affirmative answer to this question.


title: Race for Quantum Advantage using Random Circuit Sampling

abstract: Random circuit sampling, the task to sample bit strings from a random unitary operator, has been performed to demonstrate quantum advantage on the Sycamore quantum processor with 53 qubits and on the Zuchongzhi quantum processor with 56 and 61 qubits. Recently, it has been claimed that classical computers using tensor network simulation could catch on current noisy quantum processors for random circuit sampling. While the linear cross entropy benchmark fidelity is used to certify all these claims, it may not capture in detail statistical properties of outputs. Here, we compare the bit strings sampled from classical computers using tensor network simulation by Pan et al. [Phys. Rev. Lett. 129, 090502 (2022)] and by Kalachev et al. [arXiv:2112.15083 (2021)] and from the Sycamore and Zuchongzhi quantum processors. It is shown that all Kalachev et al.'s samples pass the NIST random number tests. The heat maps of bit strings show that Pan et al.'s and Kalachev et al.'s samples are quite different from the Sycamore or Zuzhongzhi samples. The analysis with the Marchenko-Pastur distribution and the Wasssertein distances demonstrates that Kalachev et al.'s samples are statistically close to the Sycamore samples than Pan et al.'s while the three datasets have similar values of the linear cross entropy fidelity. Our finding implies that further study is needed to certify or beat the claims of quantum advantage for random circuit sampling.


title: Long-term multi-wavelength study of 1ES 0647+250

abstract: The BL Lac object 1ES 0647+250 is one of the few distant $\gamma$-ray emitting blazars detected at very high energies (VHE, $\gtrsim$100 GeV) during a non-flaring state. It was detected with the MAGIC telescopes during its low activity in the years 2009-2011, as well as during three flaring activities in the years 2014, 2019 and 2020, with the highest VHE flux in the latter epoch. An extensive multi-instrument data set was collected within several coordinated observing campaigns throughout these years. We aim to characterise the long-term multi-band flux variability of 1ES 0647+250, as well as its broadband spectral energy distribution (SED) during four distinct activity states selected in four different epochs, in order to constrain the physical parameters of the blazar emission region under certain assumptions. We evaluate the variability and correlation of the emission in the different energy bands with the fractional variability and the Z-transformed Discrete Correlation Function, as well as its spectral evolution in X-rays and $\gamma$ rays. Owing to the controversy in the redshift measurements of 1ES 0647+250 reported in the literature, we also estimate its distance in an indirect manner through the comparison of the GeV and TeV spectra from simultaneous observations with Fermi-LAT and MAGIC during the strongest flaring activity detected to date. Moreover, we interpret the SEDs from the four distinct activity states within the framework of one-component and two-component leptonic models, proposing specific scenarios that are able to reproduce the available multi-instrument data.


title: From equivariant volumes to equivariant periods

abstract: We consider generalizations of equivariant volumes of abelian GIT quotients obtained as partition functions of 1d, 2d, and 3d supersymmetric GLSM on $S^1$, $D^2$ and $D^2 \times S^1$, respectively. We define these objects and study their dependence on equivariant parameters for non-compact toric K\"ahler quotients. We generalize the finite-difference equations (shift equations) obeyed by equivariant volumes to these partition functions. The partition functions are annihilated by differential/difference operators that represent equivariant quantum cohomology/K-theory relations of the target and the appearance of compact divisors in these relations plays a crucial role in the analysis of the non-equivariant limit. We show that the expansion in equivariant parameters contains information about genus-zero Gromov-Witten invariants of the target.


title: Noncommutative $AdS_2$ I: Exact solutions

abstract: We study the exact solutions of both, massless and massive, scalar field theory on the noncommutative $AdS_2$. We also discuss some important limits in order to compare with known results.


title: Time-periodic Metallic Metamaterials defined by Floquet Circuits

abstract: In this paper, we study the scattering and diffraction phenomena in time-modulated metamaterials of metallic nature by means of Floquet equivalent circuits. Concretely, we focus on a time-periodic screen that alternates between "metal" and "air" states. We generalize our previous approaches by introducing the concepts of "macroperiod" and "duty cycle" to the time modulation. This allows to analyze time-periodic metallic metamaterials whose modulation ratios are, in general, rational numbers. Furthermore, with the introduction of the duty cycle, perfect temporal symmetry is broken within the time modulation as the time screen could remain a different amount of time in metal and air states. Previous statements lead to an enrichment of the diffraction phenomenon and to new degrees of freedom that can be exploited in engineering to control the reflection and transmission of electromagnetic waves. Finally, we present some analytical results that are validated with a self-implemented finite-difference time-domain (FDTD) approach. Results show that the scattering level and diffraction angles can be controlled independently by means of the duty cycle and the modulation ratio, respectively. Thus, novel time-based pulsed sources and beamformers can be efficiently designed


title: Nonparametric Likelihood Ratio Test for Univariate Shape-constrained Densities

abstract: We provide a comprehensive study of a nonparametric likelihood ratio test on whether a random sample follows a distribution in a prespecified class of shape-constrained densities. While the conventional definition of likelihood ratio is not well-defined for general nonparametric problems, we consider a working sub-class of alternative densities that leads to test statistics with desirable properties. Under the null, a scaled and centered version of the test statistic is asymptotic normal and distribution-free, which comes from the fact that the asymptotic dominant term under the null depends only on a function of spacings of transformed outcomes that are uniform distributed. The nonparametric maximum likelihood estimator (NPMLE) under the hypothesis class appears only in an average log-density ratio which often converges to zero at a faster rate than the asymptotic normal term under the null, while diverges in general test so that the test is consistent. The main technicality is to show these results for log-density ratio which requires a case-by-case analysis, including new results for k-monotone densities with unbounded support and completely monotone densities that are of independent interest. A bootstrap method by simulating from the NPMLE is shown to have the same limiting distribution as the test statistic.


title: Invariant Smooth Quartic Surfaces by all Finite Primitive Groups of $\operatorname{PGL}_4(\mathbb{C})$

abstract: For each finite primitive subgroup $G$ of $\operatorname{PGL}_4(\mathbb{C})$, we find all the smooth $G$-invariant quartic surfaces. We also find all the faithful representations in $\operatorname{PGL}_4(\mathbb{C})$ of the smooth quartic $G$-invariant surfaces by the groups: $\mathfrak{A}_5,\mathfrak{S}_5, \operatorname{PSL_2(\mathbb{F}_7)},\mathfrak{A}_6,\mathbb{Z}_2^4\rtimes\mathbb{Z}_5$ and $\mathbb{Z}_2^4\rtimes D_{10}$. The primitive representation of these groups are precisely the subgroups of $\operatorname{PGL}_4(\mathbb{C})$ for which $\mathbb{P}^3$ is not $G$-super rigid. As a byproduct, we show that the smooth quartic surface with the biggest group of projective automorphism is given by $\{ x_0^4 + x_1^4 + x_2^4 + x_3^4 + 12 x_0 x_1 x_2 x_3= 0\}$ (unique up to projective equivalence).


title: Investor base and idiosyncratic volatility of cryptocurrencies

abstract: This paper investigates how changes in investor base is related to idiosyncratic volatility in cryptocurrency markets. For each cryptocurrency, we set change in its subreddit followers as a proxy for the change in its investor base, and find out that the latter can significantly increase cryptocurrencies idiosyncratic volatility. This finding is not subsumed by effects of size, momentum, liquidity and volume and is robust to various measures of idiosyncratic volatility.


title: Asperity Shape and Gradient Elasticity in Flexoelectric/Triboelectric Contacts

abstract: The underlying mechanisms responsible for triboelectricity have yet to be completely understood. We have previously proposed a model which explains charge transfer in non-metals via band bending due to electromechanical, especially flexoelectric, effects at deformed asperities coupled with work function differences. Here, we investigate whether the shape of asperities is important for triboelectricity. The results indicate that the shape is important in general, since how the electromechanical response scales with force and asperity size depends on the shape. This is qualitatively in agreement with experimental results. Further, we discuss how the impact of the shape depends on material, geometric, and electronic transport details. Additionally, gradient elasticity is incorporated into the model. As asperity contact is a nanoscale phenomenon, size-dependent mechanics can become significant and give more physically reasonable results. In some cases, the impact of gradient elasticity terms on the electromechanical potentials is very large, indicating that standard elasticity theory is not enough to cover some relevant cases in modelling triboelectricity.


title: The non-linear perturbation of a black hole by gravitational waves. II. Quasinormal modes and the compactification problem

abstract: Recently, Friedrich's Generalized Conformal Field Equations (GCFE) have been implemented numerically and global quantities such as the Bondi energy and the Bondi-Sachs mass loss have been successfully calculated directly on null-infinity. Although being an attractive option for studying global quantities by way of local differential geometrical methods, how viable are the GCFE for study of quantities arising in the physical space-time? In particular, how long can the evolution track phenomena that need a constant proper physical timestep to be accurately resolved? We address this question by studying the curvature oscillations induced on the Schwarzschild space-time by a non-linear gravitational perturbation. For small enough amplitudes, these are the well approximated by the linear quasinormal modes, where each mode rings at a frequency determined solely by the Schwarzschild mass. We find that the GCFE can indeed resolve these oscillations, which quickly approach the linear regime, but only for a short time before the compactification becomes ``too fast'' to handle numerically.


title: Noncommutative $AdS_2$ II: The Correspondence Principle

abstract: Using the exact solutions to the field equation for a massive scalar field on noncommutative $AdS_2$, we apply the $AdS/CFT$ correspondence principle to obtain an exact result for the associated two-point function on the conformal boundary. The answer satisfies conformal invariance and has the correct commutative limit and massless limit.


title: The Correlation: minimum wage - unemployment in the conditions of transition to digital economy

abstract: The research is done in the context of the upcoming introduction of new European legislation for the first time for regulation of minimum wage at European level. Its purpose is to identify the direction and strength of the correlation amongst changes of minimum wage and unemployment rate in the context of conflicting findings of the scientific literature. There will be used statistical instruments for the purposes of the analysis as it incorporates data for Bulgaria for the period 1991-2021. The significance of the research is related to the transition to digital economy and the necessity for complex transformation of the minimum wage functions in the context of the new socio-economic reality.


title: Green function and invariant measure estimates for nondivergence form elliptic homogenization

abstract: We prove quantitative estimates on the the parabolic Green function and the stationary invariant measure in the context of stochasic homogenization of elliptic equations in nondivergence form. We consequently obtain a quenched, local CLT for the corresponding diffusion process and a quantitative ergodicity estimate for the environmental process. Each of these results are characterized by deterministic (in terms of the environment) estimates which are valid above a random, ``minimal'' length scale, the stochastic moments of which we estimate sharply.


title: Device Directedness with Contextual Cues for Spoken Dialog Systems

abstract: In this work, we define barge-in verification as a supervised learning task where audio-only information is used to classify user spoken dialogue into true and false barge-ins. Following the success of pre-trained models, we use low-level speech representations from a self-supervised representation learning model for our downstream classification task. Further, we propose a novel technique to infuse lexical information directly into speech representations to improve the domain-specific language information implicitly learned during pre-training. Experiments conducted on spoken dialog data show that our proposed model trained to validate barge-in entirely from speech representations is faster by 38% relative and achieves 4.5% relative F1 score improvement over a baseline LSTM model that uses both audio and Automatic Speech Recognition (ASR) 1-best hypotheses. On top of this, our best proposed model with lexically infused representations along with contextual features provides a further relative improvement of 5.7% in the F1 score but only 22% faster than the baseline.


title: Quadratic Time-dependent Quantum Harmonic Oscillator

abstract: We present a Lie algebraic approach to a Hamiltonian class covering driven, parametric quantum harmonic oscillators where the parameter set -- mass, frequency, driving strength, and parametric pumping -- is time-dependent. Our unitary-transformation-based approach provides a solution to our general quadratic time-dependent quantum harmonic model. As an example, we show an analytic solution to the periodically driven quantum harmonic oscillator without the rotating wave approximation; it works for any given detuning and coupling strength regime. For the sake of validation, we provide an analytic solution to the historical Caldirola--Kanai quantum harmonic oscillator and show that there exists a unitary transformation within our framework that takes a generalized version of it onto the Paul trap Hamiltonian. In addition, we show how our approach provides the dynamics of generalized models whose Schr\"odinger equation becomes numerically unstable in the laboratory frame.


title: Voice-preserving Zero-shot Multiple Accent Conversion

abstract: Most people who have tried to learn a foreign language would have experienced difficulties understanding or speaking with a native speaker's accent. For native speakers, understanding or speaking a new accent is likewise a difficult task. An accent conversion system that changes a speaker's accent but preserves that speaker's voice identity, such as timbre and pitch, has the potential for a range of applications, such as communication, language learning, and entertainment. Existing accent conversion models tend to change the speaker identity and accent at the same time. Here, we use adversarial learning to disentangle accent dependent features while retaining other acoustic characteristics. What sets our work apart from existing accent conversion models is the capability to convert an unseen speaker's utterance to multiple accents while preserving its original voice identity. Subjective evaluations show that our model generates audio that sound closer to the target accent and like the original speaker.


title: Direct observations of a complex coronal web driving highly structured slow solar wind

abstract: The solar wind consists of continuous streams of charged particles that escape into the heliosphere from the Sun, and is split into fast and slow components, with the fast wind emerging from the interiors of coronal holes. Near the ecliptic plane, the fast wind from low-latitude coronal holes is interspersed with a highly structured slow solar wind, the source regions and drivers of which are poorly understood. Here we report extreme-ultraviolet observations that reveal a spatially complex web of magnetized plasma structures that persistently interact and reconnect in the middle corona. Coronagraphic white-light images show concurrent emergence of slow wind streams over these coronal web structures. With advanced global MHD coronal models, we demonstrate that the observed coronal web is a direct imprint of the magnetic separatrix web (S-web). By revealing a highly dynamic portion of the S-web, our observations open a window into important middle-coronal processes that appear to play a key role in driving the structured slow solar wind.


title: Fuzzy hyperspheres via confining potentials and energy cutoffs

abstract: We simplify and complete the construction of fully $O(D)$-equivariant fuzzy spheres $S^d_L$, for all dimensions $d\equiv D-1$, initiated in [G. Fiore, F. Pisacane, J. Geom. Phys. 132 (2018), 423]. This is based on imposing a suitable energy cutoff on a quantum particle in $\mathbb{R}^D$ in a confining potential well $V(r)$ with a very sharp minimum on the sphere of radius $r=1$; the cutoff and the depth of the well diverge with $L\in\mathbb{N}$. As a result, the noncommutative Cartesian coordinates $\overline{x}^i$ generate the whole algebra of observables $A_L$ on the Hilbert space $H_L$; $H_L$ can be recovered applying polynomials in the $\overline{x}^i$ to any of its elements. The commutators of the $\overline{x}^i$ are proportional to the angular momentum components, as in Snyder noncommutative spaces. $H_L$, as carrier space of a reducible representation of $O(D)$, is isomorphic to the space of harmonic homogeneous polynomials of degree $L$ in the Cartesian coordinates of (commutative) $\mathbb{R}^{D+1}$, which carries an irreducible representation ${\bf\pi}_L$ of $O(D+1)\supset O(D)$. Moreover, $A_L$ is isomorphic to ${\bf\pi}_L\left(Uso(D+1)\right)$. We resp. interpret $\{H_L\}_{L\in\mathbb{N}}$, $\{A_L\}_{L\in\mathbb{N}}$ as fuzzy deformations of the space $H_s:={\cal L}^2(S^d)$ of (square integrable) functions on $S^d$ and of the associated algebra $A_s$ of observables, because they resp. go to $H_s,A_s$ as $L$ diverges (with $\hbar$ fixed). With suitable $\hbar=\hbar(L)\stackrel{L\to\infty}{\longrightarrow} 0$, in the same limit $A_L$ goes to the (algebra of functions on the) Poisson manifold $T^*S^d$; more formally, $\{A_L\}_{L\in\mathbb{N}}$ yields a fuzzy quantization of a coadjoint orbit of $O(D+1)$ that goes to the classical phase space $T^*S^d$.


title: Proceedings of the 4th International Workshop on Reading Music Systems

abstract: The International Workshop on Reading Music Systems (WoRMS) is a workshop that tries to connect researchers who develop systems for reading music, such as in the field of Optical Music Recognition, with other researchers and practitioners that could benefit from such systems, like librarians or musicologists. The relevant topics of interest for the workshop include, but are not limited to: Music reading systems; Optical music recognition; Datasets and performance evaluation; Image processing on music scores; Writer identification; Authoring, editing, storing and presentation systems for music scores; Multi-modal systems; Novel input-methods for music to produce written music; Web-based Music Information Retrieval services; Applications and projects; Use-cases related to written music. These are the proceedings of the 4th International Workshop on Reading Music Systems, held online on Nov. 18th 2022.


title: Corn Yield Prediction based on Remotely Sensed Variables Using Variational Autoencoder and Multiple Instance Regression

abstract: In the U.S., corn is the most produced crop and has been an essential part of the American diet. To meet the demand for supply chain management and regional food security, accurate and timely large-scale corn yield prediction is attracting more attention in precision agriculture. Recently, remote sensing technology and machine learning methods have been widely explored for crop yield prediction. Currently, most county-level yield prediction models use county-level mean variables for prediction, ignoring much detailed information. Moreover, inconsistent spatial resolution between crop area and satellite sensors results in mixed pixels, which may decrease the prediction accuracy. Only a few works have addressed the mixed pixels problem in large-scale crop yield prediction. To address the information loss and mixed pixels problem, we developed a variational autoencoder (VAE) based multiple instance regression (MIR) model for large-scaled corn yield prediction. We use all unlabeled data to train a VAE and the well-trained VAE for anomaly detection. As a preprocess method, anomaly detection can help MIR find a better representation of every bag than traditional MIR methods, thus better performing in large-scale corn yield prediction. Our experiments showed that variational autoencoder based multiple instance regression (VAEMIR) outperformed all baseline methods in large-scale corn yield prediction. Though a suitable meta parameter is required, VAEMIR shows excellent potential in feature learning and extraction for large-scale corn yield prediction.


title: HouseDiffusion: Vector Floorplan Generation via a Diffusion Model with Discrete and Continuous Denoising

abstract: The paper presents a novel approach for vector-floorplan generation via a diffusion model, which denoises 2D coordinates of room/door corners with two inference objectives: 1) a single-step noise as the continuous quantity to precisely invert the continuous forward process; and 2) the final 2D coordinate as the discrete quantity to establish geometric incident relationships such as parallelism, orthogonality, and corner-sharing. Our task is graph-conditioned floorplan generation, a common workflow in floorplan design. We represent a floorplan as 1D polygonal loops, each of which corresponds to a room or a door. Our diffusion model employs a Transformer architecture at the core, which controls the attention masks based on the input graph-constraint and directly generates vector-graphics floorplans via a discrete and continuous denoising process. We have evaluated our approach on RPLAN dataset. The proposed approach makes significant improvements in all the metrics against the state-of-the-art with significant margins, while being capable of generating non-Manhattan structures and controlling the exact number of corners per room. A project website with supplementary video and document is here https://aminshabani.github.io/housediffusion.


title: Symplectic reduction and a Darboux-Moser-Weinstein theorem for Lie algebroids

abstract: We extend the Marsden-Weinstein reduction theorem and the Darboux-Moser-Weinstein theorem to symplectic Lie algebroids. We also obtain a coisotropic embedding theorem for symplectic Lie algebroids.


title: Shapley Curves: A Smoothing Perspective

abstract: This paper fills the limited statistical understanding of Shapley values as a variable importance measure from a nonparametric (or smoothing) perspective. We introduce population-level \textit{Shapley curves} to measure the true variable importance, determined by the conditional expectation function and the distribution of covariates. Having defined the estimand, we derive minimax convergence rates and asymptotic normality under general conditions for the two leading estimation strategies. For finite sample inference, we propose a novel version of the wild bootstrap procedure tailored for capturing lower-order terms in the estimation of Shapley curves. Numerical studies confirm our theoretical findings, and an empirical application analyzes the determining factors of vehicle prices.


title: SEAT: Stable and Explainable Attention

abstract: Currently, attention mechanism becomes a standard fixture in most state-of-the-art natural language processing (NLP) models, not only due to outstanding performance it could gain, but also due to plausible innate explanation for the behaviors of neural architectures it provides, which is notoriously difficult to analyze. However, recent studies show that attention is unstable against randomness and perturbations during training or testing, such as random seeds and slight perturbation of embedding vectors, which impedes it from becoming a faithful explanation tool. Thus, a natural question is whether we can find some substitute of the current attention which is more stable and could keep the most important characteristics on explanation and prediction of attention. In this paper, to resolve the problem, we provide a first rigorous definition of such alternate namely SEAT (Stable and Explainable Attention). Specifically, a SEAT should has the following three properties: (1) Its prediction distribution is enforced to be close to the distribution based on the vanilla attention; (2) Its top-k indices have large overlaps with those of the vanilla attention; (3) It is robust w.r.t perturbations, i.e., any slight perturbation on SEAT will not change the prediction distribution too much, which implicitly indicates that it is stable to randomness and perturbations. Finally, through intensive experiments on various datasets, we compare our SEAT with other baseline methods using RNN, BiLSTM and BERT architectures via six different evaluation metrics for model interpretation, stability and accuracy. Results show that SEAT is more stable against different perturbations and randomness while also keeps the explainability of attention, which indicates it is a more faithful explanation. Moreover, compared with vanilla attention, there is almost no utility (accuracy) degradation for SEAT.


title: Learning and Testing Latent-Tree Ising Models Efficiently

abstract: We provide time- and sample-efficient algorithms for learning and testing latent-tree Ising models, i.e. Ising models that may only be observed at their leaf nodes. On the learning side, we obtain efficient algorithms for learning a tree-structured Ising model whose leaf node distribution is close in Total Variation Distance, improving on the results of prior work. On the testing side, we provide an efficient algorithm with fewer samples for testing whether two latent-tree Ising models have leaf-node distributions that are close or far in Total Variation distance. We obtain our algorithms by showing novel localization results for the total variation distance between the leaf-node distributions of tree-structured Ising models, in terms of their marginals on pairs of leaves.


title: Discovering Influencers in Opinion Formation over Social Graphs

abstract: The adaptive social learning paradigm helps model how networked agents are able to form opinions on a state of nature and track its drifts in a changing environment. In this framework, the agents repeatedly update their beliefs based on private observations and exchange the beliefs with their neighbors. In this work, it is shown how the sequence of publicly exchanged beliefs over time allows users to discover rich information about the underlying network topology and about the flow of information over the graph. In particular, it is shown that it is possible (i) to identify the influence of each individual agent to the objective of truth learning, (ii) to discover how well-informed each agent is, (iii) to quantify the pairwise influences between agents, and (iv) to learn the underlying network topology. The algorithm derived herein is also able to work under non-stationary environments where either the true state of nature or the graph topology are allowed to drift over time. We apply the proposed algorithm to different subnetworks of Twitter users, and identify the most influential and central agents by using their public tweets (posts).


title: Introducing TIGRESS-NCR: I. Co-Regulation of the Multiphase Interstellar Medium and Star Formation Rates

abstract: Massive, young stars are the main source of energy that maintains multiphase structure and turbulence in the interstellar medium (ISM), and without this "feedback" the star formation rate (SFR) would be much higher than is observed. Rapid energy loss in the ISM and efficient energy recovery by stellar feedback lead to co-regulation of SFRs and the ISM state. Realistic approaches to this problem should solve the dynamical evolution of the ISM, including star formation, and the input of feedback energy self-consistently and accurately. Here, we present the TIGRESS-NCR numerical framework, in which UV radiation, supernovae, cooling and heating processes, and gravitational collapse are modeled explicitly. We use an adaptive ray tracing method for UV radiation transfer from star clusters represented by sink particles, accounting for attenuation by dust and gas. We solve photon-driven chemical equations to determine the abundances of H (time-dependent) and C/O-bearing species (steady-state), which then set cooling and heating rates self-consistently. Applying these methods, we present high-resolution magnetohydrodynamics simulations of differentially rotating local galactic disks representing typical conditions of nearby star-forming galaxies. We analyze ISM properties and phase distributions and show good agreement with existing multiwavelength galactic observations. We measure midplane pressure components (turbulent, thermal, and magnetic) and the weight, demonstrating that vertical dynamical equilibrium holds. We quantify the ratios of pressure components to the SFR surface density, which we call the feedback yields. The TIGRESS-NCR framework will allow for a wide range of parameter exploration, including low metallicity system.


title: Improved Elekes-Szab\'o type estimates using proximity

abstract: We prove a new Elekes-Szab\'o type estimate on the size of the intersection of a Cartesian product $A\times B\times C$ with an algebraic surface $\{f=0\}$ over the reals. In particular, if $A,B,C$ are sets of $N$ real numbers and $f$ is a trivariate polynomial, then either $f$ has a special form that encodes additive group structure (for example $f(x,y,x) = x + y - z$), or $A \times B\times C \cap\{f=0\}$ has cardinality $O(N^{12/7})$. This is an improvement over the previously bound $O(N^{11/6})$. We also prove an asymmetric version of our main result, which yields an Elekes-Ronyai type expanding polynomial estimate with exponent $3/2$. This has applications to questions in combinatorial geometry related to the Erd\H{o}s distinct distances problem. Like previous approaches to the problem, we rephrase the question as a $L^2$ estimate, which can be analyzed by counting additive quadruples. The latter problem can be recast as an incidence problem involving points and curves in the plane. The new idea in our proof is that we use the order structure of the reals to restrict attention to a smaller collection of proximate additive quadruples.


title: Techniques, Tricks and Algorithms for Efficient GPU-Based Processing of Higher Order Hyperbolic PDEs

abstract: GPU computing is expected to play an integral part in all modern Exascale supercomputers. It is also expected that higher order Godunov schemes will make up about a significant fraction of the application mix on such supercomputers. It is, therefore, very important to prepare the community of users of higher order schemes for hyperbolic PDEs for this emerging opportunity. We focus on three broad and high-impact areas where higher order Godunov schemes are used. The first area is computational fluid dynamics (CFD). The second is computational magnetohydrodynamics (MHD) which has an involution constraint that has to be mimetically preserved. The third is computational electrodynamics (CED) which has involution constraints and also extremely stiff source terms. Together, these three diverse uses of higher order Godunov methodology, cover many of the most important applications areas. In all three cases, we show that the optimal use of algorithms, techniques and tricks, along with the use of OpenACC, yields superlative speedups on GPUs! As a bonus, we find a most remarkable and desirable result: some higher order schemes, with their larger operations count per zone, show better speedup than lower order schemes on GPUs. In other words, the GPU is an optimal stratagem for overcoming the higher computational complexities of higher order schemes! Several avenues for future improvement have also been identified. A scalability study is presented for a real-world application using GPUs and comparable numbers of high-end multicore CPUs. It is found that GPUs offer a substantial performance benefit over comparable number of CPUs, especially when all the methods designed in this paper are used.


title: Scaling of Entanglement-Assisted Communication in Amplified Fiber Links

abstract: Quantum information processing technology offers several communication strategies, which offer capacity advantages over classical technologies. However, advantages typically arise only in very particular communication scenarios which are of limited use in public networks. Most importantly, striking capacity advantages have so far been found only for cases where the system capacity is way below commercially interesting values. In this work we present a novel scenario where pre-shared entanglement offers arbitrarily high capacity advantages, and where at the same time data rates are compatible with future network demand. Our approach rests on the observation that the number of modes in multi-mode fiber can be increased solely by tuning of the refractive index, while maintaining the fiber diameter.


title: Multiple Imputation with Neural Network Gaussian Process for High-dimensional Incomplete Data

abstract: Missing data are ubiquitous in real world applications and, if not adequately handled, may lead to the loss of information and biased findings in downstream analysis. Particularly, high-dimensional incomplete data with a moderate sample size, such as analysis of multi-omics data, present daunting challenges. Imputation is arguably the most popular method for handling missing data, though existing imputation methods have a number of limitations. Single imputation methods such as matrix completion methods do not adequately account for imputation uncertainty and hence would yield improper statistical inference. In contrast, multiple imputation (MI) methods allow for proper inference but existing methods do not perform well in high-dimensional settings. Our work aims to address these significant methodological gaps, leveraging recent advances in neural network Gaussian process (NNGP) from a Bayesian viewpoint. We propose two NNGP-based MI methods, namely MI-NNGP, that can apply multiple imputations for missing values from a joint (posterior predictive) distribution. The MI-NNGP methods are shown to significantly outperform existing state-of-the-art methods on synthetic and real datasets, in terms of imputation error, statistical inference, robustness to missing rates, and computation costs, under three missing data mechanisms, MCAR, MAR, and MNAR.


title: Dynamical transitions from slow to fast relaxation in random open quantum systems

abstract: We explore the effects of spatial locality on the dynamics of random quantum systems subject to a Markovian noise. To this end, we study a model in which the system Hamiltonian and its couplings to the noise are random matrices whose entries decay as power laws of distance, with distinct exponents $\alpha_H, \alpha_L$. The steady state is always featureless, but the rate at which it is approached exhibits three phases depending on $\alpha_H$ and $\alpha_L$: a phase where the approach is asymptotically exponential as a result of a gap in the spectrum of the Lindblad superoperator that generates the dynamics, and two gapless phases with subexponential relaxation, distinguished by the manner in which the gap decreases with system size. Within perturbation theory, the phase boundaries in the $(\alpha_H, \alpha_L)$ plane differ for weak and strong dissipation, suggesting phase transitions as a function of noise strength. We identify nonperturbative effects that prevent such phase transitions in the thermodynamic limit.


title: Locally monochromatic two-step nonlinear trident process in a plane wave

abstract: In many-cycle plane waves at intermediate intensities, the nonlinear trident process can be well-approximated by the two sequential steps of nonlinear Compton scattering of a polarised real photon followed by its transformation into an electron-positron pair via nonlinear Breit-Wheeler pair creation. We investigate this two-step process in the intermediate intensity regime by employing the locally monochromatic approximation for each step and numerically evaluating resulting expressions. When photon polarisation is included, it is found to produce an order 10% decrease in the trident rate: the importance of polarisation increases at lower intensities, and decreases at higher intensities. Its importance persists at higher intensities in a linearly-polarised background, but disappears at high intensities in a circularly-polarised background. If the two steps are made to take place in two linearly-polarised plane wave pulses with perpendicular polarisations, the pair yield can be increased by approximately 30% compared to two plane waves with the same polarisation. It is also shown that harmonic structures in the Compton step can be passed to the pair step if the Compton edge is at an energy of the order of the threshold for linear Breit-Wheeler.


title: A room-temperature electrical-field-enhanced ultrafast switch in organic microcavity polariton condensates

abstract: Integrated electro-optical switches are essential as one of the fundamental elements in the development of modern optoelectronics. As an architecture for photonic systems, exciton polaritons, that are hybrid bosonic quasiparticles that possess unique properties derived from both excitons and photons, have shown much promise. For this system, we demonstrate a significant improvement of emitted intensity and condensation threshold by applying an electric field to a microcavity filled with an organic microbelt. Our theoretical investigations indicate that the electric field makes the excitons dipolar and induces an enhancement of the exciton-polariton interaction and of the polariton lifetime. Based on these electric field induced changes, a sub-nanosecond electrical-field-enhanced polariton condensate switch is realized at room temperature, providing the basis for developing an on-chip integrated photonic device in the strong light-matter coupling regime.


title: Population statistics of intermediate mass black holes in dwarf galaxies using the NewHorizon simulation

abstract: While it is well established that supermassive black holes (SMBHs) co-evolve with their host galaxy, it is currently less clear how lower mass black holes, so-called intermediate mass black holes (IMBHs), evolve within their dwarf galaxy hosts. In this paper, we present results on the evolution of a large sample of IMBHs from the NewHorizon simulation. We show that occupation fractions of IMBHs in dwarf galaxies are at least 50 percent for galaxies with stellar masses down to 1E6 Msun, but BH growth is very limited in dwarf galaxies. In NewHorizon, IMBH growth is somewhat more efficient at high redshift z = 3 but in general IMBH do not grow significantly until their host galaxy leaves the dwarf regime. As a result, NewHorizon under-predicts observed AGN luminosity function and AGN fractions. We show that the difficulties of IMBH to remain attached to the centres of their host galaxies plays an important role in limiting their mass growth, and that this dynamic evolution away from galactic centres becomes stronger at lower redshift.


title: Universal scaling in real dimension

abstract: The concept of universality has shaped our understanding of many-body physics, but is mostly limited to homogenous systems. Here, we present a study of universality on a non-homogeneous graph, the long-range diluted graph (LRDG). Its scaling theory is controlled by a single parameter, the spectral dimension $d_{s}$, which plays the role of the relevant parameter on complex geometries. The graph under consideration allows us to tune the value of the spectral dimension continuously also to noninteger values and to find the universal exponents as continuous functions of the dimension. By means of extensive numerical simulations, we probe the scaling exponents of a simple instance of $O(\mathcal{N})$ symmetric models on the LRDG showing quantitative agreement with the theoretical prediction of universal scaling in real dimensions.


title: On the impact of incorporating task-information in learning-based image denoising

abstract: A variety of deep neural network (DNN)-based image denoising methods have been proposed for use with medical images. These methods are typically trained by minimizing loss functions that quantify a distance between the denoised image, or a transformed version of it, and the defined target image (e.g., a noise-free or low-noise image). They have demonstrated high performance in terms of traditional image quality metrics such as root mean square error (RMSE), structural similarity index measure (SSIM), or peak signal-to-noise ratio (PSNR). However, it has been reported recently that such denoising methods may not always improve objective measures of image quality. In this work, a task-informed DNN-based image denoising method was established and systematically evaluated. A transfer learning approach was employed, in which the DNN is first pre-trained by use of a conventional (non-task-informed) loss function and subsequently fine-tuned by use of the hybrid loss that includes a task-component. The task-component was designed to measure the performance of a numerical observer (NO) on a signal detection task. The impact of network depth and constraining the fine-tuning to specific layers of the DNN was explored. The task-informed training method was investigated in a stylized low-dose X-ray computed tomography (CT) denoising study for which binary signal detection tasks under signal-known-statistically (SKS) with background-known-statistically (BKS) conditions were considered. The impact of changing the specified task at inference time to be different from that employed for model training, a phenomenon we refer to as "task-shift", was also investigated. The presented results indicate that the task-informed training method can improve observer performance while providing control over the trade off between traditional and task-based measures of image quality.


title: Automorphisms of symmetric powers and motivic zeta functions

abstract: We prove that if $X$ is a smooth projective variety of dimension greater than 1 over a field $K$ of characteristic zero such that $\operatorname{Pic}(X_{\bar{K}}) = \mathbb{Z}$ and $X_{\bar{K}}$ is simply connected, then the natural map $\rho: \operatorname{Aut}(X) \to \operatorname{Aut}(\operatorname{Sym}^d(X))$ is an isomorphism for every $d > 0$. We also partially compute the motivic zeta function of a Severi-Brauer surface and explain some relations between the classes of Severi-Brauer varieties in the Grothendieck ring of varieties.


title: Dual Graphs of Polyhedral Decompositions for the Detection of Adversarial Attacks

abstract: Previous work has shown that a neural network with the rectified linear unit (ReLU) activation function leads to a convex polyhedral decomposition of the input space. These decompositions can be represented by a dual graph with vertices corresponding to polyhedra and edges corresponding to polyhedra sharing a facet, which is a subgraph of a Hamming graph. This paper illustrates how one can utilize the dual graph to detect and analyze adversarial attacks in the context of digital images. When an image passes through a network containing ReLU nodes, the firing or non-firing at a node can be encoded as a bit ($1$ for ReLU activation, $0$ for ReLU non-activation). The sequence of all bit activations identifies the image with a bit vector, which identifies it with a polyhedron in the decomposition and, in turn, identifies it with a vertex in the dual graph. We identify ReLU bits that are discriminators between non-adversarial and adversarial images and examine how well collections of these discriminators can ensemble vote to build an adversarial image detector. Specifically, we examine the similarities and differences of ReLU bit vectors for adversarial images, and their non-adversarial counterparts, using a pre-trained ResNet-50 architecture. While this paper focuses on adversarial digital images, ResNet-50 architecture, and the ReLU activation function, our methods extend to other network architectures, activation functions, and types of datasets.


title: Nepal Himalaya Offers Considerable Potential for Pumped Storage Hydropower

abstract: There is a pressing need for a transition from fossil fuel to renewable energy to meet the increasing energy demands and reduce greenhouse gas (GHG) emissions. The Himalayas possess substantial renewable energy potential that can be harnessed through hydropower projects due to its peculiar topographic characteristics and abundant water resources. However, the current exploitation rate is low owing to the predominance of run-of-river hydropower systems to support the power system. The utility-scale storage facility is crucial in the load scenario of an integrated power system to manage diurnal variation, peak demand, and penetration of intermittent energy sources. In this study, we first identify the potential of pumped storage hydropower across Nepal (a central Himalayan country) under multiple configurations by pairing lakes, hydropower projects, rivers, and available flat terrains. We then identify technically feasible pairs from those of potential locations. Infrastructural, environmental, operational, and other technical constraints govern the choice of feasible locations. We find the flat land-to-river configuration most promising than other configurations. Our results provide insight into the potential of pumped storage hydropower and are of practical importance in planning sustainable power systems in the Himalayas and beyond.


title: Diffraction by a Right-Angled No-Contrast Penetrable Wedge: Analytical Continuation of Spectral Functions

abstract: We study the problem of diffraction by a right-angled no-contrast penetrable wedge by means of a two-complex-variable Wiener-Hopf approach. Specifically, the analyticity properties of the unknown (spectral) functions of the two-complex-variable Wiener-Hopf equation are studied. We show that these spectral functions can be analytically continued onto a two-complex dimensional manifold, and unveil their singularities in $\mathbb{C}^2$. To do so, integral representation formulae for the spectral functions are given and thoroughly used. It is shown that the novel concept of additive crossing holds for the penetrable wedge diffraction problem and that we can reformulate the physical diffraction problem as a functional problem using this concept.


title: SciRepEval: A Multi-Format Benchmark for Scientific Document Representations

abstract: Learned representations of scientific documents can serve as valuable input features for downstream tasks without further fine-tuning. However, existing benchmarks for evaluating these representations fail to capture the diversity of relevant tasks. In response, we introduce SciRepEval, the first comprehensive benchmark for training and evaluating scientific document representations. It includes 24 challenging and realistic tasks, 8 of which are new, across four formats: classification, regression, ranking and search. We then use this benchmark to study and improve the generalization ability of scientific document representation models. We show how state-of-the-art models like SPECTER and SciNCL struggle to generalize across the task formats, and that simple multi-task training fails to improve them. However, a new approach that learns multiple embeddings per document, each tailored to a different format, can improve performance. We experiment with task-format-specific control codes and adapters and find they outperform the existing single-embedding state-of-the-art by over 2 points absolute. We release the resulting family of multi-format models, called SPECTER2, for the community to use and build on.


title: How do Cross-View and Cross-Modal Alignment Affect Representations in Contrastive Learning?

abstract: Various state-of-the-art self-supervised visual representation learning approaches take advantage of data from multiple sensors by aligning the feature representations across views and/or modalities. In this work, we investigate how aligning representations affects the visual features obtained from cross-view and cross-modal contrastive learning on images and point clouds. On five real-world datasets and on five tasks, we train and evaluate 108 models based on four pretraining variations. We find that cross-modal representation alignment discards complementary visual information, such as color and texture, and instead emphasizes redundant depth cues. The depth cues obtained from pretraining improve downstream depth prediction performance. Also overall, cross-modal alignment leads to more robust encoders than pre-training by cross-view alignment, especially on depth prediction, instance segmentation, and object detection.


title: Development of a Mobile Vehicle Manipulator Simulator for the Validation of Shared Control Concepts

abstract: This paper presents the development of a real-time simulator for the validation of controlling a large vehicle manipulator. The need for this development can be justified by the lack of such a simulator: There are neither open source projects nor commercial products, which would be suitable for testing cooperative control concepts. First, we present the nonlinear simulation model of the vehicle and the manipulator. For the modeling MATLAB/Simulink is used, which also enables a code generation into standalone C++ ROS-Nodes (Robot Operating System Nodes). The emerging challenges of the code generation are also discussed. Then, the obtained standalone C++ ROS-Nodes integrated in the simulator framework which includes a graphical user interface, a steering wheel and a joystick. This simulator can provide the real-time calculation of the overall system's motion enabling the interaction of human and automation. Furthermore, a qualitative validation of the model is given. Finally, the functionalities of the simulator is demonstrated in tests with a human operators.


title: Investigating datasets with high IRIS burst prevalence

abstract: Approximately 0.01 % of all Si IV 1394 A spectra sampled in 2013 and 2014 by the Interface Region Imaging Spectrograph (IRIS) have IRIS burst profiles. However, these events are not evenly distributed across datasets with 19.31 % of these spectra being identified in only six rasters. Here, we investigate five of these six datasets, to understand why they contain so many IRIS burst profiles. This research will help guide future targeted analyses of IRIS bursts. We analyse five datasets sampled by the IRIS satellite, studying both Si IV 1394 A spectra and 1400 A filter slit-jaw imager (SJI) data. IRIS burst profiles are identified through the use of an automated algorithm. Additionally, we study co-spatial line-of-sight photospheric magnetic field maps sampled by the Solar Dynamics Observatory's Helioseismic and Magnetic Imager (SDO/HMI) instrument. The majority of identified IRIS burst profiles (12401 out of 13904) found in the five datasets analysed here were localised to seven small regions in the time-distance domain (temporal durations of <4 hours and spatial lengths of <12" along the slit). The SJI data co-spatial to these regions contained long-lived or repetitive compact brightenings, matching the defined properties of UV bursts, which remained close to the IRIS slit throughout their evolutions. The IRIS burst profiles were not limited to the brightest pixels in the fields of view (FOVs) nor did they comprise the majority of bright (>500 DN/s) pixels. These IRIS burst profiles occurred co-spatial to evolving (e.g. cancelling) opposite polarity magnetic fields where magnetic reconnection is thought to be possible. More than 10 % of the IRIS burst profiles identified during the entirety of 2013 and 2014 are contained in just seven small regions in the time-distance domain where long-lived (lifetimes >10 minutes) or repetitive UV bursts occurred along the axis of the IRIS slit.


title: A Moment-Matching Approach to Testable Learning and a New Characterization of Rademacher Complexity

abstract: A remarkable recent paper by Rubinfeld and Vasilyan (2022) initiated the study of \emph{testable learning}, where the goal is to replace hard-to-verify distributional assumptions (such as Gaussianity) with efficiently testable ones and to require that the learner succeed whenever the unknown distribution passes the corresponding test. In this model, they gave an efficient algorithm for learning halfspaces under testable assumptions that are provably satisfied by Gaussians. In this paper we give a powerful new approach for developing algorithms for testable learning using tools from moment matching and metric distances in probability. We obtain efficient testable learners for any concept class that admits low-degree \emph{sandwiching polynomials}, capturing most important examples for which we have ordinary agnostic learners. We recover the results of Rubinfeld and Vasilyan as a corollary of our techniques while achieving improved, near-optimal sample complexity bounds for a broad range of concept classes and distributions. Surprisingly, we show that the information-theoretic sample complexity of testable learning is tightly characterized by the Rademacher complexity of the concept class, one of the most well-studied measures in statistical learning theory. In particular, uniform convergence is necessary and sufficient for testable learning. This leads to a fundamental separation from (ordinary) distribution-specific agnostic learning, where uniform convergence is sufficient but not necessary.


title: Run-Based Semantics for RPQs

abstract: The formalism of RPQs (regular path queries) is an important building block of most query languages for graph databases. RPQs are generally evaluated under homomorphism semantics; in particular only the endpoints of the matched walks are returned. Practical applications often need the full matched walks to compute aggregate values. In those cases, homomorphism semantics are not suitable since the number of matched walks can be infinite. Hence, graph-database engines adapt the semantics of RPQs, often neglecting theoretical red flags. For instance, the popular query language Cypher uses trail semantics, which ensures the result to be finite at the cost of making computational problems intractable. We propose a new kind of semantics for RPQs, including in particular simple-run and binding-trail semantics, as a candidate to reconcile theoretical considerations with practical aspirations. Both ensure the output to be finite in a way that is compatible with homomorphism semantics: projection on endpoints coincides with homomorphism semantics. Hence, testing the emptiness of result is tractable, and known methods readily apply. Moreover, simple-run and binding-trail semantics support bag semantics, and enumeration of the bag of results is tractable


title: CoMadOut -- A Robust Outlier Detection Algorithm based on CoMAD

abstract: Unsupervised learning methods are well established in the area of anomaly detection and achieve state of the art performances on outlier data sets. Outliers play a significant role, since they bear the potential to distort the predictions of a machine learning algorithm on a given data set. Especially among PCA-based methods, outliers have an additional destructive potential regarding the result: they may not only distort the orientation and translation of the principal components, they also make it more complicated to detect outliers. To address this problem, we propose the robust outlier detection algorithm CoMadOut, which satisfies two required properties: (1) being robust towards outliers and (2) detecting them. Our outlier detection method using coMAD-PCA defines dependent on its variant an inlier region with a robust noise margin by measures of in-distribution (ID) and out-of-distribution (OOD). These measures allow distribution based outlier scoring for each principal component, and thus, for an appropriate alignment of the decision boundary between normal and abnormal instances. Experiments comparing CoMadOut with traditional, deep and other comparable robust outlier detection methods showed that the performance of the introduced CoMadOut approach is competitive to well established methods related to average precision (AP), recall and area under the receiver operating characteristic (AUROC) curve. In summary our approach can be seen as a robust alternative for outlier detection tasks.


title: Bayesian Brain: Computation with Perception to Recognize 3D Objects

abstract: We mimic the cognitive ability of Human perception, based on Bayesian hypothesis, to recognize view-based 3D objects. We consider approximate Bayesian (Empirical Bayesian) for perceptual inference for recognition. We essentially handle computation with perception.


title: Understanding Sample Generation Strategies for Learning Heuristic Functions in Classical Planning

abstract: We study the problem of learning good heuristic functions for classical planning tasks with neural networks based on samples represented by states with their cost-to-goal estimates. The heuristic function is learned for a state space and goal condition with the number of samples limited to a fraction of the size of the state space, and must generalize well for all states of the state space with the same goal condition. Our main goal is to better understand the influence of sample generation strategies on the performance of a greedy best-first heuristic search (GBFS) guided by a learned heuristic function. In a set of controlled experiments, we find that two main factors determine the quality of the learned heuristic: the algorithm used to generate the sample set and how close the sample estimates to the perfect cost-to-goal are. These two factors are dependent: having perfect cost-to-goal estimates is insufficient if the samples are not well distributed across the state space. We also study other effects, such as adding samples with high-value estimates. Based on our findings, we propose practical strategies to improve the quality of learned heuristics: three strategies that aim to generate more representative states and two strategies that improve the cost-to-goal estimates. Our practical strategies result in a learned heuristic that, when guiding a GBFS algorithm, increases by more than 30% the mean coverage compared to a baseline learned heuristic.


title: Rank-One Editing of Encoder-Decoder Models

abstract: Large sequence to sequence models for tasks such as Neural Machine Translation (NMT) are usually trained over hundreds of millions of samples. However, training is just the origin of a model's life-cycle. Real-world deployments of models require further behavioral adaptations as new requirements emerge or shortcomings become known. Typically, in the space of model behaviors, behavior deletion requests are addressed through model retrainings whereas model finetuning is done to address behavior addition requests, both procedures being instances of data-based model intervention. In this work, we present a preliminary study investigating rank-one editing as a direct intervention method for behavior deletion requests in encoder-decoder transformer models. We propose four editing tasks for NMT and show that the proposed editing algorithm achieves high efficacy, while requiring only a single instance of positive example to fix an erroneous (negative) model behavior.