title: Dynamic Gradient Reactivation for Backward Compatible Person Re-identification

abstract: We study the backward compatible problem for person re-identification (Re-ID), which aims to constrain the features of an updated new model to be comparable with the existing features from the old model in galleries. Most of the existing works adopt distillation-based methods, which focus on pushing new features to imitate the distribution of the old ones. However, the distillation-based methods are intrinsically sub-optimal since it forces the new feature space to imitate the inferior old feature space. To address this issue, we propose the Ranking-based Backward Compatible Learning (RBCL), which directly optimizes the ranking metric between new features and old features. Different from previous methods, RBCL only pushes the new features to find best-ranking positions in the old feature space instead of strictly alignment, and is in line with the ultimate goal of backward retrieval. However, the sharp sigmoid function used to make the ranking metric differentiable also incurs the gradient vanish issue, therefore stems the ranking refinement during the later period of training. To address this issue, we propose the Dynamic Gradient Reactivation (DGR), which can reactivate the suppressed gradients by adding dynamic computed constant during forward step. To further help targeting the best-ranking positions, we include the Neighbor Context Agents (NCAs) to approximate the entire old feature space during training. Unlike previous works which only test on the in-domain settings, we make the first attempt to introduce the cross-domain settings (including both supervised and unsupervised), which are more meaningful and difficult. The experimental results on all five settings show that the proposed RBCL outperforms previous state-of-the-art methods by large margins under all settings.


title: Approximate Distance Oracles for Planar Graphs with Subpolynomial Error Dependency

abstract: Thorup [FOCS'01, JACM'04] and Klein [SODA'01] independently showed that there exists a $(1+\epsilon)$-approximate distance oracle for planar graphs with $O(n (\log n)\epsilon^{-1})$ space and $O(\epsilon^{-1})$ query time. While the dependency on $n$ is nearly linear, the space-query product of their oracles depend quadratically on $1/\epsilon$. Many follow-up results either improved the space \emph{or} the query time of the oracles while having the same, sometimes worst, dependency on $1/\epsilon$. Kawarabayashi, Sommer, and Thorup [SODA'13] were the first to improve the dependency on $1/\epsilon$ from quadratic to nearly linear (at the cost of $\log^*(n)$ factors). It is plausible to conjecture that the linear dependency on $1/\epsilon$ is optimal: for many known distance-related problems in planar graphs, it was proved that the dependency on $1/\epsilon$ is at least linear. In this work, we disprove this conjecture by reducing the dependency of the space-query product on $1/\epsilon$ from linear all the way down to \emph{subpolynomial} $(1/\epsilon)^{o(1)}$. More precisely, we construct an oracle with $O(n\log(n)(\epsilon^{-o(1)} + \log^*n))$ space and $\log^{2+o(1)}(1/\epsilon)$ query time. Our construction is the culmination of several different ideas developed over the past two decades.


title: pocoMC: A Python package for accelerated Bayesian inference in astronomy and cosmology

abstract: pocoMC is a Python package for accelerated Bayesian inference in astronomy and cosmology. The code is designed to sample efficiently from posterior distributions with non-trivial geometry, including strong multimodality and non-linearity. To this end, pocoMC relies on the Preconditioned Monte Carlo algorithm which utilises a Normalising Flow in order to decorrelate the parameters of the posterior. It facilitates both tasks of parameter estimation and model comparison, focusing especially on computationally expensive applications. It allows fitting arbitrary models defined as a log-likelihood function and a log-prior probability density function in Python. Compared to popular alternatives (e.g. nested sampling) pocoMC can speed up the sampling procedure by orders of magnitude, cutting down the computational cost substantially. Finally, parallelisation to computing clusters manifests linear scaling.


title: First-principles study of optoelectronic and thermoelectronic properties of the ScAgC half-Heusler compound

abstract: This work presents a theoretical study regarding photovoltaic (PV) & thermoelectric (TE) applications of ScAgC. The electronic, optical and thermoelectric properties are investigated using DFT and semi-classical Boltzmann transport theory. DFT calculates a direct band-gap of $\sim$$0.47$ eV, while $G_{0}W_{0}$ method estimates a band-gap of $\sim1.01$ eV. We used parabola fitting to estimate effective mass ($m^{*}$) values for bands B1-B4 at $\Gamma$-point, which are $\sim$ -0.087 (-0.075), $\sim$ -0.17 (-0.27), $\sim$ -0.17 (-0.27), and $\sim$ 0.049 (0.058) along the $\Gamma-X$ ($\Gamma-L$) direction, respectively. We also examine phonon dispersion and thermal properties. Furthermore, optoelectronics' properties are calculated within the energy range of 0 to 10 eV. The optical conductivity $\sigma (\omega)$, refractive index $\tilde{n}(\omega)$, and dielectric function $\epsilon (\omega)$ show strong optical transitions in the visible region. The lowest calculated value of reflectivity r($\omega$) is $\sim$0.24 at $\sim$4.7 eV, and the highest calculated value of absorption coefficient $\alpha (\omega )$ is $\sim1.7\times 10^{6} cm^{-1}$ at $\sim$ 8.5 eV. At 300 K, we expect a maximum solar efficiency (SLME) of $\sim$33% at $\sim$1 $\mu m$. The lattice thermal conductivity $\kappa_{ph}$ shows maximum value of $\sim$3.8 W$m^{-1}K^{-1}$ at 1200 K. At 1200 K, for electron doping of $\sim$3.9$\times$$10^{21}$$cm^{-3}$, the maximum value of $S^{2}\sigma /\tau$ is $\sim$145 $\times 10^{14}$ $\mu WK^{-2}cm^{-1}s^{-1}$, while for hole doping of $\sim$1.5$\times$$10^{21}$$cm^{-3}$, it is $\sim$123 $\times 10^{14}$ $\mu WK^{-2}cm^{-1}s^{-1}$. The highest $ZT$ at 1200 K is expected to be $\sim$0.53, whereas the optimal \%efficiency is predicted as $\sim$8.5% for cold (hot) temperatures of 300 (1200) K. The results suggest that ScAgC can be a potential candidate for solar cell and TE applications.


title: Modelling ground pickup for microwave telescopes

abstract: Microwave telescopes require an ever-increasing control of experimental systematics in their quest to measure the Cosmic Microwave Background (CMB) to exquisite levels of precision. One important systematic for ground and balloon-borne experiments is ground pickup, where beam sidelobes detect the thermal emission of the much warmer ground while the main beam is scanning the sky. This generates scan-synchronous noise in experiment timestreams, which is difficult to filter out without also deleting some of the signal from the sky. Therefore, efficient modelling of pickup can help guide the design of experiments and of analysis pipelines. In this work, we present an extension to the beamconv algorithm that enables us to generate time-ordered data (TOD) from beam-convolved sky and ground maps simultaneously. We simulate ground pickup for both a ground-based experiment and a telescope attached to a stratospheric balloon. Ground templates for the balloon experiment are obtained by re-projecting satellite maps of the Earth's microwave emission.


title: The superiorization method with restarted perturbations for split minimization problems with an application to radiotherapy treatment planning

abstract: In this paper we study the split minimization problem that consists of two constrained minimization problems in two separate spaces that are connected via a linear operator that maps one space into the other. To handle the data of such a problem we develop a superiorization approach that can reach a feasible point with reduced (not necessarily minimal) objective function values. The superiorization methodology is based on interlacing the iterative steps of two separate and independent iterative processes by perturbing the iterates of one process according to the steps dictated by the other process. We include in our developed method two novel elements. The first one is the permission to restart the perturbations in the superiorized algorithm which results in a significant acceleration and increases the computational efficiency. The second element is the ability to independently superiorize subvectors. This caters to the needs of real-world applications, as demonstrated here for a problem in intensity-modulated radiation therapy treatment planning.


title: A Computational Model for Logical Analysis of Data

abstract: Initially introduced by Peter Hammer, Logical Analysis of Data is a methodology that aims at computing a logical justification for dividing a group of data in two groups of observations, usually called the positive and negative groups. Consider this partition into positive and negative groups as the description of a partially defined Boolean function; the data is then processed to identify a subset of attributes, whose values may be used to characterize the observations of the positive groups against those of the negative group. LAD constitutes an interesting rule-based learning alternative to classic statistical learning techniques and has many practical applications. Nevertheless, the computation of group characterization may be costly, depending on the properties of the data instances. A major aim of our work is to provide effective tools for speeding up the computations, by computing some \emph{a priori} probability that a given set of attributes does characterize the positive and negative groups. To this effect, we propose several models for representing the data set of observations, according to the information we have on it. These models, and the probabilities they allow us to compute, are also helpful for quickly assessing some properties of the real data at hand; furthermore they may help us to better analyze and understand the computational difficulties encountered by solving methods. Once our models have been established, the mathematical tools for computing probabilities come from Analytic Combinatorics. They allow us to express the desired probabilities as ratios of generating functions coefficients, which then provide a quick computation of their numerical values. A further, long-range goal of this paper is to show that the methods of Analytic Combinatorics can help in analyzing the performance of various algorithms in LAD and related fields.


title: An adiabatic oracle for Grover's algorithm

abstract: Grover's search algorithm was originally proposed for circuit-based quantum computers. A crucial part of it is to query an oracle -- a black-box unitary operation. Generation of this oracle is formally beyond the original algorithm design. Here, we propose a realization of Grover's oracle for a large class of searching problems using a quantum annealing step. The time of this step grows only logarithmically with the size of the database. This suggests an efficient path to application of Grover's algorithm to practically important problems, such as finding the ground state of a Hamiltonian with a spectral gap over its ground state.


title: Zero-shot Cross-lingual Transfer is Under-specified Optimization

abstract: Pretrained multilingual encoders enable zero-shot cross-lingual transfer, but often produce unreliable models that exhibit high performance variance on the target language. We postulate that this high variance results from zero-shot cross-lingual transfer solving an under-specified optimization problem. We show that any linear-interpolated model between the source language monolingual model and source + target bilingual model has equally low source language generalization error, yet the target language generalization error reduces smoothly and linearly as we move from the monolingual to bilingual model, suggesting that the model struggles to identify good solutions for both source and target languages using the source language alone. Additionally, we show that zero-shot solution lies in non-flat region of target language error generalization surface, causing the high variance.


title: Quantization, Dequantization, and Distinguished States

abstract: Geometric quantization is a natural way to construct quantum models starting from classical data. In this work, we start from a symplectic vector space with an inner product and -- using techniques of geometric quantization -- construct the quantum algebra and equip it with a distinguished state. We compare our result with the construction due to Sorkin -- which starts from the same input data -- and show that our distinguished state coincides with the Sorkin-Johnson state. Sorkin's construction was originally applied to the free scalar field over a causal set (locally finite, partially ordered set). Our perspective suggests a natural generalization to less linear examples, such as an interacting field.


title: Observations of magnetic reconnection and particle acceleration locations in solar coronal jets

abstract: We present a multi-wavelength analysis of two flare-related jets on November 13, 2014, using data from SDO/AIA, RHESSI, Hinode/XRT, and IRIS. Unlike most coronal jets where hard X-ray (HXR) emissions are usually observed near the jet base, in these events HXR emissions are found at several locations, including in the corona. We carry out the first differential emission measure (DEM) analysis that combines both AIA (and XRT when available) bandpass filter data and RHESSI HXR measurements for coronal jets, and obtain self-consistent results across a wide temperature range and into non-thermal energies. In both events, hot plasma first appeared at the jet base, but as the base plasma gradually cooled, hot plasma also appeared near the jet top. Moreover, non-thermal electrons, while only mildly energetic, are found in multiple HXR locations and contain a large amount of total energy. Particularly, the energetic electrons that produced the HXR sources at the jet top were accelerated near the top location, rather than traveling from a reconnection site at the jet base. This means that there was more than one particle acceleration site in each event. Jet velocities are consistent with previous studies, including upward and downward velocities around ~200 km/s and ~100 km/s respectively, and fast outflows of 400-700 km/s. We also examine the energy partition in the later event, and find that the non-thermal energy in accelerated electrons is most significant compared to other energy forms considered. We discuss the interpretations and provide constraints on mechanisms for coronal jet formation.


title: From Spectral Graph Convolutions to Large Scale Graph Convolutional Networks

abstract: Graph Convolutional Networks (GCNs) have been shown to be a powerful concept that has been successfully applied to a large variety of tasks across many domains over the past years. In this work we study the theory that paved the way to the definition of GCN, including related parts of classical graph theory. We also discuss and experimentally demonstrate key properties and limitations of GCNs such as those caused by the statistical dependency of samples, introduced by the edges of the graph, which causes the estimates of the full gradient to be biased. Another limitation we discuss is the negative impact of minibatch sampling on the model performance. As a consequence, during parameter update, gradients are computed on the whole dataset, undermining scalability to large graphs. To account for this, we research alternative methods which allow to safely learn good parameters while sampling only a subset of data per iteration. We reproduce the results reported in the work of Kipf et al. and propose an implementation inspired to SIGN, which is a sampling-free minibatch method. Eventually we compare the two implementations on a benchmark dataset, proving that they are comparable in terms of prediction accuracy for the task of semi-supervised node classification.


title: Transport coefficients of second-order relativistic fluid dynamics in the relaxation-time approximation

abstract: We derive the transport coefficients of second-order fluid dynamics with $14$ dynamical moments using the method of moments and the Chapman-Enskog method in the relaxation-time approximation for the collision integral of the relativistic Boltzmann equation. Contrary to results previously reported in the literature, we find that the second-order transport coefficients derived using the two methods are in perfect agreement. Furthermore, we show that, unlike in the case of binary hard-sphere interactions, the diffusion-shear coupling coefficients $\ell_{V\pi}$, $\lambda_{V\pi}$, and $\tau_{V\pi}$ actually diverge in some approximations when the expansion order $N_\ell \rightarrow \infty$. Here we show how to circumvent such a problem in multiple ways, recovering the correct transport coefficients of second-order fluid dynamics with $14$ dynamical moments. We also validate our results for the diffusion-shear coupling by comparison to a numerical solution of the Boltzmann equation for the propagation of sound waves in an ultrarelativistic ideal gas.


title: Inferring sources of substandard and falsified products in pharmaceutical supply chains

abstract: Substandard and falsified pharmaceuticals, prevalent in low- and middle-income countries, substantially increase levels of morbidity, mortality and drug resistance. Regulatory agencies combat this problem using post-market surveillance by collecting and testing samples where consumers purchase products. Existing analysis tools for post-market surveillance data focus attention on the locations of positive samples. This paper looks to expand such analysis through underutilized supply-chain information to provide inference on sources of substandard and falsified products. We first establish the presence of unidentifiability issues when integrating this supply-chain information with surveillance data. We then develop a Bayesian methodology for evaluating substandard and falsified sources that extracts utility from supply-chain information and mitigates unidentifiability while accounting for multiple sources of uncertainty. Using de-identified surveillance data, we show the proposed methodology to be effective in providing valuable inference.


title: DDI Prediction via Heterogeneous Graph Attention Networks

abstract: Polypharmacy, defined as the use of multiple drugs together, is a standard treatment method, especially for severe and chronic diseases. However, using multiple drugs together may cause interactions between drugs. Drug-drug interaction (DDI) is the activity that occurs when the impact of one drug changes when combined with another. DDIs may obstruct, increase, or decrease the intended effect of either drug or, in the worst-case scenario, create adverse side effects. While it is critical to detect DDIs on time, it is timeconsuming and expensive to identify them in clinical trials due to their short duration and many possible drug pairs to be considered for testing. As a result, computational methods are needed for predicting DDIs. In this paper, we present a novel heterogeneous graph attention model, HAN-DDI to predict drug-drug interactions. We create a heterogeneous network of drugs with different biological entities. Then, we develop a heterogeneous graph attention network to learn DDIs using relations of drugs with other entities. It consists of an attention-based heterogeneous graph node encoder for obtaining drug node representations and a decoder for predicting drug-drug interactions. Further, we utilize comprehensive experiments to evaluate of our model and to compare it with state-of-the-art models. Experimental results show that our proposed method, HAN-DDI, outperforms the baselines significantly and accurately predicts DDIs, even for new drugs.


title: Generalized Minkowski inequality via degenerate Hessian equations on exterior domains

abstract: In this paper, we prove a generalized Minkowski inequality holds for any smooth, $(k-1)$-convex, starshaped domain $\Omega.$ Our proof relies on the solvability of the degenerate $k$-Hessian equation on the exterior domain $\mathbb R^n\setminus\Omega.$


title: The distribution of $\ell^\infty$-Selmer groups in degree $\ell$ twist families I

abstract: In this paper and its sequel, we develop a technique for finding the distribution of $\ell^{\infty}$-Selmer groups in degree $\ell$ twist families of Galois modules over number fields. Given an elliptic curve E over a number field satisfying certain technical conditions, this technique can be used to show that 100% of the quadratic twists of E have rank at most 1. Given a prime $\ell$ and a number field F not containing $\mu_{2\ell}$, this method also shows that the $\ell^{\infty}$-class groups in the family of degree $\ell$ cyclic extensions of F have a distribution consistent with the Cohen-Lenstra-Gerth heuristics. For this work, we develop the theory of the fixed point Selmer group, which serves as the base layer of the $\ell^{\infty}$-Selmer group. This first paper gives a technique for finding the distribution of $\ell^{\infty}$-Selmer groups in certain families of twists where the fixed point Selmer group is stable. In the sequel paper, we will give a technique for controlling fixed point Selmer groups.


title: Time synchronization protocol for the KLJN secure key exchange scheme

abstract: The information theoretically secure Kirchhoff-law-Johnson-noise (KLJN) key exchange scheme, similarly to quantum key distribution (QKD), is also potentially vulnerable against clock attacks, where Eve takes over the control of clock synchronization in the channel. This short note aims to introduce a time synchronization protocol scheme for Alice and Bob, which is resistant against arbitrary time delay attacks, both symmetric and asymmetric ones. We propose and explore various ways of clock synchronization for the KLJN system and propose an ultimate protocol that preserves time and hardware integrity under arbitrary attacks.


title: HyperDbg: Reinventing Hardware-Assisted Debugging (Extended Version)

abstract: Software analysis, debugging, and reverse engineering have a crucial impact in today's software industry. Efficient and stealthy debuggers are especially relevant for malware analysis. However, existing debugging platforms fail to address a transparent, effective, and high-performance low-level debugger due to their detectable fingerprints, complexity, and implementation restrictions. In this paper, we present HyperDbg, a new hypervisor-assisted debugger for high-performance and stealthy debugging of user and kernel applications. To accomplish this, HyperDbg relies on state-of-the-art hardware features available in today's CPUs, such as VT-x and extended page tables. In contrast to other widely used existing debuggers, we design HyperDbg using a custom hypervisor, making it independent of OS functionality or API. We propose hardware-based instruction-level emulation and OS-level API hooking via extended page tables to increase the stealthiness. Our results of the dynamic analysis of 10,853 malware samples show that HyperDbg's stealthiness allows debugging on average 22% and 26% more samples than WinDbg and x64dbg, respectively. Moreover, in contrast to existing debuggers, HyperDbg is not detected by any of the 13 tested packers and protectors. We improve the performance over other debuggers by deploying a VMX-compatible script engine, eliminating unnecessary context switches. Our experiment on three concrete debugging scenarios shows that compared to WinDbg as the only kernel debugger, HyperDbg performs step-in, conditional breaks, and syscall recording, 2.98x, 1319x, and 2018x faster, respectively. We finally show real-world applications, such as a 0-day analysis, structure reconstruction for reverse engineering, software performance analysis, and code-coverage analysis.


title: The OpenMP Cluster Programming Model

abstract: Despite the various research initiatives and proposed programming models, efficient solutions for parallel programming in HPC clusters still rely on a complex combination of different programming models (e.g., OpenMP and MPI), languages (e.g., C++ and CUDA), and specialized runtimes (e.g., Charm++ and Legion). On the other hand, task parallelism has shown to be an efficient and seamless programming model for clusters. This paper introduces OpenMP Cluster (OMPC), a task-parallel model that extends OpenMP for cluster programming. OMPC leverages OpenMP's offloading standard to distribute annotated regions of code across the nodes of a distributed system. To achieve that it hides MPI-based data distribution and load-balancing mechanisms behind OpenMP task dependencies. Given its compliance with OpenMP, OMPC allows applications to use the same programming model to exploit intra- and inter-node parallelism, thus simplifying the development process and maintenance. We evaluated OMPC using Task Bench, a synthetic benchmark focused on task parallelism, comparing its performance against other distributed runtimes. Experimental results show that OMPC can deliver up to 1.53x and 2.43x better performance than Charm++ on CCR and scalability experiments, respectively. Experiments also show that OMPC performance weakly scales for both Task Bench and a real-world seismic imaging application.


title: Symbolic Runtime Verification for Monitoring under Uncertainties and Assumptions

abstract: Runtime Verification deals with the question of whether a run of a system adheres to its specification. This paper studies runtime verification in the presence of partial knowledge about the observed run, particularly where input values may not be precise or may not be observed at all. We also allow declaring assumptions on the execution which permits to obtain more precise verdicts also under imprecise inputs. To this end, we show how to understand a given correctness property as a symbolic formula and explain that monitoring boils down to solving this formula iteratively, whenever more and more observations of the run are given. We base our framework on stream runtime verification, which allows to express temporal correctness properties not only in the Boolean but also in richer logical theories. While in general our approach requires to consider larger and larger sets of formulas, we identify domains (including Booleans and Linear Algebra) for which pruning strategies exist, which allows to monitor with constant memory (i.e. independent of the length of the observation) while preserving the same inference power as the monitor that remembers all observations. We empirically exhibit the power of our technique using a prototype implementation under two important cases studies: software for testing car emissions and heart-rate monitoring.


title: Using Machine Learning to Reduce Observational Biases When Detecting New Impacts on Mars

abstract: The current inventory of recent (fresh) impacts on Mars shows a strong bias towards areas of low thermal inertia. These areas are generally visually bright, and impacts create dark scours and rays that make them easier to detect. It is expected that impacts occur at a similar rate in areas of higher thermal inertia, but those impacts are under-detected. This study investigates the use of a trained machine learning classifier to increase the detection of fresh impacts on Mars using CTX data. This approach discovered 69 new fresh impacts that have been confirmed with follow-up HiRISE images. We found that examining candidates partitioned by thermal inertia (TI) values, which is only possible due to the large number of machine learning candidates, helps reduce the observational bias and increase the number of known high-TI impacts.


title: The Contribution of Lyrics and Acoustics to Collaborative Understanding of Mood

abstract: In this work, we study the association between song lyrics and mood through a data-driven analysis. Our data set consists of nearly one million songs, with song-mood associations derived from user playlists on the Spotify streaming platform. We take advantage of state-of-the-art natural language processing models based on transformers to learn the association between the lyrics and moods. We find that a pretrained transformer-based language model in a zero-shot setting -- i.e., out of the box with no further training on our data -- is powerful for capturing song-mood associations. Moreover, we illustrate that training on song-mood associations results in a highly accurate model that predicts these associations for unseen songs. Furthermore, by comparing the prediction of a model using lyrics with one using acoustic features, we observe that the relative importance of lyrics for mood prediction in comparison with acoustics depends on the specific mood. Finally, we verify if the models are capturing the same information about lyrics and acoustics as humans through an annotation task where we obtain human judgments of mood-song relevance based on lyrics and acoustics.


title: A multi-patient analysis of the center of rotation trajectories using finite element models of the human mandible

abstract: Studying different types of tooth movements can help us to better understand the force systems used for tooth position correction in orthodontic treatments. This study considers a more realistic force system in tooth movement modeling across different patients and investigates the effect of the couple force direction on the position of the center of rotation (CRot). The finite-element (FE) models of human mandibles from three patients are used to investigate the position of the CRots for different patients' teeth in 3D space. The CRot is considered a single point in a 3D coordinate system and is obtained by choosing the closest point on the axis of rotation to the center of resistance (CRes). A force system, consisting of a constant load and a couple (pair of forces), is applied to each tooth, and the corresponding CRot trajectories are examined across different patients. To perform a consistent inter-patient analysis, different patients' teeth are registered to the corresponding reference teeth using an affine transformation. The selected directions and applied points of force on the reference teeth are then transformed into the registered teeth domains. The effect of the direction of the couple on the location of the CRot is also studied by rotating the couples about the three principal axes of a patient's premolar. Our results indicate that similar patterns can be obtained for the CRot positions of different patients and teeth if the same load conditions are used. Moreover, equally rotating the direction of the couple about the three principal axes results in different patterns for the CRot positions, especially in labiolingual direction. The CRot trajectories follow similar patterns in the corresponding teeth, but any changes in the direction of the force and couple cause misalignment of the CRot trajectories, seen as rotations about the long axis of the tooth.


title: Long Short-Term Memory to predict 3D Amino acids Positions in GPCR Molecular Dynamics

abstract: G-Protein Coupled Receptors (GPCRs) are a big family of eukaryotic cell transmembrane proteins, responsible for numerous biological processes. From a practical viewpoint around 34\% of the drugs approved by the US Food and Drug Administration target these receptors. They can be analyzed from their simulated molecular dynamics, including the prediction of their behavior in the presence of drugs. In this paper, the capability of Long Short-Term Memory Networks (LSTMs) are evaluated to learn and predict the molecular dynamic trajectories of a receptor. Several models were trained with the 3D position of the amino acids of the receptor considering different transformations on the position of the amino acid, such as their centers of mass, the geometric centers and the position of the $\alpha$--carbon for each amino acid. The error of the prediction of the position was evaluated by the mean average error (MAE) and root-mean-square deviation (RMSD). The LSTM models show a robust performance, with results comparable to the state-of-the-art in non-dynamic 3D predictions. The best MAE and RMSD values were found for the mass center of the amino acids with 0.078 {\AA} and 0.156 {\AA} respectively. This work shows the potential of LSTM to predict the molecular dynamics of GPRCs.


title: Policy Diagnosis via Measuring Role Diversity in Cooperative Multi-agent RL

abstract: Cooperative multi-agent reinforcement learning (MARL) is making rapid progress for solving tasks in a grid world and real-world scenarios, in which agents are given different attributes and goals, resulting in different behavior through the whole multi-agent task. In this study, we quantify the agent's behavior difference and build its relationship with the policy performance via {\bf Role Diversity}, a metric to measure the characteristics of MARL tasks. We define role diversity from three perspectives: action-based, trajectory-based, and contribution-based to fully measure a multi-agent task. Through theoretical analysis, we find that the error bound in MARL can be decomposed into three parts that have a strong relation to the role diversity. The decomposed factors can significantly impact policy optimization on three popular directions including parameter sharing, communication mechanism, and credit assignment. The main experimental platforms are based on {\bf Multiagent Particle Environment (MPE)} and {\bf The StarCraft Multi-Agent Challenge (SMAC). Extensive experiments} clearly show that role diversity can serve as a robust measurement for the characteristics of a multi-agent cooperation task and help diagnose whether the policy fits the current multi-agent system for a better policy performance.


title: Machine Learning model for gas-liquid interface reconstruction in CFD numerical simulations

abstract: The volume of fluid (VoF) method is widely used in multi-phase flow simulations to track and locate the interface between two immiscible fluids. A major bottleneck of the VoF method is the interface reconstruction step due to its high computational cost and low accuracy on unstructured grids. We propose a machine learning enhanced VoF method based on Graph Neural Networks (GNN) to accelerate the interface reconstruction on general unstructured meshes. We first develop a methodology to generate a synthetic dataset based on paraboloid surfaces discretized on unstructured meshes. We then train a GNN based model and perform generalization tests. Our results demonstrate the efficiency of a GNN based approach for interface reconstruction in multi-phase flow simulations in the industrial context.


title: PAC-Bayesian Domain Adaptation Bounds for Multiclass Learners

abstract: Multiclass neural networks are a common tool in modern unsupervised domain adaptation, yet an appropriate theoretical description for their non-uniform sample complexity is lacking in the adaptation literature. To fill this gap, we propose the first PAC-Bayesian adaptation bounds for multiclass learners. We facilitate practical use of our bounds by also proposing the first approximation techniques for the multiclass distribution divergences we consider. For divergences dependent on a Gibbs predictor, we propose additional PAC-Bayesian adaptation bounds which remove the need for inefficient Monte-Carlo estimation. Empirically, we test the efficacy of our proposed approximation techniques as well as some novel design-concepts which we include in our bounds. Finally, we apply our bounds to analyze a common adaptation algorithm that uses neural networks.


title: A mechanically strong and ductile soft magnet with extremely low coercivity

abstract: Soft magnetic materials (SMMs) serve in electrical applications and sustainable energy supply, allowing magnetic flux variation in response to changes in applied magnetic field, at low energy loss1. The electrification of transport, households and manufacturing leads to an increase in energy consumption due to hysteresis losses2. Therefore, minimizing coercivity, which scales these losses, is crucial3. Yet, meeting this target alone is not enough: SMMs in electrical engines must withstand severe mechanical loads, i.e., the alloys need high strength and ductility4. This is a fundamental design challenge, as most methods that enhance strength introduce stress fields that can pin magnetic domains, thus increasing coercivity and hysteretic losses5. Here, we introduce an approach to overcome this dilemma. We have designed a Fe-Co-Ni-Ta-Al multicomponent alloy with ferromagnetic matrix and paramagnetic coherent nanoparticles (~91 nm size, ~55% volume fraction). They impede dislocation motion, enhancing strength and ductility. Their small size, low coherency and small magnetostatic energy create an interaction volume below the magnetic domain wall width, leading to minimal domain wall pinning, thus maintaining the soft magnetic properties. The alloy has a tensile strength of 1336 MPa at 54% tensile elongation, extremely low coercivity of 78 A/m (<1 Oe), moderate saturation magnetization of 100 Am2/kg, and high electrical resistivity of 103 {\mu}{\Omega} u Ohm cm.


title: Probing cosmic birefringence with polarized Sunyaev-Zel'dovich tomography

abstract: If the physics behind dark energy and/or dark matter violates the parity symmetry assumed in the standard cosmological paradigm, the linear polarization of the cosmic microwave background (CMB) photons can rotate due to their coupling to the dark sector. Recent 3$\sigma$ hints of this ``cosmic birefringence" in the EB spectrum of the CMB polarization motivates us to pursue new directions to independently validate and characterize the signal. Here, we explore the prospects to probe cosmic birefringence from small-scale fluctuations in the CMB using polarized Sunyaev-Zel'dovich (pSZ) tomography. We find that pSZ can be used to infer the redshift dependence of cosmic birefringence and also help calibrate the instrumental polarization orientation. To illustrate the prospects, we show that pSZ tomography may probe an axion-like dark energy model with masses $m_\phi \lesssim 10^{-32}$eV with $\mathcal{O}(0.1)$ degrees of rotation between reionization and recombination.


title: ReLyMe: Improving Lyric-to-Melody Generation by Incorporating Lyric-Melody Relationships

abstract: Lyric-to-melody generation, which generates melody according to given lyrics, is one of the most important automatic music composition tasks. With the rapid development of deep learning, previous works address this task with end-to-end neural network models. However, deep learning models cannot well capture the strict but subtle relationships between lyrics and melodies, which compromises the harmony between lyrics and generated melodies. In this paper, we propose ReLyMe, a method that incorporates Relationships between Lyrics and Melodies from music theory to ensure the harmony between lyrics and melodies. Specifically, we first introduce several principles that lyrics and melodies should follow in terms of tone, rhythm, and structure relationships. These principles are then integrated into neural network lyric-to-melody models by adding corresponding constraints during the decoding process to improve the harmony between lyrics and melodies. We use a series of objective and subjective metrics to evaluate the generated melodies. Experiments on both English and Chinese song datasets show the effectiveness of ReLyMe, demonstrating the superiority of incorporating lyric-melody relationships from the music domain into neural lyric-to-melody generation.


title: The Rate and Spatial Distribution of Novae in M31 as Determined by a Twenty-Year Survey

abstract: A long-term (1995-2016) survey for novae in the nearby Andromeda galaxy (M31) was conducted as part of the Research-Based Science Education initiative. During the course of the survey 180 nights of observation were completed at Kitt Peak, Arizona. A total of 262 novae were either discovered or confirmed, 40 of which have not been previously reported. Of these, 203 novae form a spatially-complete sample detected by the KPNO/WIYN 0.9-m telescope within a $20'\times20'$ field centered on the nucleus of M31. An additional 50 novae are part of a spatially-complete sample detected by the KPNO 4-m telescope within a larger $36'\times36'$ field. Consistent with previous studies, it is found that the spatial distribution of novae in both surveys follows the bulge light of M31 somewhat more closely than the overall background light of the galaxy. After correcting for the limiting magnitude and the spatial and temporal coverage of the surveys, a final nova rate in M31 is found to be $R=40^{+5}_{-4}$ yr$^{-1}$, which is considerably lower than recent estimates. When normalized to the $K$-band luminosity of M31, this value yields a luminosity-specific nova rate, $\nu_K = 3.3\pm0.4$ yr$^{-1} [10^{10} L_{\odot,K}]^{-1}$. By scaling the M31 nova rate using the relative infrared luminosities of M31 and our Galaxy, a nova rate of $R_\mathrm{G}=28^{+5}_{-4}$ is found for the Milky Way.


title: The Gravitational Afterglow of Boson Stars

abstract: In this work we study the long-lived post-merger gravitational wave signature of a boson-star binary coalescence. We use full numerical relativity to simulate the post-merger and track the gravitational afterglow over an extended period of time. We implement recent innovations for the binary initial data, which significantly reduce spurious initial excitations of the scalar field profiles, as well as a measure for the angular momentum that allows us to track the total momentum of the spatial volume, including the curvature contribution. Crucially, we find the afterglow to last much longer than the spin-down timescale. This prolonged gravitational wave afterglow provides a characteristic signal that may distinguish it from other astrophysical sources.


title: The MuSe 2022 Multimodal Sentiment Analysis Challenge: Humor, Emotional Reactions, and Stress

abstract: The Multimodal Sentiment Analysis Challenge (MuSe) 2022 is dedicated to multimodal sentiment and emotion recognition. For this year's challenge, we feature three datasets: (i) the Passau Spontaneous Football Coach Humor (Passau-SFCH) dataset that contains audio-visual recordings of German football coaches, labelled for the presence of humour; (ii) the Hume-Reaction dataset in which reactions of individuals to emotional stimuli have been annotated with respect to seven emotional expression intensities, and (iii) the Ulm-Trier Social Stress Test (Ulm-TSST) dataset comprising of audio-visual data labelled with continuous emotion values (arousal and valence) of people in stressful dispositions. Using the introduced datasets, MuSe 2022 2022 addresses three contemporary affective computing problems: in the Humor Detection Sub-Challenge (MuSe-Humor), spontaneous humour has to be recognised; in the Emotional Reactions Sub-Challenge (MuSe-Reaction), seven fine-grained `in-the-wild' emotions have to be predicted; and in the Emotional Stress Sub-Challenge (MuSe-Stress), a continuous prediction of stressed emotion values is featured. The challenge is designed to attract different research communities, encouraging a fusion of their disciplines. Mainly, MuSe 2022 targets the communities of audio-visual emotion recognition, health informatics, and symbolic sentiment analysis. This baseline paper describes the datasets as well as the feature sets extracted from them. A recurrent neural network with LSTM cells is used to set competitive baseline results on the test partitions for each sub-challenge. We report an Area Under the Curve (AUC) of .8480 for MuSe-Humor; .2801 mean (from 7-classes) Pearson's Correlations Coefficient for MuSe-Reaction, as well as .4931 Concordance Correlation Coefficient (CCC) and .4761 for valence and arousal in MuSe-Stress, respectively.


title: Lip-Listening: Mixing Senses to Understand Lips using Cross Modality Knowledge Distillation for Word-Based Models

abstract: In this work, we propose a technique to transfer speech recognition capabilities from audio speech recognition systems to visual speech recognizers, where our goal is to utilize audio data during lipreading model training. Impressive progress in the domain of speech recognition has been exhibited by audio and audio-visual systems. Nevertheless, there is still much to be explored with regards to visual speech recognition systems due to the visual ambiguity of some phonemes. To this end, the development of visual speech recognition models is crucial given the instability of audio models. The main contributions of this work are i) building on recent state-of-the-art word-based lipreading models by integrating sequence-level and frame-level Knowledge Distillation (KD) to their systems; ii) leveraging audio data during training visual models, a feat which has not been utilized in prior word-based work; iii) proposing the Gaussian-shaped averaging in frame-level KD, as an efficient technique that aids the model in distilling knowledge at the sequence model encoder. This work proposes a novel and competitive architecture for lip-reading, as we demonstrate a noticeable improvement in performance, setting a new benchmark equals to 88.64% on the LRW dataset.


title: Investigating a predicted metallicity [Fe/H] variation in the Type II Globular Cluster NGC 362

abstract: NGC 362 is a non-common Type II Galactic globular cluster, showing a complex pseudo two-color diagram or 'chromosome map'. The clear separation of its stellar populations in the color-magnitude diagram and the distribution of the giant stars in the chromosome map strongly suggests that NGC 362 could host stars with both cluster-nominal as well as enhanced heavy-element abundances, and one of them could be iron. However, despite previous spectroscopic observations of NGC 362, no such iron variation has been detected. Our main goal is to confirm or disprove this result by searching for any internal variation of [Fe/H] which would give us insight into the formation and evolution of this interesting globular cluster. In this paper, we present the abundance analysis for a sample of 11 red giant branch members based on high-resolution and high S/N spectra obtained with the MIKE echelle spectrograph mounted at the Magellan-Clay telescope. HST and GAIA photometry and astrometry has been used to determine atmospheric parameters and membership. We obtained T$_{\text{eff}}$, log(g) and v$_{\text{t}}$ for our target stars and measured the mean iron content of the sample and its dispersion with three different methods, which lead to [Fe/H]$_1$=-1.10$\pm0.02$, [Fe/H]$_2$=-1.09$\pm0.01$ and [Fe/H]$_3$=-1.10$\pm0.01$, while the internal dispersion turned out to be $\sigma_{[\text{Fe/H}]_1}$=0.06$\pm0.01$, $\sigma_{[\text{Fe/H}]_2}$=0.03$\pm0.01$ and $\sigma_{[\text{Fe/H}]_3}$=0.05$\pm0.01$ respectively. The error analysis gives an internal dispersion due to observational error of 0.05 dex. Comparing the observed dispersion with the internal errors, we conclude that NGC 362 does not show any trace of an internal iron spread.


title: Catalysis of entanglement and other quantum resources

abstract: In chemistry, a catalyst is a substance which enables a chemical reaction or increases its rate, while remaining unchanged in the process. Instead of chemical reactions, quantum catalysis enhances our ability to convert quantum states into each other under physical constraints. The nature of the constraints depends on the problem under study and can arise, e.g., from energy preservation. This article reviews the most recent developments in quantum catalysis and gives a historical overview of this research direction. We focus on the catalysis of quantum entanglement and coherence, and also discuss this phenomenon in quantum thermodynamics and general quantum resource theories. We review applications of quantum catalysis and also discuss the recent efforts on universal catalysis, where the quantum state of the catalyst does not depend on the states to be transformed. Catalytic embezzling is also considered, a phenomenon that occurs if the catalyst's state can change in the transition.


title: A machine-learning-based tool for last closed-flux surface reconstruction on tokamaks

abstract: Nuclear fusion represents one of the best alternatives for a sustainable source of clean energy. Tokamaks allow to confine fusion plasma with magnetic fields and one of the main challenges in the control of the magnetic configuration is the prediction/reconstruction of the Last Closed-Flux Surface (LCFS). The evolution in time of the LCFS is determined by the interaction of the actuator coils and the internal tokamak plasma. This task requires real-time capable tools able to deal with high-dimensional data as well as with high resolution in time, where the interaction between a wide range of input actuator coils with internal plasma state responses add additional layer of complexity. In this work, we present the application of a novel state of the art machine learning model to the LCFS reconstruction in the Experimental Advanced Superconducting Tokamak (EAST) that learns automatically from the experimental data of EAST. This architecture allows not only offline simulation and testing of a particular control strategy, but can also be embedded in the real-time control system for online magnetic equilibrium reconstruction and prediction. In the real-time modeling test, our approach achieves very high accuracies, with over 99% average similarity in LCFS reconstruction of the entire discharge process.


title: RE-Tagger: A light-weight Real-Estate Image Classifier

abstract: Real-estate image tagging is one of the essential use-cases to save efforts involved in manual annotation and enhance the user experience. This paper proposes an end-to-end pipeline (referred to as RE-Tagger) for the real-estate image classification problem. We present a two-stage transfer learning approach using custom InceptionV3 architecture to classify images into different categories (i.e., bedroom, bathroom, kitchen, balcony, hall, and others). Finally, we released the application as REST API hosted as a web application running on 2 cores machine with 2 GB RAM. The demo video is available here.


title: A Newton-CG based barrier method for finding a second-order stationary point of nonconvex conic optimization with complexity guarantees

abstract: In this paper we consider finding an approximate second-order stationary point (SOSP) of nonconvex conic optimization that minimizes a twice differentiable function over the intersection of an affine subspace and a convex cone. In particular, we propose a Newton-conjugate gradient (Newton-CG) based barrier method for finding an $(\epsilon,\sqrt{\epsilon})$-SOSP of this problem. Our method is not only implementable, but also achieves an iteration complexity of ${\cal O}(\epsilon^{-3/2})$, which matches the best known iteration complexity of second-order methods for finding an $(\epsilon,\sqrt{\epsilon})$-SOSP of unconstrained nonconvex optimization. The operation complexity, consisting of ${\cal O}(\epsilon^{-3/2})$ Cholesky factorizations and $\widetilde{\cal O}(\epsilon^{-3/2}\min\{n,\epsilon^{-1/4}\})$ other fundamental operations, is also established for our method.


title: Fatigue crack growth in bearing steel under cyclic mode II + static biaxial compression

abstract: Mode II fatigue crack growth under reversed shear and static biaxial compression was investigated in two bearing steels. Many aborted branches, quasi-orthogonal to the main crack, were observed along the crack face. The compressive stress parallel to the main crack hindered the growth of these branches and favored coplanar mode II crack growth. The crack face sliding displacement profiles measured by DIC were used to derive $\Delta_{\rm KII,eff}$, at the main crack tip, using elastic-plastic FE simulations with crack face friction, by an inverse method. Friction corrected crack growth kinetics were obtained for mode II crack growth in both steels.


title: Learning Joint Detection, Equalization and Decoding for Short-Packet Communications

abstract: We propose and practically demonstrate a joint detection and decoding scheme for short-packet wireless communications in scenarios that require to first detect the presence of a message before actually decoding it. For this, we extend the recently proposed serial Turbo-autoencoder neural network (NN) architecture and train it to find short messages that can be, all "at once", detected, synchronized, equalized and decoded when sent over an unsynchronized channel with memory. The conceptional advantage of the proposed system stems from a holistic message structure with superimposed pilots for joint detection and decoding without the need of relying on a dedicated preamble. This results not only in higher spectral efficiency, but also translates into the possibility of shorter messages compared to using a dedicated preamble. We compare the detection error rate (DER), bit error rate (BER) and block error rate (BLER) performance of the proposed system with a hand-crafted state-of-the-art conventional baseline and our simulations show a significant advantage of the proposed autoencoder-based system over the conventional baseline in every scenario up to messages conveying k = 96 information bits. Finally, we practically evaluate and confirm the improved performance of the proposed system over-the-air (OTA) using a software-defined radio (SDR)-based measurement testbed.


title: Turing Machines cannot simulate the human mind

abstract: Can a Turing Machine simulate the human mind? If the Church-Turing thesis is assumed to be true, then a Turing Machine should be able to simulate the human mind. In this paper, I challenge that assumption by providing strong mathematical arguments against the Church-Turing thesis. First, I show that there are decision problems that are computable for humans, but uncomputable for Turing Machines. Next, using a thought experiment I show that a humanoid robot equipped with a Turing Machine as the control unit cannot perform all humanly doable physical tasks. Finally, I show that a quantum mechanical computing device involving sequential quantum wave function collapse can compute sequences that are uncomputable for Turing Machines. These results invalidate the Church-Turing thesis and lead to the conclusion that the human mind cannot be simulated by a Turing Machine. Connecting these results, I argue that quantum effects in the human brain are fundamental to the computing abilities of the human mind.


title: Autoencoding Conditional GAN for Portfolio Allocation Diversification

abstract: Over the decades, the Markowitz framework has been used extensively in portfolio analysis though it puts too much emphasis on the analysis of the market uncertainty rather than on the trend prediction. While generative adversarial network (GAN) and conditional GAN (CGAN) have been explored to generate financial time series and extract features that can help portfolio analysis. The limitation of the CGAN framework stands in putting too much emphasis on generating series rather than keeping features that can help this generator. In this paper, we introduce an autoencoding CGAN (ACGAN) based on deep generative models that learns the internal trend of historical data while modeling market uncertainty and future trends. We evaluate the model on several real-world datasets from both the US and Europe markets, and show that the proposed ACGAN model leads to better portfolio allocation and generates series that are closer to true data compared to the existing Markowitz and CGAN approaches.


title: Locally-finite extensive categories, their semi-rings, and decomposition to connected objects

abstract: Let $\mathcal C$ be the category of finite graphs. Lov\`{a}sz shows that the semi-ring of isomorphism classes of $\mathcal C$ (with coproduct as sum, and product as multiplication) is embedded into the direct product of the semi-ring of natural numbers. Our aim is to generalize this result to other categories. For this, one crucial property is that every object decomposes to a finite coproduct of connected objects. We show that a locally-finite extensive category satisfies this condition. Conversely, a category where any object is decomposed into a finite coproduct of connected objects is shown to be extensive. The decomposition turns out to be unique. Using these results, we give some sufficient conditions that the semi-ring (the ring) of isomorphism classes of a locally finite category embeds to the direct product of natural numbers (integers, respectively). Such a construction of rings from a category is a most primitive form of Burnside rings and Grothendieck rings.


title: Tell Me the Evidence? Dual Visual-Linguistic Interaction for Answer Grounding

abstract: Answer grounding aims to reveal the visual evidence for visual question answering (VQA), which entails highlighting relevant positions in the image when answering questions about images. Previous attempts typically tackle this problem using pretrained object detectors, but without the flexibility for objects not in the predefined vocabulary. However, these black-box methods solely concentrate on the linguistic generation, ignoring the visual interpretability. In this paper, we propose Dual Visual-Linguistic Interaction (DaVI), a novel unified end-to-end framework with the capability for both linguistic answering and visual grounding. DaVI innovatively introduces two visual-linguistic interaction mechanisms: 1) visual-based linguistic encoder that understands questions incorporated with visual features and produces linguistic-oriented evidence for further answer decoding, and 2) linguistic-based visual decoder that focuses visual features on the evidence-related regions for answer grounding. This way, our approach ranked the 1st place in the answer grounding track of 2022 VizWiz Grand Challenge.


title: M-FUSE: Multi-frame Fusion for Scene Flow Estimation

abstract: Recently, neural network for scene flow estimation show impressive results on automotive data such as the KITTI benchmark. However, despite of using sophisticated rigidity assumptions and parametrizations, such networks are typically limited to only two frame pairs which does not allow them to exploit temporal information. In our paper we address this shortcoming by proposing a novel multi-frame approach that considers an additional preceding stereo pair. To this end, we proceed in two steps: Firstly, building upon the recent RAFT-3D approach, we develop an improved two-frame baseline by incorporating an advanced stereo method. Secondly, and even more importantly, exploiting the specific modeling concepts of RAFT-3D, we propose a U-Net architecture that performs a fusion of forward and backward flow estimates and hence allows to integrate temporal information on demand. Experiments on the KITTI benchmark do not only show that the advantages of the improved baseline and the temporal fusion approach complement each other, they also demonstrate that the computed scene flow is highly accurate. More precisely, our approach ranks second overall and first for the even more challenging foreground objects, in total outperforming the original RAFT-3D method by more than 16%. Code is available at https://github.com/cv-stuttgart/M-FUSE.


title: Conservative SPDEs as fluctuating mean field limits of stochastic gradient descent

abstract: The convergence of stochastic interacting particle systems in the mean-field limit to solutions of conservative stochastic partial differential equations is established, with optimal rate of convergence. As a second main result, a quantitative central limit theorem for such SPDEs is derived, again, with optimal rate of convergence. The results apply, in particular, to the convergence in the mean-field scaling of stochastic gradient descent dynamics in overparametrized, shallow neural networks to solutions of SPDEs. It is shown that the inclusion of fluctuations in the limiting SPDE improves the rate of convergence, and retains information about the fluctuations of stochastic gradient descent in the continuum limit.


title: Optical Field Recovery in Jones Space

abstract: Optical full-field recovery makes it possible to compensate for fiber impairments such as chromatic dispersion and polarization mode dispersion (PMD) in the digital signal processing. For cost-sensitive short-reach optical networks, some advanced single-polarization (SP) optical field recovery schemes are recently proposed to avoid chromatic dispersion-induced power fading effect, and improve the spectral efficiency for larger potential capacity. Polarization division multiplexing (PDM) can further double both the spectral efficiency and the system capacity of these SP carrier-assisted direct detection (DD) schemes. However, the so-called polarization fading phenomenon induced by random polarization rotation is a fundamental obstacle which prevents SP carrier-assisted DD systems from polarization diversity. In this paper, we propose a receiver of Jones-space field recovery (JSFR) to realize polarization diversity with SP carrier-assisted DD schemes in Jones space. Different receiver structures and simplified recovery procedures for JSFR are explored theoretically. The proposed JSFR pushes the SP DD schemes towards PDM without extra optical signal-to-noise ratio (OSNR) penalty. In addition, the JSFR shows good tolerance to PMD since the optical field recovery is conducted before polarization recovery. In the concept-of-proof experiment, we demonstrate 448-Gb/s reception over 80-km single-mode fiber using the proposed JSFR based on 22 couplers. Furthermore, we qualitatively compare the optical field recovery in Jones space and Stokes space from the perspective of the modulation dimension. Qualitatively, we compare the optical field recovery in the Jones space and Stokes space from the perspective of the modulation dimension.


title: CosmicNet II: Emulating extended cosmologies with efficient and accurate neural networks

abstract: In modern analysis pipelines, Einstein-Boltzmann Solvers (EBSs) are an invaluable tool for obtaining CMB and matter power spectra. To accelerate the computation of these observables, the CosmicNet strategy is to replace the bottleneck of an EBS, which is the integration of a system of differential equations for linear cosmological perturbations, by neural networks. This strategy offers advantages compared to the direct emulation of the final observables, including small networks that are easy to train in high-dimensional parameter spaces, and which do not depend by on primordial spectrum parameters nor observation-related quantities such as selection functions. In this second CosmicNet paper, we present a more efficient set of networks that are already trained for extended cosmologies beyond LCDM, with massive neutrinos, extra relativistic degrees of freedom, spatial curvature, and dynamical dark energy. We release a new branch of the CLASS code, called CLASSNET, which automatically uses networks within a region of trusted accuracy. We demonstrate the accuracy and performance of CLASSNET by presenting parameter inference runs from Planck, BAO and supernovae data, performed with CLASSNET and the COBAYA inference package. We have eliminated the perturbation module as a bottleneck of the EBS, with a speedup that is even more remarkable in extended cosmologies, where the usual approach would have been more expensive while the network's performance remains the same. We obtain a speedup factor of order 150 for the emulated perturbation module of CLASS. For the whole code, this translates into an overall speedup factor of order 3 when computing CMB harmonic spectra (now dominated by the highly parallelizable and further optimizable line-of-sight integration), and of order 50 when computing matter power spectra (less than 0.1 seconds even in extended cosmologies).


title: Improved Batching Strategy For Irregular Time-Series ODE

abstract: Irregular time series data are prevalent in the real world and are challenging to model with a simple recurrent neural network (RNN). Hence, a model that combines the use of ordinary differential equations (ODE) and RNN was proposed (ODE-RNN) to model irregular time series with higher accuracy, but it suffers from high computational costs. In this paper, we propose an improvement in the runtime on ODE-RNNs by using a different efficient batching strategy. Our experiments show that the new models reduce the runtime of ODE-RNN significantly ranging from 2 times up to 49 times depending on the irregularity of the data while maintaining comparable accuracy. Hence, our model can scale favorably for modeling larger irregular data sets.


title: HST-Based Lens Model of SDSS J1226+2152, in Preparation for JWST-ERS TEMPLATES

abstract: The strongly lensed z=2.9233 Lyman break galaxy, SGAS J122651.3+215220, lensed by a cluster at z=0.4358, was first targeted by JWST as part of the JWST-ERS program TEMPLATES: Targeting Extremely Magnified Panchromatic Lensed Arcs and their Extended Star formation. Aiming to combine the exquisite capabilities of JWST with the extreme magnification provided by strong gravitational lensing, these observations will peer into galaxies at cosmic noon and probe the building blocks of star formation. Here, we present an Hubble Space Telescope strong lensing analysis, lens model, source-plane interpretation, and the lensing outputs needed to analyze the JWST observations in the context of the source's intrinsic properties. The lens model outputs are made publicly available to the community through the Mikulski Archive for Space Telescopes (MAST) Portal.


title: The Untold Impact of Learning Approaches on Software Fault-Proneness Predictions

abstract: Software fault-proneness prediction is an active research area, with many factors affecting prediction performance extensively studied. However, the impact of the learning approach (i.e., the specifics of the data used for training and the target variable being predicted) on the prediction performance has not been studied, except for one initial work. This paper explores the effects of two learning approaches, useAllPredictAll and usePrePredictPost, on the performance of software fault-proneness prediction, both within-release and across-releases. The empirical results are based on data extracted from 64 releases of twelve open-source projects. Results show that the learning approach has a substantial, and typically unacknowledged, impact on the classification performance. Specifically, using useAllPredictAll leads to significantly better performance than using usePrePredictPost learning approach, both within-release and across-releases. Furthermore, this paper uncovers that, for within-release predictions, this difference in classification performance is due to different levels of class imbalance in the two learning approaches. When class imbalance is addressed, the performance difference between the learning approaches is eliminated. Our findings imply that the learning approach should always be explicitly identified and its impact on software fault-proneness prediction considered. The paper concludes with a discussion of potential consequences of our results for both research and practice.


title: Nonthermal effects in solids after swift heavy ion impact

abstract: This contribution is a brief introduction to nonthermal effects related to modifications of the interatomic potential upon ultrafast excitation of the electronic system of solids, primarily focusing on the swift heavy ion track problem. We clarify the difference between the exchange of the kinetic energy of electrons (and holes) scattering on the lattice (electron-phonon coupling, "thermal effects") and the relaxation of the nonequilibrium potential energy of a solid ("nonthermal effects"). We discuss that at different degrees of electronic excitation, the modification of the interatomic potential may result in various phase transitions without an increase of the atomic temperature, i.e., at room temperature (nonthermal melting, formation of the superionic state), or in atomic acceleration causing "nonthermal heating" of the target atoms. Examples of theoretically predicted various effects are given, supported by known experimental observations.


title: Hybrid topological photonic crystals

abstract: Photonic topological phases offering unprecedented manipulation of electromagnetic waves have attracted much research interest which, however, have been mostly restricted to a single band gap. Here, we report on the experimental discovery of hybrid topological photonic crystals which host simultaneously quantum anomalous Hall and valley Hall phases in different photonic band gaps. The underlying hybrid topological phase manifests itself in the edge responses as the coexistence of the chiral edge states and valley Hall edge states in different frequency ranges. We experimentally verify such an emergent phenomenon and show that such a feature enables novel multiplexing of photon transport in the edge channels. Our study reveals a situation with coexisting topology of distinct nature in a single photonic system that may enable frequency-dependent filtering and manipulation of topological edge photons.


title: Linear programming with unitary-equivariant constraints

abstract: Unitary equivariance is a natural symmetry that occurs in many contexts in physics and mathematics. Optimization problems with such symmetry can often be formulated as semidefinite programs for a $d^{p+q}$-dimensional matrix variable that commutes with $U^{\otimes p} \otimes \bar{U}^{\otimes q}$, for all $U \in \mathrm{U}(d)$. Solving such problems naively can be prohibitively expensive even if $p+q$ is small but the local dimension $d$ is large. We show that, under additional symmetry assumptions, this problem reduces to a linear program that can be solved in time that does not scale in $d$, and we provide a general framework to execute this reduction under different types of symmetries. The key ingredient of our method is a compact parametrization of the solution space by linear combinations of walled Brauer algebra diagrams. This parametrization requires the idempotents of a Gelfand-Tsetlin basis, which we obtain by adapting a general method arXiv:1606.08900 inspired by the Okounkov-Vershik approach. To illustrate potential applications, we use several examples from quantum information: deciding the principal eigenvalue of a quantum state, quantum majority vote, asymmetric cloning and transformation of a black-box unitary. We also outline a possible route for extending our method to general unitary-equivariant semidefinite programs.


title: Bayesian Experimental Design for Computed Tomography with the Linearised Deep Image Prior

abstract: We investigate adaptive design based on a single sparse pilot scan for generating effective scanning strategies for computed tomography reconstruction. We propose a novel approach using the linearised deep image prior. It allows incorporating information from the pilot measurements into the angle selection criteria, while maintaining the tractability of a conjugate Gaussian-linear model. On a synthetically generated dataset with preferential directions, linearised DIP design allows reducing the number of scans by up to 30% relative to an equidistant angle baseline.


title: myqcs: Quantum Circuit Simulator

abstract: myqcs is a quantum circuit simulator using tensor. The simulator can be used with both wave functions or density matrices. The simulator also included noise that can be varied in form and that can be different for each gate.


title: Mathematical analysis and numerical simulation of the Guyer-Krumhansl heat equation

abstract: The Guyer-Krumhansl heat equation has numerous important practical applications in both low-temperature and room temperature heat conduction problems. In recent years, it turned out that the Guyer-Krumhansl model can effectively describe the thermal behaviour of macroscale heterogeneous materials. Thus, the Guyer-Krumhansl equation is a promising candidate to be the next standard model in engineering. However, to support the Guyer-Krumhansl equation's introduction into the engineering practice, its mathematical properties must be thoroughly investigated and understood. In the present paper, we show the basic structure of this particular heat equation, focusing on the differences in comparison to the Fourier heat equation {obtained when $(\tau_{q}, \mu^{2})\rightarrow (0,0)$}. Additionally, we prove the well-posedness of a particular, practically significant initial and boundary value problem. The stability of the solution is also investigated in the discrete space using a finite difference approach.


title: Homotopy Equivalences of 3-Manifolds

abstract: Let $M$ be an oriented closed $3$-manifold. We prove that there exists a constant $A_M$, depending only on the manifold $M$, such that for every self-homotopy equivalence $f$ of $M$ there is an integer $k$ such that $1 \leq k \leq A_M$ and $f^k$ is homotopic to a homeomorphism.


title: $\kappa$-deformed complex fields, (discrete) symmetries, and charges

abstract: We will briefly describe how to build a field theory of a complex scalar field in the $\kappa$-Minkowski spacetime. After introducing the action, we will shortly describe its properties under both continuous and deformed symmetry transformations. We will then describe how to compute the charges and describe their non-trivial properties due to $\kappa$-deformation. We will conclude with the experimental significance of the model, particularly in the context of decay probability differences between particles and antiparticles.


title: Thermodynamic consistency of quantum master equations

abstract: Starting from a microscopic system-baths description, we derive the general conditions for a time-local quantum master equation (QME) to satisfy the first and second law of thermodynamics at the fluctuating level. Using counting statistics, we show that the fluctuating second law can be rephrased as a Generalized Quantum Detailed Balance condition (GQDB), i.e., a symmetry of the time-local generators which ensures the validity of the fluctuation theorem. When requiring in addition a strict system-bath energy conservation, the GQDB reduces to the usual notion of detailed balance which ensures QMEs with Gibbsian steady states. However, if energy conservation is only required on average, QMEs with non Gibbsian steady states can still maintain a certain level of thermodynamic consistency. Applying our theory to commonly used QMEs, we show that the Redfield equation breaks the GQDB, and that some recently derived approximation schemes based on the Redfield equation (which hold beyond the secular approximation and allow to derive a QME of Lindblad form) satisfy the GQDB and the average first law. We find that performing the secular approximation is the only way to ensure the first and second law at the fluctuating level.


title: The relation between Parisi scheme and multi-thermalized dynamics in finite dimensions

abstract: In this note we summarize the connections between equilibrium and slow out of equilibrium dynamics in finite dimensional glasses, such as we understand them today. If we assume that a finite-dimensional system is stable with respect to a family of weak random perturbations (stochastic stability), then its dynamics have a `Multithermalization' structure if and only if the Boltzmann-Gibbs distribution obeys an Ultrametric Parisi distribution.


title: About the (in)equivalence between holonomic versus non-holonomic theories of gravity

abstract: We investigate the scenarios in which a holonomic versus a non-holonomic frame description of gravity theories are equivalent. It turns out that classically, the equivalence holds in a way that is independent of the particular dynamics and/or spacetime dimension. This includes general metric-affine dynamics. A global bundle-theoretical investigation is carried out, uncovering the equivalence principle as the culprit. The equivalence holds as long as the equivalence principle holds. This is not something to be expected when non-invertible configurations of the vielbein field are taken into account. In such case, the gauge-theoretical description of gravity unsolders from spacetime, and one has to decide if gravity is spacetime geometry or an internal gauge theory.


title: Quantifying the high-dimensionality of quantum devices

abstract: We introduce a measure of average dimensionality (or coherence) for high-dimensional quantum devices. This includes sets of quantum measurements, steering assemblages, and quantum channels. For measurements and channels, our measure corresponds to an average compression dimension, whereas for quantum steering we get a semi-device independent quantifier for the average entanglement dimensionality known as the Schmidt measure. We analyse the measure in all three scenarios. First, we show that it can be decided via semi-definite programming for channels and measurements in low-dimensional systems. Second, we argue that the resulting steering measure is a high-dimensional generalisation of the well-known steering weight. Finally, we analyse the behaviour of the measure in the asymptotic setting. More precisely, we show that the asymptotic Schmidt measure of bipartite quantum states is equal to the entanglement cost and show how the recently introduced entanglement of formation for steering assemblages can be related to our measure in the asymptotic case.


title: Latent Variable Models for Bayesian Causal Discovery

abstract: Learning predictors that do not rely on spurious correlations involves building causal representations. However, learning such a representation is very challenging. We, therefore, formulate the problem of learning a causal representation from high dimensional data and study causal recovery with synthetic data. This work introduces a latent variable decoder model, Decoder BCD, for Bayesian causal discovery and performs experiments in mildly supervised and unsupervised settings. We present a series of synthetic experiments to characterize important factors for causal discovery and show that using known intervention targets as labels helps in unsupervised Bayesian inference over structure and parameters of linear Gaussian additive noise latent structural causal models.


title: AGBoost: Attention-based Modification of Gradient Boosting Machine

abstract: A new attention-based model for the gradient boosting machine (GBM) called AGBoost (the attention-based gradient boosting) is proposed for solving regression problems. The main idea behind the proposed AGBoost model is to assign attention weights with trainable parameters to iterations of GBM under condition that decision trees are base learners in GBM. Attention weights are determined by applying properties of decision trees and by using the Huber's contamination model which provides an interesting linear dependence between trainable parameters of the attention and the attention weights. This peculiarity allows us to train the attention weights by solving the standard quadratic optimization problem with linear constraints. The attention weights also depend on the discount factor as a tuning parameter, which determines how much the impact of the weight is decreased with the number of iterations. Numerical experiments performed for two types of base learners, original decision trees and extremely randomized trees with various regression datasets illustrate the proposed model.


title: Properties of the Anomalous States of Positronium

abstract: It is shown that there are anomalous bound-state solutions to the two-body Dirac equation for an electron and positron interacting via an electromagnetic potential. These anomalous solutions have quantized coordinates at nuclear distances (fermi) and are orthogonal to the usual atomic positronium bound-states as shown by a simple extension of the Bethe-Salpeter equation. It is shown that the anomalous states have many properties which correspond to those of neutrinos.


title: Exclusive emissions of polarized $\rho$ mesons at the EIC and the proton content at low $x$

abstract: We present a new study on helicity amplitudes and cross sections for the exclusive production of $\rho$ mesons at the EIC in high-energy factorization. In this framework the analytic expression of amplitudes takes the form of a convolution between an off-shell impact factor, depicting the ($\gamma^* \to \rho$) transition, and a nonperturbative density, known as Unintegrated Gluon Distribution (UGD) that encodes information about the proton structure at low $x$ and evolves according to the BFKL equation. We come out with an evidence that observables sensitive to the polarizations of the incoming virtual photon and of the emitted meson allow us to discriminate among different UGD models and to gather quantitative information on the proton content at high energies.


title: Enhancing Fairness of Visual Attribute Predictors

abstract: The performance of deep neural networks for image recognition tasks such as predicting a smiling face is known to degrade with under-represented classes of sensitive attributes. We address this problem by introducing fairness-aware regularization losses based on batch estimates of Demographic Parity, Equalized Odds, and a novel Intersection-over-Union measure. The experiments performed on facial and medical images from CelebA, UTKFace, and the SIIM-ISIC melanoma classification challenge show the effectiveness of our proposed fairness losses for bias mitigation as they improve model fairness while maintaining high classification performance. To the best of our knowledge, our work is the first attempt to incorporate these types of losses in an end-to-end training scheme for mitigating biases of visual attribute predictors. Our code is available at https://github.com/nish03/FVAP.


title: Relativistic dynamical friction in stellar systems

abstract: We extend the classical formulation of the dynamical friction effect on a test star by Chandrasekhar to the case of relativistic velocities and velocity distributions also accounting for post-Newtonian corrections to the gravitational force. The original kinetic framework is revised and used to construct a special-relativistic dynamical friction formula where the relative velocities changes in subsequent encounters are added up with Lorentz transformation and the velocity distribution of the field stars accounts for relativistic velocities. Furthermore, a simple expression is obtained for systems where the post-Newtonian correction on the gravitational forces become relevant even at non-relativistic particle velocities. Finally, using a linearized Lagrangian we derive another expression for the dynamical friction expression in a more compact form than that of Lee (1969). Comparing our formulation with the classical one, we observe that a given test particle suffers a slightly stronger drag when moving through a distribution of field stars with relativistic velocity distribution. Vice versa, a purely classical treatment of a system where post-Newtonian (PN) corrections should be included, over estimates the effect of dynamical friction at low test particle velocity, regardless of the form of velocity distribution. Finally, a first order PN dynamical friction covariant formulation is less strong than its classical counterpart at small velocities but much higher for large velocities over a broad range of mass ratios


title: Physical Passive Patch Adversarial Attacks on Visual Odometry Systems

abstract: Deep neural networks are known to be susceptible to adversarial perturbations -- small perturbations that alter the output of the network and exist under strict norm limitations. While such perturbations are usually discussed as tailored to a specific input, a universal perturbation can be constructed to alter the model's output on a set of inputs. Universal perturbations present a more realistic case of adversarial attacks, as awareness of the model's exact input is not required. In addition, the universal attack setting raises the subject of generalization to unseen data, where given a set of inputs, the universal perturbations aim to alter the model's output on out-of-sample data. In this work, we study physical passive patch adversarial attacks on visual odometry-based autonomous navigation systems. A visual odometry system aims to infer the relative camera motion between two corresponding viewpoints, and is frequently used by vision-based autonomous navigation systems to estimate their state. For such navigation systems, a patch adversarial perturbation poses a severe security issue, as it can be used to mislead a system onto some collision course. To the best of our knowledge, we show for the first time that the error margin of a visual odometry model can be significantly increased by deploying patch adversarial attacks in the scene. We provide evaluation on synthetic closed-loop drone navigation data and demonstrate that a comparable vulnerability exists in real data. A reference implementation of the proposed method and the reported experiments is provided at https://github.com/patchadversarialattacks/patchadversarialattacks.


title: 1st Place Solution to the EPIC-Kitchens Action Anticipation Challenge 2022

abstract: In this report, we describe the technical details of our submission to the EPIC-Kitchens Action Anticipation Challenge 2022. In this competition, we develop the following two approaches. 1) Anticipation Time Knowledge Distillation using the soft labels learned by the teacher model as knowledge to guide the student network to learn the information of anticipation time; 2) Verb-Noun Relation Module for building the relationship between verbs and nouns. Our method achieves state-of-the-art results on the testing set of EPIC-Kitchens Action Anticipation Challenge 2022.


title: Rigidity of strictly convex domains in Euclidean spaces

abstract: In this paper, we prove a rigidity theorem for smooth strictly convex domains in Euclidean spaces.


title: ElectroVoxel: Electromagnetically Actuated Pivoting for Scalable Modular Self-Reconfigurable Robots

abstract: This paper introduces a cube-based reconfigurable robot that utilizes an electromagnet-based actuation framework to reconfigure in three dimensions via pivoting. While a variety of actuation mechanisms for self-reconfigurable robots have been explored, they often suffer from cost, complexity, assembly and sizing requirements that prevent scaled production of such robots. To address this challenge, we use an actuation mechanism based on electromagnets embedded into the edges of each cube to interchangeably create identically or oppositely polarized electromagnet pairs, resulting in repulsive or attractive forces, respectively. By leveraging attraction for hinge formation, and repulsion to drive pivoting maneuvers, we can reconfigure the robot by voxelizing it and actuating its constituent modules - termed Electrovoxels - via electromagnetically actuated pivoting. To demonstrate this, we develop fully untethered, three-dimensional self-reconfigurable robots and demonstrate 2D and 3D self-reconfiguration using pivot and traversal maneuvers on an air-table and in microgravity on a parabolic flight. This paper describes the hardware design of our robots, its pivoting framework, our reconfiguration planning software, and an evaluation of the dynamical and electrical characteristics of our system to inform the design of scalable self-reconfigurable robots.


title: A Skeleton-aware Graph Convolutional Network for Human-Object Interaction Detection

abstract: Detecting human-object interactions is essential for comprehensive understanding of visual scenes. In particular, spatial connections between humans and objects are important cues for reasoning interactions. To this end, we propose a skeleton-aware graph convolutional network for human-object interaction detection, named SGCN4HOI. Our network exploits the spatial connections between human keypoints and object keypoints to capture their fine-grained structural interactions via graph convolutions. It fuses such geometric features with visual features and spatial configuration features obtained from human-object pairs. Furthermore, to better preserve the object structural information and facilitate human-object interaction detection, we propose a novel skeleton-based object keypoints representation. The performance of SGCN4HOI is evaluated in the public benchmark V-COCO dataset. Experimental results show that the proposed approach outperforms the state-of-the-art pose-based models and achieves competitive performance against other models.


title: Conversion of squeezed gravitons into photons during inflation

abstract: It is believed that relic gravitons are squeezed during inflation. If so, quantum noise induced by them can be significantly enhanced in current interferometers. However, decoherence of the gravitons during cosmic history may change the degree of squeezing. As a first step for analyzing the decoherence of the gravitons, we assume the presence of a sizable magnetic field at the beginning of inflation and study conversion processes of the squeezed gravitons into photons during inflation in the case of minimal coupling between gravitons and photons. We solve the dynamical evolution of a coupled system of gravitons and photons perturbatively and obtain squeezing parameters for the system numerically and analytically. It turns out that the gravitons are robust against the decoherence caused by the cosmological magnetic fields. We also find that the conversion rate of gravitons into photons is at a few percent at most.


title: Generalized partially bent functions, generalized perfect arrays and cocyclic Butson matrices

abstract: In a recent survey, Schmidt compiled equivalences between generalized bent functions, group invariant Butson Hadamard matrices, and abelian splitting relative difference sets. We establish a broader network of equivalences by considering Butson matrices that are cocyclic rather than strictly group invariant. This result has several applications; for example, to the construction of Boolean functions whose expansions are generalized partially bent functions, including cases where no bent function can exist.


title: Vision Transformer for NeRF-Based View Synthesis from a Single Input Image

abstract: Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce the inputs to a single unposed image. Existing approaches condition on local image features to reconstruct a 3D object, but often render blurry predictions at viewpoints that are far away from the source view. To address this issue, we propose to leverage both the global and local features to form an expressive 3D representation. The global features are learned from a vision transformer, while the local features are extracted from a 2D convolutional network. To synthesize a novel view, we train a multilayer perceptron (MLP) network conditioned on the learned 3D representation to perform volume rendering. This novel 3D representation allows the network to reconstruct unseen regions without enforcing constraints like symmetry or canonical coordinate systems. Our method can render novel views from only a single input image and generalize across multiple object categories using a single model. Quantitative and qualitative evaluations demonstrate that the proposed method achieves state-of-the-art performance and renders richer details than existing approaches.


title: How Do Multilingual Encoders Learn Cross-lingual Representation?

abstract: NLP systems typically require support for more than one language. As different languages have different amounts of supervision, cross-lingual transfer benefits languages with little to no training data by transferring from other languages. From an engineering perspective, multilingual NLP benefits development and maintenance by serving multiple languages with a single system. Both cross-lingual transfer and multilingual NLP rely on cross-lingual representations serving as the foundation. As BERT revolutionized representation learning and NLP, it also revolutionized cross-lingual representations and cross-lingual transfer. Multilingual BERT was released as a replacement for single-language BERT, trained with Wikipedia data in 104 languages. Surprisingly, without any explicit cross-lingual signal, multilingual BERT learns cross-lingual representations in addition to representations for individual languages. This thesis first shows such surprising cross-lingual effectiveness compared against prior art on various tasks. Naturally, it raises a set of questions, most notably how do these multilingual encoders learn cross-lingual representations. In exploring these questions, this thesis will analyze the behavior of multilingual models in a variety of settings on high and low resource languages. We also look at how to inject different cross-lingual signals into multilingual encoders, and the optimization behavior of cross-lingual transfer with these models. Together, they provide a better understanding of multilingual encoders on cross-lingual transfer. Our findings will lead us to suggested improvements to multilingual encoders and cross-lingual transfer.


title: PAC Reinforcement Learning for Predictive State Representations

abstract: In this paper we study online Reinforcement Learning (RL) in partially observable dynamical systems. We focus on the Predictive State Representations (PSRs) model, which is an expressive model that captures other well-known models such as Partially Observable Markov Decision Processes (POMDP). PSR represents the states using a set of predictions of future observations and is defined entirely using observable quantities. We develop a novel model-based algorithm for PSRs that can learn a near optimal policy in sample complexity scaling polynomially with respect to all the relevant parameters of the systems. Our algorithm naturally works with function approximation to extend to systems with potentially large state and observation spaces. We show that given a realizable model class, the sample complexity of learning the near optimal policy only scales polynomially with respect to the statistical complexity of the model class, without any explicit polynomial dependence on the size of the state and observation spaces. Notably, our work is the first work that shows polynomial sample complexities to compete with the globally optimal policy in PSRs. Finally, we demonstrate how our general theorem can be directly used to derive sample complexity bounds for special models including $m$-step weakly revealing and $m$-step decodable tabular POMDPs, POMDPs with low-rank latent transition, and POMDPs with linear emission and latent transition.


title: A Data-Based Perspective on Transfer Learning

abstract: It is commonly believed that in transfer learning including more pre-training data translates into better performance. However, recent evidence suggests that removing data from the source dataset can actually help too. In this work, we take a closer look at the role of the source dataset's composition in transfer learning and present a framework for probing its impact on downstream performance. Our framework gives rise to new capabilities such as pinpointing transfer learning brittleness as well as detecting pathologies such as data-leakage and the presence of misleading examples in the source dataset. In particular, we demonstrate that removing detrimental datapoints identified by our framework improves transfer learning performance from ImageNet on a variety of target tasks. Code is available at https://github.com/MadryLab/data-transfer


title: The d-separation criterion in Categorical Probability

abstract: The d-separation criterion detects the compatibility of a joint probability distribution with a directed acyclic graph through certain conditional independences. In this work, we study this problem in the context of categorical probability theory by introducing a categorical definition of causal models, a categorical notion of d-separation, and proving an abstract version of the d-separation criterion. This approach has two main benefits. First, categorical d-separation is a very intuitive criterion based on topological connectedness. Second, our results apply both to measure-theoretic probability (with standard Borel spaces) and beyond probability theory, including to deterministic and possibilistic networks. It therefore provides a clean proof of the equivalence of local and global Markov properties with causal compatibility for continuous and mixed random variables as well as deterministic and possibilistic variables.

categories: math.ST cs.LO math.CT math.PR stat.ML stat.TH


title: Origin of subgap states in normal-insulator-superconductor van der Waals heterostructures

abstract: Superconductivity in van der Waals materials, such as NbSe$_{2}$ and TaS$_{2}$, is fundamentally novel due to the effects of dimensionality, crystal symmetries, and strong spin-orbit coupling. In this work we perform tunnel spectroscopy on NbSe$_{2}$ by utilizing MoS$_{2}$ or hexagonal Boron Nitride (hBN) as a tunnel barrier. We observe subgap excitations and probe their origin by studying various heterostructure designs. We show that the edge of NbSe$_{2}$ hosts many defect states, which strongly couple to the superconductor and form Andreev bound states. Furthermore, by isolating the NbSe$_{2}$ edge we show that the subgap states are ubiquitous in MoS$_{2}$ tunnel barriers, but absent in hBN tunnel barriers, suggesting defects in MoS$_{2}$ as their origin. Their magnetic nature reveals a singlet or a doublet type ground state and based on nearly vanishing g-factors or avoided-crossing of subgap excitations we highlight the role of strong spin-orbit coupling.