title: Assessing the Effects of Hyperparameters on Knowledge Graph Embedding Quality

abstract: Embedding knowledge graphs into low-dimensional spaces is a popular method for applying approaches, such as link prediction or node classification, to these databases. This embedding process is very costly in terms of both computational time and space. Part of the reason for this is the optimisation of hyperparameters, which involves repeatedly sampling, by random, guided, or brute-force selection, from a large hyperparameter space and testing the resulting embeddings for their quality. However, not all hyperparameters in this search space will be equally important. In fact, with prior knowledge of the relative importance of the hyperparameters, some could be eliminated from the search altogether without significantly impacting the overall quality of the outputted embeddings. To this end, we ran a Sobol sensitivity analysis to evaluate the effects of tuning different hyperparameters on the variance of embedding quality. This was achieved by performing thousands of embedding trials, each time measuring the quality of embeddings produced by different hyperparameter configurations. We regressed the embedding quality on those hyperparameter configurations, using this model to generate Sobol sensitivity indices for each of the hyperparameters. By evaluating the correlation between Sobol indices, we find substantial variability in the hyperparameter sensitivities between knowledge graphs, with differing dataset characteristics being the probable cause of these inconsistencies. As an additional contribution of this work we identify several relations in the UMLS knowledge graph that may cause data leakage via inverse relations, and derive and present UMLS-43, a leakage-robust variant of that graph.


title: Weakly-supervised High-fidelity Ultrasound Video Synthesis with Feature Decoupling

abstract: Ultrasound (US) is widely used for its advantages of real-time imaging, radiation-free and portability. In clinical practice, analysis and diagnosis often rely on US sequences rather than a single image to obtain dynamic anatomical information. This is challenging for novices to learn because practicing with adequate videos from patients is clinically unpractical. In this paper, we propose a novel framework to synthesize high-fidelity US videos. Specifically, the synthesis videos are generated by animating source content images based on the motion of given driving videos. Our highlights are three-fold. First, leveraging the advantages of self- and fully-supervised learning, our proposed system is trained in weakly-supervised manner for keypoint detection. These keypoints then provide vital information for handling complex high dynamic motions in US videos. Second, we decouple content and texture learning using the dual decoders to effectively reduce the model learning difficulty. Last, we adopt the adversarial training strategy with GAN losses for further improving the sharpness of the generated videos, narrowing the gap between real and synthesis videos. We validate our method on a large in-house pelvic dataset with high dynamic motion. Extensive evaluation metrics and user study prove the effectiveness of our proposed method.


title: Agent with Tangent-based Formulation and Anatomical Perception for Standard Plane Localization in 3D Ultrasound

abstract: Standard plane (SP) localization is essential in routine clinical ultrasound (US) diagnosis. Compared to 2D US, 3D US can acquire multiple view planes in one scan and provide complete anatomy with the addition of coronal plane. However, manually navigating SPs in 3D US is laborious and biased due to the orientation variability and huge search space. In this study, we introduce a novel reinforcement learning (RL) framework for automatic SP localization in 3D US. Our contribution is three-fold. First, we formulate SP localization in 3D US as a tangent-point-based problem in RL to restructure the action space and significantly reduce the search space. Second, we design an auxiliary task learning strategy to enhance the model's ability to recognize subtle differences crossing Non-SPs and SPs in plane search. Finally, we propose a spatial-anatomical reward to effectively guide learning trajectories by exploiting spatial and anatomical information simultaneously. We explore the efficacy of our approach on localizing four SPs on uterus and fetal brain datasets. The experiments indicate that our approach achieves a high localization accuracy as well as robust performance.


title: Online Reflective Learning for Robust Medical Image Segmentation

abstract: Deep segmentation models often face the failure risks when the testing image presents unseen distributions. Improving model robustness against these risks is crucial for the large-scale clinical application of deep models. In this study, inspired by human learning cycle, we propose a novel online reflective learning framework (RefSeg) to improve segmentation robustness. Based on the reflection-on-action conception, our RefSeg firstly drives the deep model to take action to obtain semantic segmentation. Then, RefSeg triggers the model to reflect itself. Because making deep models realize their segmentation failures during testing is challenging, RefSeg synthesizes a realistic proxy image from the semantic mask to help deep models build intuitive and effective reflections. This proxy translates and emphasizes the segmentation flaws. By maximizing the structural similarity between the raw input and the proxy, the reflection-on-action loop is closed with segmentation robustness improved. RefSeg runs in the testing phase and is general for segmentation models. Extensive validation on three medical image segmentation tasks with a public cardiac MR dataset and two in-house large ultrasound datasets show that our RefSeg remarkably improves model robustness and reports state-of-the-art performance over strong competitors.


title: Vision-based Conflict Detection within Crowds based on High-Resolution Human Pose Estimation for Smart and Safe Airport

abstract: Future airports are becoming more complex and congested with the increasing number of travellers. While the airports are more likely to become hotspots for potential conflicts to break out which can cause serious delays to flights and several safety issues. An intelligent algorithm which renders security surveillance more effective in detecting conflicts would bring many benefits to the passengers in terms of their safety, finance, and travelling efficiency. This paper details the development of a machine learning model to classify conflicting behaviour in a crowd. HRNet is used to segment the images and then two approaches are taken to classify the poses of people in the frame via multiple classifiers. Among them, it was found that the support vector machine (SVM) achieved the most performant achieving precision of 94.37%. Where the model falls short is against ambiguous behaviour such as a hug or losing track of a subject in the frame. The resulting model has potential for deployment within an airport if improvements are made to cope with the vast number of potential passengers in view as well as training against further ambiguous behaviours which will arise in an airport setting. In turn, will provide the capability to enhance security surveillance and improve airport safety.


title: The Higgs boson Turns Ten

abstract: The discovery of the Higgs boson, ten years ago, was a milestone that opened the door to the study of a new sector of fundamental physical interactions. We review the role of the Higgs field in the Standard Model of particle physics and explain its impact on the world around us. We summarize the insights into Higgs physics revealed so far by ten years of work, discuss what remains to be determined, and outline potential connections of the Higgs sector with unsolved mysteries of particle physics.


title: Asynchronous Decentralized Bayesian Optimization for Large Scale Hyperparameter Optimization

abstract: Bayesian optimization (BO) is a promising approach for hyperparameter optimization of deep neural networks (DNNs), where each model training can take minutes to hours. In BO, a computationally cheap surrogate model is employed to learn the relationship between parameter configurations and their performance such as accuracy. Parallel BO methods often adopt single manager/multiple workers strategies to evaluate multiple hyperparameter configurations simultaneously. Despite significant hyperparameter evaluation time, the overhead in such centralized schemes prevents these methods to scale on a large number of workers. We present an asynchronous-decentralized BO, wherein each worker runs a sequential BO and asynchronously communicates its results through shared storage. We scale our method without loss of computational efficiency with above 95% of worker's utilization to 1,920 parallel workers (full production queue of the Polaris supercomputer) and demonstrate improvement in model accuracy as well as faster convergence on the CANDLE benchmark from the Exascale computing project.


title: On the global generation of higher direct images of pluricanonical bundles

abstract: Given a fibration $f$ between two projective manifolds $X$ and $Y$, we discuss the effective generation of the higher direct images $R^{i}f_{\ast}(K^{m}_{X})$, where $K^{m}_{X}$ is the $m$-th tensor power of the canonical bundle of $X$. In particular, we answer two questions posed by Popa--Schnell in [PS14].


title: Tension-clock control of human mitotic chromosome oscillations

abstract: During cell division paired (sister) chromosomes are observed to perform approximate saw-tooth oscillations across the cell mid-plane. Experimental data suggests that these oscillations are regulated through intersister tension. We propose a time dependent tension threshold model that exhibits three stable periodic solutions and the phase diagram can be generated semi-analytically. Incorporation of diffusive noise reproduces realistic oscillations, with realistic periods, amplitudes and reproducing the observation that either sister of the pair can switch direction first.


title: The Cheeger problem in abstract measure spaces

abstract: We consider non-negative $\sigma$-finite measure spaces coupled with a proper functional $P$ that plays the role of a perimeter. We introduce the Cheeger problem in this framework and extend many classical results on the Cheeger constant and on Cheeger sets to this setting, requiring minimal assumptions on the pair measure space-perimeter. Throughout the paper, the measure space will never be asked to be metric, at most topological, and this requires the introduction of a suitable notion of Sobolev spaces, induced by the coarea formula with the given perimeter.


title: Contribution of Collective Excitations to Third Harmonic Generation in Multiband Superconductors: the case of MgB$_2$

abstract: Multiband superconductors can host collective excitations with marked differences with respect to their single-band counterpart. We first study the spectrum of collective amplitude fluctuations in a clean two-bands superconductor, showing that the spectral weight of the Higgs mode rapidly deviates from the naive extension of the single band case as the interband coupling is turned on. These results are then used to critically analyze the non-linear optical response in MgB$_2$, providing an explanation for the apparently contradictory results of recent experiments, pointing towards a selective relevance either of the Leggett mode or of the amplitude fluctuations at twice the lower gap. By using exact numerical simulations and realistic estimate of disorder we compute the relative contribution of the quasiparticle, amplitude and phase fluctuations to the non-linear optical response. We show that at low pumping frequency only the resonance at twice the smaller gap emerges, as due to the BCS response, while the Leggett mode dominates only in a narrow range of higher pumping frequencies matching its low-temperature value. Our findings provide a fresh perspective on the potential of non-linear THz spectroscopy to detect collective modes in other multiband systems, as e.g. iron-based superconductors.


title: Multi-task Driver Steering Behaviour Modeling Using Time-Series Transformer

abstract: Human intention prediction provides an augmented solution for the design of assistants and collaboration between the human driver and intelligent vehicles. In this study, a multi-task sequential learning framework is developed to predict future steering torques and steering postures based on the upper limb neuromuscular Electromyography (EMG) signals. A single-right-hand driving mode is particularly studied. For this driving mode, three different driving postures are also evaluated. Then, a multi-task time-series transformer network (MTS-Trans) is developed to predict the steering torques and driving postures. To evaluate the multi-task learning performance, four different frameworks are assessed. Twenty-one participants are involved in the driving simulator-based experiment. The proposed model achieved accurate prediction results on the future steering torque prediction and driving postures recognition for single-hand driving modes. The proposed system can contribute to the development of advanced driver steering assistant systems and ensure mutual understanding between human drivers and intelligent vehicles.


title: Singular Levy processes and dispersive effects of generalized Schr\"odinger equations

abstract: We introduce new models for Schr\"odinger-type equations, which generalize standard NLS and for which different dispersion occurs depending on the directions. Our purpose is to understand dispersive properties depending on the directions of propagation, in the spirit of waveguide manifolds, but where the diffusion is of different types. We mainly consider the standard Euclidean space and the waveguide case but our arguments extend easily to other types of manifolds (like product spaces). Our approach unifies in a natural way several previous results. Those models are also generalizations of some appearing in seminal works in mathematical physics, such as relativistic strings. In particular, we prove the large data scattering on waveguide manifolds $\mathbb{R}^d \times \mathbb{T}$, $d \geq 3$. This result can be regarded as the analogue of \cite{TV2, YYZ2} in our setting and the waveguide analogue investigated in \cite{GSWZ}. A key ingredient of the proof is a Morawetz-type estimate for the setting of this model.


title: Scalable MCMC Sampling for Nonsymmetric Determinantal Point Processes

abstract: A determinantal point process (DPP) is an elegant model that assigns a probability to every subset of a collection of $n$ items. While conventionally a DPP is parameterized by a symmetric kernel matrix, removing this symmetry constraint, resulting in nonsymmetric DPPs (NDPPs), leads to significant improvements in modeling power and predictive performance. Recent work has studied an approximate Markov chain Monte Carlo (MCMC) sampling algorithm for NDPPs restricted to size-$k$ subsets (called $k$-NDPPs). However, the runtime of this approach is quadratic in $n$, making it infeasible for large-scale settings. In this work, we develop a scalable MCMC sampling algorithm for $k$-NDPPs with low-rank kernels, thus enabling runtime that is sublinear in $n$. Our method is based on a state-of-the-art NDPP rejection sampling algorithm, which we enhance with a novel approach for efficiently constructing the proposal distribution. Furthermore, we extend our scalable $k$-NDPP sampling algorithm to NDPPs without size constraints. Our resulting sampling method has polynomial time complexity in the rank of the kernel, while the existing approach has runtime that is exponential in the rank. With both a theoretical analysis and experiments on real-world datasets, we verify that our scalable approximate sampling algorithms are orders of magnitude faster than existing sampling approaches for $k$-NDPPs and NDPPs.


title: Top-philic Dark Matter in a Hybrid KSVZ axion framework

abstract: We explore a two-component dark matter scenario in an extended Kim-Shifman-Vainshtein-Zakharov (KSVZ) axion framework. This hybrid setup incorporates an extra $SU(2)_L$ complex singlet scalar whose lightest component plays the role of one of the dark matter, while the QCD axion of the KSVZ model acts as a second dark matter candidate. In this work, we focus on accentuating the role of vector-like quark that naturally emerges in the KSVZ extension on the dark matter and collider phenomenology. Here, we demonstrate that the presence of this colored particle can significantly affect the allowed dark matter parameter space of the scalar dark matter by opening up additional co-annihilation as well as the direct detection channels. Moreover, the interaction between the color particle with the top quark and scalar dark matter provides a unique topology to generate a boosted-top pair with considerable missing transverse momentum at the LHC. Using jet substructure variables and multivariate analysis, here we show that one can already exclude a vast region of parameter space with 139 $\text{fb}^{-1}$ integrated luminosity at 14 TeV LHC.


title: Stabilization results of a Lorenz piezoelectric beam with partial viscous dampings

abstract: In this paper, we investigate the stabilization of a one-dimensional Lorenz piezoelectric (Stretching system) with partial viscous dampings. First, by using Lorenz gauge conditions, we reformulate our system to achieve the existence and uniqueness of the solution. Next, by using General criteria of Arendt-Batty, we prove the strong stability in different cases. Finally, we prove that it is sufficient to control the stretching of the center-line of the beam in x-direction to achieve the exponential stability. Numerical results are also presented to validate our theoretical result.


title: Panning for gold: Lessons learned from the platform-agnostic automated detection of political content in textual data

abstract: The growing availability of data about online information behaviour enables new possibilities for political communication research. However, the volume and variety of these data makes them difficult to analyse and prompts the need for developing automated content approaches relying on a broad range of natural language processing techniques (e.g. machine learning- or neural network-based ones). In this paper, we discuss how these techniques can be used to detect political content across different platforms. Using three validation datasets, which include a variety of political and non-political textual documents from online platforms, we systematically compare the performance of three groups of detection techniques relying on dictionaries, supervised machine learning, or neural networks. We also examine the impact of different modes of data preprocessing (e.g. stemming and stopword removal) on the low-cost implementations of these techniques using a large set (n = 66) of detection models. Our results show the limited impact of preprocessing on model performance, with the best results for less noisy data being achieved by neural network- and machine-learning-based models, in contrast to the more robust performance of dictionary-based models on noisy data.


title: A complete POVM description of multi-channel quantum electro-optic sampling with monochromatic field modes

abstract: We propose a multi-channel version of quantum electro-optic sampling involving monochromatic field modes. It allows for multiple simultaneous measurements of arbitrarily many $\hat{X}$ and $\hat{Y}$ field-quadrature for a single quantum-state copy, while independently tuning the interaction strengths at each channel. In contrast to standard electro-optic sampling, the sampled mid-infrared (MIR) mode undergoes a nonlinear interaction with multiple near-infrared (NIR) pump beams. We present a complete positive operator-valued measure (POVM) description for quantum states in the MIR mode. The probability distribution of the electro-optic signal outcomes is shown to be related to an $s$-parametrized phase-space quasiprobability distribution of the indirectly measured MIR state, with the parameter $s$ depending solely on the quantities characterizing the nonlinear interaction. Furthermore, we show that the quasiprobability distributions for the sampled and post-measurement states are related to each other through a renormalization and a change in the parametrization. This result is then used to demonstrate that two consecutive measurements of both $\hat{X}$ and $\hat{Y}$ quadratures can outperform eight-port homodyne detection.


title: Thirty milliseconds in the life of a supercooled liquid

abstract: We combine the swap Monte Carlo algorithm to long multi-CPU molecular dynamics simulations to analyse the equilibrium relaxation dynamics of model supercooled liquids over a time window covering ten orders of magnitude for temperatures down to the experimental glass transition temperature $T_g$. The analysis of \rev{several} time correlation functions coupled to spatio-temporal resolution of particle motion allow us to elucidate the nature of the equilibrium dynamics in deeply supercooled liquids. We find that structural relaxation starts at early times in rare localised regions characterised by a waiting time distribution that develops a power law near $T_g$. At longer times, relaxation events accumulate with increasing probability in these regions as $T_g$ is approached. This accumulation leads to a power-law growth of the linear extension of relaxed domains with time with a large, temperature-dependent dynamic exponent. Past the average relaxation time, unrelaxed domains slowly shrink with time due to relaxation events happening at their boundaries. Our results provide a complete microscopic description of the particle motion responsible for key experimental signatures of glassy dynamics, from the shape and temperature evolution of relaxation spectra to the core features of dynamic heterogeneity. They also provide a microscopic basis to understand the emergence of dynamic facilitation in deeply supercooled liquids and allow us to critically reassess theoretical descriptions of the glass transition.

categories: cond-mat.soft cond-mat.dis-nn cond-mat.mtrl-sci cond-mat.stat-mech


title: Reinforcement Learning Based User-Guided Motion Planning for Human-Robot Collaboration

abstract: Robots are good at performing repetitive tasks in modern manufacturing industries. However, robot motions are mostly planned and preprogrammed with a notable lack of adaptivity to task changes. Even for slightly changed tasks, the whole system must be reprogrammed by robotics experts. Therefore, it is highly desirable to have a flexible motion planning method, with which robots can adapt to specific task changes in unstructured environments, such as production systems or warehouses, with little or no intervention from non-expert personnel. In this paper, we propose a user-guided motion planning algorithm in combination with the reinforcement learning (RL) method to enable robots automatically generate their motion plans for new tasks by learning from a few kinesthetic human demonstrations. To achieve adaptive motion plans for a specific application environment, e.g., desk assembly or warehouse loading/unloading, a library is built by abstracting features of common human demonstrated tasks. The definition of semantical similarity between features in the library and features of a new task is proposed and further used to construct the reward function in RL. The RL policy can automatically generate motion plans for a new task if it determines that new task constraints can be satisfied with the current library and request additional human demonstrations. Multiple experiments conducted on common tasks and scenarios demonstrate that the proposed user-guided RL-assisted motion planning method is effective.


title: Simulating financial time series using attention

abstract: Financial time series simulation is a central topic since it extends the limited real data for training and evaluation of trading strategies. It is also challenging because of the complex statistical properties of the real financial data. We introduce two generative adversarial networks (GANs), which utilize the convolutional networks with attention and the transformers, for financial time series simulation. The GANs learn the statistical properties in a data-driven manner and the attention mechanism helps to replicate the long-range dependencies. The proposed GANs are tested on the S&P 500 index and option data, examined by scores based on the stylized facts and are compared with the pure convolutional GAN, i.e. QuantGAN. The attention-based GANs not only reproduce the stylized facts, but also smooth the autocorrelation of returns.


title: Learning Job Titles Similarity from Noisy Skill Labels

abstract: Measuring semantic similarity between job titles is an essential functionality for automatic job recommendations. This task is usually approached using supervised learning techniques, which requires training data in the form of equivalent job title pairs. In this paper, we instead propose an unsupervised representation learning method for training a job title similarity model using noisy skill labels. We show that it is highly effective for tasks such as text ranking and job normalization.


title: A self-contained karma economy for the dynamic allocation of common resources

abstract: This paper presents karma mechanisms, a novel approach to the repeated allocation of a scarce resource among competing agents over an infinite time. Examples include deciding which ride hailing trip requests to serve during peak demand, granting the right of way in intersections or lane mergers, or admitting internet content to a regulated fast channel. We study a simplified yet insightful formulation of these problems where at every instant two agents from a large population get randomly matched to compete over the resource. The intuitive interpretation of a karma mechanism is "If I give in now, I will be rewarded in the future." Agents compete in an auction-like setting where they bid units of karma, which circulates directly among them and is self-contained in the system. We demonstrate that this allows a society of self-interested agents to achieve high levels of efficiency without resorting to a (possibly problematic) monetary pricing of the resource. We model karma mechanisms as dynamic population games and guarantee the existence of a stationary Nash equilibrium. We then analyze the performance at the stationary Nash equilibrium numerically. For the case of homogeneous agents, we compare different mechanism design choices, showing that it is possible to achieve an efficient and ex-post fair allocation when the agents are future aware. Finally, we test the robustness against agent heterogeneity and propose remedies to some of the observed phenomena via karma redistribution.


title: Personalized Diagnostic Tool for Thyroid Cancer Classification using Multi-view Ultrasound

abstract: Over the past decades, the incidence of thyroid cancer has been increasing globally. Accurate and early diagnosis allows timely treatment and helps to avoid over-diagnosis. Clinically, a nodule is commonly evaluated from both transverse and longitudinal views using thyroid ultrasound. However, the appearance of the thyroid gland and lesions can vary dramatically across individuals. Identifying key diagnostic information from both views requires specialized expertise. Furthermore, finding an optimal way to integrate multi-view information also relies on the experience of clinicians and adds further difficulty to accurate diagnosis. To address these, we propose a personalized diagnostic tool that can customize its decision-making process for different patients. It consists of a multi-view classification module for feature extraction and a personalized weighting allocation network that generates optimal weighting for different views. It is also equipped with a self-supervised view-aware contrastive loss to further improve the model robustness towards different patient groups. Experimental results show that the proposed framework can better utilize multi-view information and outperform the competing methods.


title: Training Novices: The Role of Human-AI Collaboration and Knowledge Transfer

abstract: Across a multitude of work environments, expert knowledge is imperative for humans to conduct tasks with high performance and ensure business success. These humans possess task-specific expert knowledge (TSEK) and hence, represent subject matter experts (SMEs). However, not only demographic changes but also personnel downsizing strategies lead and will continue to lead to departures of SMEs within organizations, which constitutes the challenge of how to retain that expert knowledge and train novices to keep the competitive advantage elicited by that expert knowledge. SMEs training novices is time- and cost-intensive, which intensifies the need for alternatives. Human-AI collaboration (HAIC) poses a way out of this dilemma, facilitating alternatives to preserve expert knowledge and teach it to novices for tasks conducted by SMEs beforehand. In this workshop paper, we (1) propose a framework on how HAIC can be utilized to train novices on particular tasks, (2) illustrate the role of explicit and tacit knowledge in this training process via HAIC, and (3) outline a preliminary experiment design to assess the ability of AI systems in HAIC to act as a trainer to transfer TSEK to novices who do not possess prior TSEK.


title: Energy estimates for seminodal solutions to an elliptic system with mixed couplings

abstract: We study the system of semilinear elliptic equations $$-\Delta u_i+ u_i = \sum_{j=1}^\ell \beta_{ij}|u_j|^p|u_i|^{p-2}u_i, \qquad u_i\in H^1(\mathbb{R}^N),\qquad i=1,\ldots,\ell,$$ where $N\geq 4$, $1<p<\frac{N}{N-2}$, and the matrix $(\beta_{ij})$ is symmetric and admits a block decomposition such that the entries within each block are positive or zero and all other entries are negative. We provide simple conditions on $(\beta_{ij})$, which guarantee the existence of fully nontrivial solutions, i.e., solutions all of whose components are nontrivial. We establish existence of fully nontrivial solutions to the system having a prescribed combination of positive and nonradial sign-changing components, and we give an upper bound for their energy when the system has at most two blocks. We derive the existence of solutions with positive and nonradial sign-changing components to the system of singularly perturbed elliptic equations $$-\varepsilon^2\Delta u_i+ u_i = \sum_{j=1}^\ell \beta_{ij}|u_j|^p|u_i|^{p-2}u_i, \qquad u_i\in H^1_0(B_1(0)),\qquad i=1,\ldots,\ell,$$ in the unit ball, exhibiting two different kinds of asymptotic behavior: solutions whose components decouple as $\varepsilon\to 0$, and solutions whose components remain coupled all the way up to their limit.


title: MotionMixer: MLP-based 3D Human Body Pose Forecasting

abstract: In this work, we present MotionMixer, an efficient 3D human body pose forecasting model based solely on multi-layer perceptrons (MLPs). MotionMixer learns the spatial-temporal 3D body pose dependencies by sequentially mixing both modalities. Given a stacked sequence of 3D body poses, a spatial-MLP extracts fine grained spatial dependencies of the body joints. The interaction of the body joints over time is then modelled by a temporal MLP. The spatial-temporal mixed features are finally aggregated and decoded to obtain the future motion. To calibrate the influence of each time step in the pose sequence, we make use of squeeze-and-excitation (SE) blocks. We evaluate our approach on Human3.6M, AMASS, and 3DPW datasets using the standard evaluation protocols. For all evaluations, we demonstrate state-of-the-art performance, while having a model with a smaller number of parameters. Our code is available at: https://github.com/MotionMLP/MotionMixer


title: Automatic Integration of BFT State-Machine Replication into IoT Systems

abstract: Byzantine fault tolerance (BFT) can preserve the availability and integrity of IoT systems where single components may suffer from random data corruption or attacks that can expose them to malicious behavior. While state-of-the-art BFT state-machine replication (SMR) libraries are often tailored to fit a standard request-response interaction model with dedicated client-server roles, in our design, we employ an IoT-fit interaction model that assumes a loosly-coupled, event-driven interaction between arbitrarily wired IoT components. In this paper, we explore the possibility of automating and streamlining the complete process of integrating BFT SMR into a component-based IoT execution environment. Our main goal is providing simplicity for the developer: We strive to decouple the specification of a logical application architecture from the difficulty of incorporating BFT replication mechanisms into it. Thus, our contributions address the automated configuration, re-wiring and deployment of IoT components, and their replicas, within a component-based, event-driven IoT platform.


title: Unsupervised Cross-Domain Feature Extraction for Single Blood Cell Image Classification

abstract: Diagnosing hematological malignancies requires identification and classification of white blood cells in peripheral blood smears. Domain shifts caused by different lab procedures, staining, illumination, and microscope settings hamper the re-usability of recently developed machine learning methods on data collected from different sites. Here, we propose a cross-domain adapted autoencoder to extract features in an unsupervised manner on three different datasets of single white blood cells scanned from peripheral blood smears. The autoencoder is based on an R-CNN architecture allowing it to focus on the relevant white blood cell and eliminate artifacts in the image. To evaluate the quality of the extracted features we use a simple random forest to classify single cells. We show that thanks to the rich features extracted by the autoencoder trained on only one of the datasets, the random forest classifier performs satisfactorily on the unseen datasets, and outperforms published oracle networks in the cross-domain task. Our results suggest the possibility of employing this unsupervised approach in more complicated diagnosis and prognosis tasks without the need to add expensive expert labels to unseen data.


title: Interpretation of quantum theory: the quantum "grue-bleen" problem

abstract: We present a critique of the many-world interpretation of quantum mechanics, based on different ``pictures'' that describe the time evolution of an isolated quantum system. Without an externally imposed frame to restrict these possible pictures, the theory cannot yield non-trivial interpretational statements. This is analogous to Goodman's famous ``grue-bleen'' problem of language and induction. Using a general framework applicable to many kinds of dynamical theories, we try to identify the kind of additional structure (if any) required for the meaningful interpretation of a theory. We find that the ``grue-bleen'' problem is not restricted to quantum mechanics, but also affects other theories including classical Hamiltonian mechanics. For all such theories, absent external frame information, an isolated system has no interpretation.


title: Using the polarization properties of double radio relics to probe the turbulent compression scenario

abstract: Radio relics are Mpc-size synchrotron sources located in the outskirts of some merging galaxy clusters. Binary-merging systems with favorable orientation may host two almost symmetric relics, named double radio relics. Double radio relics are seen preferentially edge-on and, thus, constitute a privileged sample for statistical studies. Their polarization and Faraday rotation properties give direct access to the relics origin and magnetic fields. In this paper, we present a polarization and Rotation Measure (RM) synthesis study of four clusters hosting double radio relics, namely 8C 0212+703, Abell 3365, PLCK G287.0+32.9, previously missing polarization studies, and ZwCl 2341+0000, for which conflicting results have been reported. We used 1-2 GHz Karl G. Jansky Very Large Array observations. We also provide an updated compilation of known double radio relics with important observed quantities. We studied their polarization and Faraday rotation properties at 1.4 GHz and we searched for correlations between fractional polarization and physical resolution, distance from the cluster center, and shock Mach number. The weak correlations found between these quantities are well reproduced by state-of-the-art magneto-hydrodynamical simulations of radio relics, confirming that merger shock waves propagate in a turbulent medium with tangled magnetic fields. Both external and internal Faraday depolarization should play a fundamental role in determining the polarization properties of radio relics at 1.4 GHz. Although the number of double radio relics with RM information is still low, their Faraday rotation properties (i.e., rest-frame RM and RM dispersion below 40 rad m$^{-2}$ and non-Gaussian RM distribution) can be explained in the scenario in which shock waves with Mach numbers larger than 2.5 propagate along the plane of the sky and compress the turbulent intra-cluster medium.


title: The closest vector problem and the zero-temperature p-spin landscape for lossy compression

abstract: We consider a high-dimensional random constrained optimization problem in which a set of binary variables is subjected to a linear system of equations. The cost function is a simple linear cost, measuring the Hamming distance with respect to a reference configuration. Despite its apparent simplicity, this problem exhibits a rich phenomenology. We show that different situations arise depending on the random ensemble of linear systems. When each variable is involved in at most two linear constraints, we show that the problem can be partially solved analytically, in particular we show that upon convergence, the zero-temperature limit of the cavity equations returns the optimal solution. We then study the geometrical properties of more general random ensembles. In particular we observe a range in the density of constraints at which the systems enters a glassy phase where the cost function has many minima. Interestingly, the algorithmic performances are only sensitive to another phase transition affecting the structure of configurations allowed by the linear constraints. We also extend our results to variables belonging to $\text{GF}(q)$, the Galois Field of order $q$. We show that increasing the value of $q$ allows to achieve a better optimum, which is confirmed by the Replica Symmetric cavity method predictions.

categories: cond-mat.dis-nn cond-mat.stat-mech cs.IT math.IT


title: New, late-type spectroscopic binaries with X-ray emission

abstract: In this paper we present a spectroscopic study of six double-lined binaries, five of which were recently discovered in a high-resolution spectroscopic survey of optical counterparts of stellar X-ray sources. Thanks to high-resolution spectra acquired with CAOS spectropolarimeter during seven years, we were able to measure the radial velocities of their components and determine their orbital elements. We have applied our code COMPO2 to determine the spectral types and atmospheric parameters of the components of these spectroscopic binaries and found that two of these systems are composed of main sequence stars, while the other four contain at least one evolved (giant or subgiant) component, similar to other well-known RS CVn systems. The subtraction of a photospheric template built up with spectra of non-active stars of the same spectral type as those of the components of each system has allowed us to investigate the chromospheric emission that fills in the H$\alpha$ cores. We found that the colder component is normally the one with the largest H$\alpha$ emission. None of the systems show a detectable LiI$\lambda$6708 line, with the exception of TYC 4279-1821-1, which exhibits high photospheric abundances in both components. Photometric time series from the literature allowed us to assess that the five systems with a nearly circular orbit have also photometric periods close or equal to the orbital ones, indicating spin-orbit synchronization. For the system with a highly eccentric orbit, a possible pseudo-synchronization with the periastron velocity is suggested.


title: How Far Can I Go ? : A Self-Supervised Approach for Deterministic Video Depth Forecasting

abstract: In this paper we present a novel self-supervised method to anticipate the depth estimate for a future, unobserved real-world urban scene. This work is the first to explore self-supervised learning for estimation of monocular depth of future unobserved frames of a video. Existing works rely on a large number of annotated samples to generate the probabilistic prediction of depth for unseen frames. However, this makes it unrealistic due to its requirement for large amount of annotated depth samples of video. In addition, the probabilistic nature of the case, where one past can have multiple future outcomes often leads to incorrect depth estimates. Unlike previous methods, we model the depth estimation of the unobserved frame as a view-synthesis problem, which treats the depth estimate of the unseen video frame as an auxiliary task while synthesizing back the views using learned pose. This approach is not only cost effective - we do not use any ground truth depth for training (hence practical) but also deterministic (a sequence of past frames map to an immediate future). To address this task we first develop a novel depth forecasting network DeFNet which estimates depth of unobserved future by forecasting latent features. Second, we develop a channel-attention based pose estimation network that estimates the pose of the unobserved frame. Using this learned pose, estimated depth map is reconstructed back into the image domain, thus forming a self-supervised solution. Our proposed approach shows significant improvements in Abs Rel metric compared to state-of-the-art alternatives on both short and mid-term forecasting setting, benchmarked on KITTI and Cityscapes. Code is available at https://github.com/sauradip/depthForecasting


title: Towards an Architecture-centric Methodology for Migrating to Microservices

abstract: The euphoria around microservices has decreased over the years, but the trend of modernizing legacy systems to this novel architectural style is unbroken to date. A variety of approaches have been proposed in academia and industry, aiming to structure and automate the often long-lasting and cost-intensive migration journey. However, our research shows that there is still a need for more systematic guidance. While grey literature is dominant for knowledge exchange among practitioners, academia has contributed a significant body of knowledge as well, catching up on its initial neglect. A vast number of studies on the topic yielded novel techniques, often backed by industry evaluations. However, practitioners hardly leverage these resources. In this paper, we report on our efforts to design an architecture-centric methodology for migrating to microservices. As its main contribution, a framework provides guidance for architects during the three phases of a migration. We refer to methods, techniques, and approaches based on a variety of scientific studies that have not been made available in a similarly comprehensible manner before. Through an accompanying tool to be developed, architects will be in a position to systematically plan their migration, make better informed decisions, and use the most appropriate techniques and tools to transition their systems to microservices.


title: Combining Localized Orbital Scaling Correction and Bethe-Salpeter Equation for Accurate Excitation Energies

abstract: We applied localized orbital scaling correction (LOSC) in Bethe-Salpeter equation (BSE) to predict accurate excitation energies for molecules. LOSC systematically eliminates the delocalization error in the density functional approximation and is capable of approximating quasiparticle (QP) energies with accuracy similar or better than the $GW$ Green's function approach and with much less computational cost. The QP energies from LOSC instead of commonly used $G_{0}W_{0}$ and ev$GW$ are directly used in BSE. We show that the BSE/LOSC approach greatly outperforms the commonly used BSE/$G_{0}W_{0}$ approach for predicting excitations with different characters. For the calculations for Truhlar-Gagliardi test set containing valence, charge transfer (CT) and Rydberg excitations, BSE/LOSC with the Tamm-Dancoff approximation provides a comparable accuracy to time-dependent density functional theory (TDDFT) and BSE/ev$GW$. For the calculations of Stein CT test set and Rydberg excitations of atoms, BSE/LOSC considerably outperforms both BSE/$G_{0}W_{0}$ and TDDFT approaches with a reduced starting point dependence. BSE/LOSC is thus a promising and efficient approach to calculate excitation energies for molecular systems.


title: Search for a dark photon and an invisible dark Higgs boson in $\mu^+\mu^-$ and missing energy final states with the Belle II experiment

abstract: The dark photon $A^\prime$ and the dark Higgs boson $h^\prime$ are hypothetical particles predicted in many dark sector models. We search for the simultaneous production of $A^\prime$ and $h^\prime$ in the dark Higgsstrahlung process $e^{+}e^{-}\rightarrow A^\prime \, h^\prime$ with $A^\prime \rightarrow \mu^+\mu^-$ and $ h^\prime$ invisible in electron-positron collisions at a center-of-mass energy of 10.58 GeV collected by the Belle II experiment in 2019. With an integrated luminosity of 8.34 fb$^{-1}$, we observe no evidence for signal. We obtain exclusion limits at 90% Bayesian credibility in the range of 1.7--5.0 fb on the cross section and in the range of $1.7 \times10^{-8}$--$200 \times10^{-8}$ on the effective coupling $\varepsilon^2 \times \alpha_D$ for the $A^\prime$ mass in the range of 4.0 GeV/$c^2$ $< M_{A^\prime}< 9.7$ GeV/$c^2$ and for the $h^\prime$ mass $M_{h^\prime} < M_{A^\prime}$, where $\varepsilon$ is the mixing strength between the standard model and the dark photon and $\alpha_D$ is the coupling of the dark photon to the dark Higgs boson. Our limits are the first in this mass range.


title: Enhancing cluster analysis via topological manifold learning

abstract: We discuss topological aspects of cluster analysis and show that inferring the topological structure of a dataset before clustering it can considerably enhance cluster detection: theoretical arguments and empirical evidence show that clustering embedding vectors, representing the structure of a data manifold instead of the observed feature vectors themselves, is highly beneficial. To demonstrate, we combine manifold learning method UMAP for inferring the topological structure with density-based clustering method DBSCAN. Synthetic and real data results show that this both simplifies and improves clustering in a diverse set of low- and high-dimensional problems including clusters of varying density and/or entangled shapes. Our approach simplifies clustering because topological pre-processing consistently reduces parameter sensitivity of DBSCAN. Clustering the resulting embeddings with DBSCAN can then even outperform complex methods such as SPECTACL and ClusterGAN. Finally, our investigation suggests that the crucial issue in clustering does not appear to be the nominal dimension of the data or how many irrelevant features it contains, but rather how \textit{separable} the clusters are in the ambient observation space they are embedded in, which is usually the (high-dimensional) Euclidean space defined by the features of the data. Our approach is successful because we perform the cluster analysis after projecting the data into a more suitable space that is optimized for separability, in some sense.


title: Production of $P_c$ states in $\Lambda_b$ decays

abstract: We develop a model for the production of the Pc states observed at LHCb in Lambdab - Jpsi p K- decays. With fewer parameters than other approaches, we obtain excellent fits to the Jpsi-p invariant mass spectrum, capturing both the prominent peaks, and broader features over the full range of invariant mass. A distinguishing feature of our model is that whereas Pc(4312), Pc(4380), and Pc(4440) are resonances with Sigmac*-D* constituents, the nature of Pc(4457) is quite different, and can be understood either as a Sigmac-D* threshold cusp, a Lambdac(2595)-D enhancement due to the triangle singularity, or a Lambdac(2595)-D resonance. We propose experimental measurements that can discriminate among these possibilities. Unlike in other models, our production mechanism respects isospin symmetry and the empirical dominance of colour-enhanced processes in weak decays, and additionally gives a natural explanation for the overall shape of the data. Our model is consistent with experimental constraints from photoproduction and Lambdab - Lambdac-D(*)0 K- decays and it does not imply the existence of partner states whose apparent absence in experiments is unexplained in other models.


title: X-Ray Optics for Astrophysics: a historical review

abstract: Grazing-incidence X-ray optics have revolutionized X-ray astrophysics. The ability to concentrate flux to a tiny detection region provides a dramatic reduction in background and a consequent very large improvement in sensitivity. The X-ray optics also permit use of small-format, high-performance focal plane detectors and, of course, especially for high-angular-resolution optics, provide a wealth of imaging data from extended sources. This review, follows the use of X-ray optics from the first rocket-borne instruments in the 1960s through to the Observatories flying today and being developed for future use. It also includes a brief overview of the challenges of fabricating X-ray optics and the various technologies that have been used to date


title: Quantum droplets in three-dimensional Bose-Einstein condensates

abstract: The properties of 3D Bose-Einstein condensate have been studied with variational and numerical methods. In the variational approach, we use the super-Gaussian trial function, and it is demonstrated that this trial function gives a good approach for the descriptions of the quantum droplets. The analytical equations for the variational parameters are obtained. The frequency of small oscillations of quantum droplets near the equilibrium position is estimated. It is also found that periodic modulation of the coupling constants leads to the resonance oscillations of the quantum droplets parameters or emission of waves depending on the amplitude of the modulations. The predictions are supported by direct numerical simulation of governing equation.


title: A single-tree algorithm to compute the Euclidean minimum spanning tree on GPUs

abstract: Computing the Euclidean minimum spanning tree (EMST) is a computationally demanding step of many algorithms. While work-efficient serial and multithreaded algorithms for computing EMST are known, designing an efficient GPU algorithm is challenging due to a complex branching structure, data dependencies, and load imbalances. In this paper, we propose a single-tree Bor\r{u}vka-based algorithm for computing EMST on GPUs. We use an efficient nearest neighbor algorithm and reduce the number of the required distance calculations by avoiding traversing subtrees with leaf nodes in the same component. The developed algorithms are implemented in a performance portable way using ArborX, an open-source geometric search library based on the Kokkos framework. We evaluate the proposed algorithm on various 2D and 3D datasets, show and compare it with the current state-of-the-art open-source CPU implementations. We demonstrate 4-24x speedup over the fastest multi-threaded implementation. We prove the portability of our implementation by providing results on a variety of hardware: AMD EPYC 7763, Nvidia A100 and AMD MI250X. We show scalability of the implementation, computing EMST for 37 million 3D cosmological dataset in under a 0.5 second on a single A100 Nvidia GPU.


title: The Structure of Hypergraphs Arising in Cellular Mobile Communication Systems

abstract: An assumption that has often been used by researchers to model the interference in a wireless network is the unit disk graph model. While many theoretical results and performance guarantees have been obtained under this model, an open research direction is to extend these results to hypergraph interference models. Motivated by recent results that the worst-case performance of the distributed maximal scheduling algorithm is characterized by the interference degree of the hypergraph, in the present work we investigate properties of the interference degree of the hypergraph and the structure of hypergraphs arising from physical constraints. We show that the problem of computing the interference degree of a hypergraph is NP-hard and we prove some properties and results concerning this hypergraph invariant. We investigate which hypergraphs are realizable, i.e. which hypergraphs arise in practice, based on physical constraints, as the interference model of a wireless network. In particular, a question that arises naturally is: what is the maximal value of $r$ such that the hypergraph $K_{1,r}$ is realizable? We determine this quantity for various integral and nonintegral values of the path loss exponent of signal propagation. We also investigate hypergraphs generated by line networks.


title: Competing electronic states emerging on polar surfaces

abstract: Excess charge on polar surfaces of ionic compounds is commonly described by the two-dimensional electron gas (2DEG) model, a homogeneous distribution of charge, spatially-confined in a few atomic layers. Here, by combining scanning probe microscopy with density functional theory calculations, we show that excess charge on the polar TaO$_2$ termination of KTaO$_3$(001) forms more complex electronic states with different degrees of spatial and electronic localization: charge density waves (CDW) coexist with strongly-localized electron polarons and bipolarons. These surface electronic reconstructions, originating from the combined action of electron-lattice interaction and electronic correlation, are energetically more favorable than the 2DEG solution. They exhibit distinct spectroscopy signals and impact on the surface properties, as manifested by a local suppression of ferroelectric distortions. Controlling the degree of charge ordering and the transition from ferroelectric to paraelectric states could be of great benefit for the generation and transport of carriers in electronic applications.


title: A Survey on Satisfiability Checking for the $\mu$-Calculus through Tree Automata

abstract: Algorithms for model checking and satisfiability of the modal $\mu$-calculus start by converting formulas to alternating parity tree automata. Thus, model checking is reduced to checking acceptance by tree automata and satisfiability to checking their emptiness. The first reduces directly to the solution of parity games but the second is more complicated. We review the non-emptiness checking of alternating tree automata by a reduction to solving parity games of a certain structure, so-called emptiness games. Since the emptiness problem for alternating tree automata is EXPTIME-complete, the size of these games is exponential in the number of states of the input automaton. We show how the construction of the emptiness games combines a (fixed) structural part with (history-)determinization of parity word automata. For tree automata with certain syntactic structures, simpler methods may be used to handle the treatment of the word automata, which then may be asymptotically smaller than in the general case. These results have direct consequences in satisfiability and validity checking for (various fragments of) the modal $\mu$-calculus.


title: A Local Macroscopic Conservative (LoMaC) low rank tensor method for the Vlasov dynamics

abstract: In this paper, we propose a novel Local Macroscopic Conservative (LoMaC) low rank tensor method for simulating the Vlasov-Poisson (VP) system. The LoMaC property refers to the exact local conservation of macroscopic mass, momentum and energy at the discrete level. This is a follow-up work of our previous development of a conservative low rank tensor approach for Vlasov dynamics (arXiv:2201.10397). In that work, we applied a low rank tensor method with a conservative singular value decomposition (SVD) to the high dimensional VP system to mitigate the curse of dimensionality, while maintaining the local conservation of mass and momentum. However, energy conservation is not guaranteed, which is a critical property to avoid unphysical plasma self-heating or cooling. The new ingredient in the LoMaC low rank tensor algorithm is that we simultaneously evolve the macroscopic conservation laws of mass, momentum and energy using a flux-difference form with kinetic flux vector splitting; then the LoMaC property is realized by projecting the low rank kinetic solution onto a subspace that shares the same macroscopic observables by a conservative orthogonal projection. The algorithm is extended to the high dimensional problems by hierarchical Tuck decomposition of solution tensors and a corresponding conservative projection algorithm. Extensive numerical tests on the VP system are showcased for the algorithm's efficacy.


title: The Disordered Heterogeneous Universe: Galaxy Distribution and Clustering Across Length Scales

abstract: Studies of disordered heterogeneous media and galaxy cosmology share a common goal: analyzing the distribution of particles at `microscales' to predict physical properties at `macroscales', whether for a liquid, composite material, or entire Universe. The former theory provides an array of techniques to characterize a wide class of microstructures; in this work, we apply them to the distributions of galaxies. We focus on the lower-order correlation functions, `void' and `particle' nearest-neighbor functions, pair-connectedness functions, percolation properties, and a scalar order metric. Compared to homogeneous Poisson and typical disordered systems, the cosmological simulations exhibit enhanced large-scale clustering and longer tails in the nearest-neighbor functions, due to the presence of quasi-long-range correlations. On large scales, the system appears `hyperuniform', due to primordial density fluctuations, whilst on the smallest scales, the system becomes almost `antihyperuniform', and, via the order metric, is shown to be a highly correlated disordered system. Via a finite scaling analysis, we show that the percolation threshold of the galaxy catalogs is significantly lower than for Poisson realizations; this is consistent with the observation that the galaxy distribution contains larger voids. However, the two sets of simulations share a fractal dimension, implying that they lie in the same universality class. Finally, we consider the ability of large-scale clustering statistics to constrain cosmological parameters using simulation-based inference. Both the nearest-neighbor distribution and pair-connectedness function considerably tighten bounds on the amplitude of cosmological fluctuations at a level equivalent to observing twenty-five times more galaxies. These are a useful alternative to the three-particle correlation, and are computable in much reduced time. (Abridged)

categories: astro-ph.CO cond-mat.dis-nn cond-mat.stat-mech gr-qc math-ph math.MP


title: K\"ahler surfaces with six-positive curvature operator of the second kind

abstract: The purpose of this article is to initiate the investigation of the curvature operator of the second kind on K\"ahler manifolds. The main result asserts that a closed K\"ahler surface with six-positive curvature operator of the second kind is biholomorphic to $\mathbb{CP}^2$. It is also shown that a closed non-flat K\"ahler surface with six-nonnegative curvature operator of the second kind is either biholomorphic to $\mathbb{CP}^2$ or isometric to $\mathbb{S}^2 \times \mathbb{S}^2$.


title: Using Machine Learning to Anticipate Tipping Points and Extrapolate to Post-Tipping Dynamics of Non-Stationary Dynamical Systems

abstract: In this paper we consider the machine learning (ML) task of predicting tipping point transitions and long-term post-tipping-point behavior associated with the time evolution of an unknown (or partially unknown), non-stationary, potentially noisy and chaotic, dynamical system. We focus on the particularly challenging situation where the past dynamical state time series that is available for ML training predominantly lies in a restricted region of the state space, while the behavior to be predicted evolves on a larger state space set not fully observed by the ML model during training. In this situation, it is required that the ML prediction system have the ability to extrapolate to different dynamics past that which is observed during training. We investigate the extent to which ML methods are capable of accomplishing useful results for this task, as well as conditions under which they fail. In general, we found that the ML methods were surprisingly effective even in situations that were extremely challenging, but do (as one would expect) fail when ``too much" extrapolation is required. For the latter case, we investigate the effectiveness of combining the ML approach with conventional modeling based on scientific knowledge, thus forming a hybrid prediction system which we find can enable useful prediction even when its ML-based and knowledge-based components fail when acting alone. We also found that achieving useful results may require using very carefully selected ML hyperparameters and we propose a hyperparameter optimization strategy to address this problem. The main conclusion of this paper is that ML-based approaches are promising tools for predicting the behavior of non-stationary dynamical systems even in the case where the future evolution (perhaps due to the crossing of a tipping point) includes dynamics on a set outside of that explored by the training data.


title: Ray-Space Motion Compensation for Lenslet Plenoptic Video Coding

abstract: Plenoptic images and videos bearing rich information demand a tremendous amount of data storage and high transmission cost. While there has been much study on plenoptic image coding, investigations into plenoptic video coding have been very limited. We investigate the motion compensation for plenoptic video coding from a slightly different perspective by looking at the problem in the ray-space domain instead of in the conventional pixel domain. Here, we develop a novel motion compensation scheme for lenslet video under two sub-cases of ray-space motion, that is, integer ray-space motion and fractional ray-space motion. The proposed new scheme of light field motion-compensated prediction is designed such that it can be easily integrated into well-known video coding techniques such as HEVC. Experimental results compared to relevant existing methods have shown remarkable compression efficiency with an average gain of 19.63% and a peak gain of 29.1%.


title: Lenart's bijection via bumpless pipe dreams

abstract: Pipe dreams and bumpless pipe dreams for vexillary permutations are each known to be in bijection with certain semistandard tableaux via maps due to Lenart and Weigandt, respectively. Recently, Gao and Huang have defined a bijection between the former two sets. In this note we show for vexillary permutations that the Gao-Huang bijection preserves the associated tableaux, giving a new proof of Lenart's result. Our methods extend to give a recording tableau for any bumpless pipe dream.


title: Solving barrier options under stochastic volatility using deep learning

abstract: We develop an unsupervised deep learning method to solve the barrier options under the Bergomi model. The neural networks serve as the approximate option surfaces and are trained to satisfy the PDE as well as the boundary conditions. Two singular terms are added to the neural networks to deal with the non-smooth and discontinuous payoff at the strike and barrier levels so that the neural networks can replicate the asymptotic behaviors of barrier options at short maturities. After that, vanilla options and barrier options are priced in a single framework. Also, neural networks are employed to deal with the high dimensionality of the function input in the Bergomi model. Once trained, the neural network solution yields fast and accurate option values.


title: The Octagon at large M

abstract: Recently, the first instance of a model of D-branes at Calabi-Yau singularities where supersymmetry is broken dynamically into stable vacua has been proposed. This construction was based on a system of $N$ regular and $M=1$ fractional branes placed at the tip of the so-called (orientifolded) Octagon singularity. In this paper we show that this model admits a large $M$ generalization, having the same low energy effective dynamics. This opens up the possibility that the effect on geometry is smooth, and amenable to describing the gauge theory all along the RG flow, including the deep IR, in terms of a weakly coupled gravity dual background. The relevance of this result in the wider context of the string landscape and the Swampland program is also discussed.


title: Regular Monoidal Languages

abstract: We introduce regular languages of morphisms in free monoidal categories, with their associated grammars and automata. These subsume the classical theory of regular languages of words and trees, but also open up a much wider class of languages over string diagrams. We use the algebra of monoidal and cartesian restriction categories to investigate the properties of regular monoidal languages, and provide sufficient conditions for their recognizability by deterministic monoidal automata.


title: Flavor hierarchies and B-anomalies from 5D

abstract: $B$-anomalies may suggest New Physics at the TeV scale breaking flavor universality. In particular, 4321 gauge models can successfully explain them in a consistent way. In this talk we explore how to UV complete the 4321 model in a 5D warped background to solve simultaneously the Higgs hierarchy problem too, finding interesting connections with the flavor puzzle. We present a model that addresses the $B$-anomalies, flavor hierarchies, and the Higgs hierarchy problem, where quarks and leptons are unified \`a la Pati-Salam in a non-universal way, and the Higgs appears as a pseudo-Nambu-Goldstone boson. These proceedings are based on arXiv:2203.01952.


title: Behavioral Player Rating in Competitive Online Shooter Games

abstract: Competitive online games use rating systems for matchmaking; progression-based algorithms that estimate the skill level of players with interpretable ratings in terms of the outcome of the games they played. However, the overall experience of players is shaped by factors beyond the sole outcome of their games. In this paper, we engineer several features from in-game statistics to model players and create ratings that accurately represent their behavior and true performance level. We then compare the estimating power of our behavioral ratings against ratings created with three mainstream rating systems by predicting rank of players in four popular game modes from the competitive shooter genre. Our results show that the behavioral ratings present more accurate performance estimations while maintaining the interpretability of the created representations. Considering different aspects of the playing behavior of players and using behavioral ratings for matchmaking can lead to match-ups that are more aligned with players' goals and interests, consequently resulting in a more enjoyable gaming experience.


title: Deep Learning and Symbolic Regression for Discovering Parametric Equations

abstract: Symbolic regression is a machine learning technique that can learn the governing formulas of data and thus has the potential to transform scientific discovery. However, symbolic regression is still limited in the complexity and dimensionality of the systems that it can analyze. Deep learning on the other hand has transformed machine learning in its ability to analyze extremely complex and high-dimensional datasets. We propose a neural network architecture to extend symbolic regression to parametric systems where some coefficient may vary but the structure of the underlying governing equation remains constant. We demonstrate our method on various analytic expressions, ODEs, and PDEs with varying coefficients and show that it extrapolates well outside of the training domain. The neural network-based architecture can also integrate with other deep learning architectures so that it can analyze high-dimensional data while being trained end-to-end. To this end we integrate our architecture with convolutional neural networks to analyze 1D images of varying spring systems.

categories: cs.LG cs.SC physics.comp-ph physics.data-an


title: The Target Study: A Conceptual Model and Framework for Measuring Disparity

abstract: We present a conceptual model to measure disparity--the target study--where social groups may be similarly situated (i.e., balanced) on allowable covariates. Our model, based on a sampling design, does not intervene to assign social group membership or alter allowable covariates. To address non-random sample selection, we extend our model to generalize or transport disparity or to assess disparity after an intervention on eligibility-related variables that eliminates forms of collider-stratification. To avoid bias from differential timing of enrollment, we aggregate time-specific study results by balancing calendar time of enrollment across social groups. To provide a framework for emulating our model, we discuss study designs, data structures, and G-computation and weighting estimators. We compare our sampling-based model to prominent decomposition-based models used in healthcare and algorithmic fairness. We provide R code for all estimators and apply our methods to measure health system disparities in hypertension control using electronic medical records.


title: Masked Autoencoder for Self-Supervised Pre-training on Lidar Point Clouds

abstract: Masked autoencoding has become a successful pretraining paradigm for Transformer models for text, images, and, recently, point clouds. Raw automotive datasets are suitable candidates for self-supervised pre-training as they generally are cheap to collect compared to annotations for tasks like 3D object detection (OD). However, the development of masked autoencoders for point clouds has focused solely on synthetic and indoor data. Consequently, existing methods have tailored their representations and models toward small and dense point clouds with homogeneous point densities. In this work, we study masked autoencoding for point clouds in an automotive setting, which are sparse and for which the point density can vary drastically among objects in the same scene. To this end, we propose Voxel-MAE, a simple masked autoencoding pre-training scheme designed for voxel representations. We pre-train the backbone of a Transformer-based 3D object detector to reconstruct masked voxels and to distinguish between empty and non-empty voxels. Our method improves the 3D OD performance by 1.75 mAP points and 1.05 NDS on the challenging nuScenes dataset. Further, we show that by pre-training with Voxel-MAE, we require only 40% of the annotated data to outperform a randomly initialized equivalent. Code available at https://github.com/georghess/voxel-mae


title: QoE-Centric Multi-User mmWave Scheduling: A Beam Alignment and Buffer Predictive Approach

abstract: In this paper, we consider the multi-user scheduling problem in millimeter wave (mmWave) video streaming networks, which comprise a streaming server and several users, each requesting a video stream with a different resolution. The main objective is to optimize the long-term average quality of experience (QoE) for all users. We tackle this problem by considering the physical layer characteristics of the mmWave network, including the beam alignment overhead due to pencil-beams. To develop an efficient scheduling policy, we leverage the contextual multi-armed bandit (MAB) models to propose a beam alignment overhead and buffer predictive streaming solution, dubbed B2P-Stream. The proposed B2P-Stream algorithm optimally balances the trade-off between the overhead and users' buffer levels and improves the QoE by reducing the beam alignment overhead for users of higher resolutions. We also provide a theoretical guarantee for our proposed method and prove that it guarantees a sub-linear regret bound. Finally, we examine our proposed framework through extensive simulations. We provide a detailed comparison of the B2P-Stream against uniformly random and Round-robin (RR) policies and show that it outperforms both of them in providing a better QoE and fairness. We also analyze the scalability and robustness of the B2P-Stream algorithm with different network configurations.


title: T-Tetrominos in Arithmetic Progression

abstract: A famous result of D. Walkup is that an $m\times n$ rectangle may be tiled by T-tetrominos if and only if both $m$ and $n$ are multiples of 4. The "if" portion may be proved by tiling a $4\times 4$ block, and then copying that block to fill the rectangle; but, this leads to regular, periodic tilings. In this paper we investigate how much "order" must be present in every tiling of a rectangle by T-tetrominos, where we measure order by length of arithmetic progressions of tiles.


title: An introduction to Thermal Field Theory and Some of its Application

abstract: In this article an introduction to the thermal field theory within imaginary time has been discussed in details. The imaginary time formalism has been introduced through both the operatorial and the functional integration method. The prescription to perform frequency sum for boson and fermion has been discussed. Green's function both in Minkowski time as well as in Euclidean time has been derived. The tadpole diagram in $\phi^4$ theory and the self-energy in $\phi^3$ theory have been computed. The basic features of general two point functions for both fermions and bosons in presence of a heat bath have been discussed. Then the free partition functions for scalar, fermion and gauge field, and interacting scalar field have been obtained. The quantum electrodynamics (QED) and gauge fixing have been discussed in details. The one-loop self-energy for electron and photon in QED have been obtained in hard thermal loop (HTL) approximation. The dispersion properties and collective excitations of both electron and photon in a thermal medium have been presented. The spectral representation of fermion and gauge boson propagators have been obtained. In HTL approximation, the generalisation of QED results of two point functions to quantum chromodynamics (QCD) have been outlined that mostly involve group theoretical factors. As an effective field theory approach the HTL resummation and the HTL perturbation theory have been introduced. The leading order, next-to-leading order and next-to-next-leading order free energy and pressure for deconfined QCD medium created in heavy-ion collisions have been computed within HTLpt. The general features of the deconfined QCD medium have also been outlined with non-perturbative effects like gluon condensate and Gribov-Zwanziger action. The dilepton production rates from quark-gluon plasma with these non-perturbative effects have been computed.


title: Single-Crystal Silicon Thermoelectrics by Phonon Engineering

abstract: Herein, we report the use of nanostructured crystalline Si as a thermoelectric material and its integration into thermoelectric harvesters. The proof-of-concept relies on the partial suppression of lattice thermal transport by introducing pores with dimensions scaling between the electron mean free path and the phonon mean free path. In other words, we artificially aimed at the electron crystal phonon glass tradeoff targeted for thermoelectric efficiency. The devices were fabricated using CMOS compatible processes and exhibited power generation from a few microWatts per cm^2 to a few milliWatts per cm^2 under temperature differences from a few K to 200 K across the thermopiles. These numbers demonstrate the capability to power autonomous devices with environmental or body heat using silicon chips with areas below cm^2. This paper also reports the possibility of using the developed demonstrators for integrated thermoelectric cooling.


title: LIV in matter

abstract: We summarize recent work dealing with the characterization of effective actions giving the electromagnetic response of some topological materials, arising from their microscopic structure. The case of weakly tilted Weyl semimetals in the limit of zero temperature, but nonzero chemical potential, is presented as a subset of a specific choice of terms in the fermionic sector of the SME.


title: Linear response hydrodynamics of a relativistic dissipative fluid with spin

abstract: We formulate a lagrangian hydrodynamics including shear and bulk viscosity in the presence of spin density, and investigate it using the linear response functional formalism. The result is a careful accounting of all sound and vortex interactions close to local equilibrium.


title: Functional Synthetic Biology

abstract: Synthetic biologists have made great progress over the past decade in developing methods for modular assembly of genetic sequences and in engineering biological systems with a wide variety of functions in various contexts and organisms. However, current paradigms in the field entangle sequence and functionality in a manner that makes abstraction difficult, reduces engineering flexibility, and impairs predictability and design reuse. Functional Synthetic Biology aims to overcome these impediments by focusing the design of biological systems on function, rather than on sequence. This reorientation will decouple the engineering of biological devices from the specifics of how those devices are put to use, requiring both conceptual and organizational change, as well as supporting software tooling. Realizing this vision of Functional Synthetic Biology will allow more flexibility in how devices are used, more opportunity for reuse of devices and data, improvements in predictability, and reductions in technical risk and cost.


title: Exactly-Solvable Self-Trapping Lattice Walks. Part I: Trapping in Ladder Graphs

abstract: A growing self-avoiding walk (GSAW) is a stochastic process that starts from the origin on a lattice and grows by occupying an unoccupied adjacent lattice site at random. A sufficiently long GSAW will reach a state in which all adjacent sites are already occupied by the walk and become trapped, terminating the process. It is known empirically from simulations that on a square lattice, this occurs after a mean of 71 steps. In Part I of a two-part series of manuscripts, we consider simplified lattice geometries only two sites high ("ladders") and derive generating functions for the probability distribution of GSAW trapping. We prove that a self-trapping walk on a square ladder will become trapped after a mean of 17 steps, while on a triangular ladder trapping will occur after a mean of 941/48 (~19.6 steps). We discuss additional implications of our results for understanding trapping in the "infinite" GSAW.


title: The waltz of tiny droplets and the flow they live in

abstract: This article describes the dynamics of small inertial particles centrifuging out of a single vortex. It shows the importance of caustics formation in the vicinity of a single vortex: both for particle collisions and void formation. From these single-vortex studies we provide estimates of the role of caustics in high Reynolds number turbulence, and in the case of clouds, estimate how they may help in rain initiation by bridging the droplet-growth bottleneck. We briefly describe how the Basset- Boussinesq history force may be calculated by a method which does not involve huge memory costs, and provide arguments for its possible importance for droplets in turbulence. We discuss how phase change could render cloud turbulence fundamentally different from turbulence in other situations.


title: A necessary condition for Sobolev extension domains in higher dimensions

abstract: We give a necessary condition for a domain to have a bounded extension operator from $L^{1,p}(\Omega)$ to $L^{1,p}(\mathbb R^n)$ for the range $1 < p < 2$. The condition is given in terms of a power of the distance to the boundary of $\Omega$ integrated along the measure theoretic boundary of a set of locally finite perimeter and its extension. This generalizes a characterizing curve condition for planar simply connected domains, and a condition for $W^{1,1}$-extensions. We use the necessary condition to give a quantitative version of the curve condition. We also construct an example of an extension domain that is homeomorphic to a ball and has $n$-dimensional boundary.


title: On rough continuity and rough $I$-continuity of real functions

abstract: In this paper, we have studied first the idea of rough continuity of real valued functions of real variables and then we have discussed some important properties of rough continuity. Then we study the idea of rough $I$-continuity of real valued functions and find the relation between rough $I$-continuity and rough continuity. We also introduce the notion of rough $(I_1, I_2)$-continuity and rough $I^*$-continuity of real valued functions and discuss some properties on this two types on continuity.


title: The Twelfth Moment of Hecke $L$-Functions in the Weight Aspect

abstract: We prove an upper bound for the twelfth moment of Hecke $L$-functions associated to holomorphic Hecke cusp forms of weight $k$ in a dyadic interval $T \leq k \leq 2T$ as $T$ tends to infinity. This bound recovers the Weyl-strength subconvex bound $L(1/2,f) \ll_{\varepsilon} k^{1/3 + \varepsilon}$ and shows that for any $\delta > 0$, the sub-Weyl subconvex bound $L(1/2,f) \ll k^{1/3 - \delta}$ holds for all but $O_{\varepsilon}(T^{12\delta + \varepsilon})$ Hecke cusp forms $f$ of weight at most $T$. Our result parallels a related result of Jutila for the twelfth moment of Hecke $L$-functions associated to Hecke-Maass cusp forms. The proof uses in a crucial way a spectral reciprocity formula of Kuznetsov that relates the fourth moment of $L(1/2,f)$ weighted by a test function to a dual fourth moment weighted by a different test function.


title: Large Deviations for Stochastic Generalized Porous Media Equations driven by L\'{e}vy Noise

abstract: We establish a large deviation principle (LDP) for a class of stochastic porous media equations driven by L\'{e}vy-type noise on a $\sigma$-finite measure space $(E,\mathcal{B}(E),\mu)$, with the Laplacian replaced by a negative definite self-adjoint operator. One of the main contributions of this paper is that we do not assume the compactness of embeddings in the corresponding Gelfand triple, and to compensate for this generalization, a new procedure is provided. This is the first paper to deal with LDPs for stochastic evolution equations with L\'evy noise without compactness conditions. The coefficient $\Psi$ is assumed to satisfy nondecreasing Lipschitz nonlinearity, so an important physical problem covered by this case is the Stefan problem. Numerous examples of negative definite self-adjoint operators are applicable to our results, for example, for open $E\subset\Bbb{R}^d$, $L=$ Laplacian or fractional Laplacians, i.e., $L=-(-\Delta)^\alpha,\ \alpha\in(0,1]$, generalized Schr\"{o}dinger operators, i.e., $L=\Delta+2\frac{\nabla \rho}{\rho}\cdot\nabla$, Laplacians on fractals is also included.


title: Transforming Image Generation from Scene Graphs

abstract: Generating images from semantic visual knowledge is a challenging task, that can be useful to condition the synthesis process in complex, subtle, and unambiguous ways, compared to alternatives such as class labels or text descriptions. Although generative methods conditioned by semantic representations exist, they do not provide a way to control the generation process aside from the specification of constraints between objects. As an example, the possibility to iteratively generate or modify images by manually adding specific items is a desired property that, to our knowledge, has not been fully investigated in the literature. In this work we propose a transformer-based approach conditioned by scene graphs that, conversely to recent transformer-based methods, also employs a decoder to autoregressively compose images, making the synthesis process more effective and controllable. The proposed architecture is composed by three modules: 1) a graph convolutional network, to encode the relationships of the input graph; 2) an encoder-decoder transformer, which autoregressively composes the output image; 3) an auto-encoder, employed to generate representations used as input/output of each generation step by the transformer. Results obtained on CIFAR10 and MNIST images show that our model is able to satisfy semantic constraints defined by a scene graph and to model relations between visual objects in the scene by taking into account a user-provided partial rendering of the desired target.


title: Quantitative Tracy-Widom laws for the largest eigenvalue of generalized Wigner matrices

abstract: We show that the fluctuations of the largest eigenvalue of any generalized Wigner matrix $H$ converge to the Tracy-Widom laws at a rate nearly $O(N^{-1/3})$, as the matrix dimension $N$ tends to infinity. We allow the variances of the entries of $H$ to have distinct values but of comparable sizes such that $\sum_{i} \mathbb{E}|h_{ij}|^2=1$. Our result improves the previous rate $O(N^{-2/9})$ by Bourgade [8] and the proof relies on the first long-time Green function comparison theorem near the edges without the second moment matching restriction.


title: The infrared [WC] stars

abstract: A number of late [WC] stars have unique infrared properties, not found among the non-[WC] planetary nebulae, and together define a class of IR-[WC] stars. They have unusual IRAS colours, resembling stars in the earliest post-AGB evolution and possibly related to PAH formation. Most or all show a double chemistry, with both a neutral (molecular) oxygen-rich and an inner carbon-rich region. Their dense nebulae indicate recent evolution from the AGB, suggesting a fatal-thermal-pulse (FTP) scenario. Although both the colours and the stellar characteristics predict fast evolution, it is shown that this phase must last for 10^4 yr. The morphologies of the nebulae are discussed. For one object in Sgr, the progenitor mass (1.3 solar masses) is known. The stellar temperatures of the IR-[WC] stars appear much higher in low metallicity systems (LMC, Sgr). This may be indicative of an extended 'pseudo' photosphere. It is proposed that re-accretion of ejected gas may slow down the post-AGB evolution and so extend the life time of the IR-[WC] stars.


title: AIROPA III: Testing Simulated and On-Sky Data

abstract: Adaptive optics images from the W. M. Keck Observatory have delivered numerous influential scientific results, including detection of multi-system asteroids, the supermassive black hole at the center of the Milky Way, and directly imaged exoplanets. Specifically, the precise and accurate astrometry these images yield was used to measure the mass of the supermassive black hole using orbits of the surrounding star cluster. Despite these successes, one of the major obstacles to improved astrometric measurements is the spatial and temporal variability of the point-spread function delivered by the instruments. AIROPA is a software package for the astrometric and photometric analysis of adaptive optics images using point-spread function fitting together with the technique of point-spread function reconstruction. In adaptive optics point-spread function reconstruction, the knowledge of the instrument performance and of the atmospheric turbulence is used to predict the long-exposure point-spread function of an observation. In this paper we present the results of our tests using AIROPA on both simulated and on-sky images of the Galactic Center. We find that our method is very reliable in accounting for the static aberrations internal to the instrument, but it does not improve significantly the accuracy on sky, possibly due to uncalibrated telescope aberrations.


title: Compatibility in Ozsvath-Szabo's bordered HFK via higher representations

abstract: We equip the basic local crossing bimodules in Ozsv\'ath-Szab\'o's theory of bordered knot Floer homology with the structure of 1-morphisms of 2-representations, categorifying the $U_q(\mathfrak{gl}(1|1)^+)$-intertwining property of the corresponding maps between ordinary representations. Besides yielding a new connection between bordered knot Floer homology and higher representation theory in line with work of Rouquier and the second author, this structure gives an algebraic reformulation of a ``compatibility between summands'' property for Ozsv\'ath-Szab\'o's bimodules that is important when building their theory up from local crossings to more global tangles and knots.


title: The "AI+R"-tree: An Instance-optimized R-tree

abstract: The emerging class of instance-optimized systems has shown potential to achieve high performance by specializing to a specific data and query workloads. Particularly, Machine Learning (ML) techniques have been applied successfully to build various instance-optimized components (e.g., learned indexes). This paper investigates to leverage ML techniques to enhance the performance of spatial indexes, particularly the R-tree, for a given data and query workloads. As the areas covered by the R-tree index nodes overlap in space, upon searching for a specific point in space, multiple paths from root to leaf may potentially be explored. In the worst case, the entire R-tree could be searched. In this paper, we define and use the overlap ratio to quantify the degree of extraneous leaf node accesses required by a range query. The goal is to enhance the query performance of a traditional R-tree for high-overlap range queries as they tend to incur long running-times. We introduce a new AI-tree that transforms the search operation of an R-tree into a multi-label classification task to exclude the extraneous leaf node accesses. Then, we augment a traditional R-tree to the AI-tree to form a hybrid "AI+R"-tree. The "AI+R"-tree can automatically differentiate between the high- and low-overlap queries using a learned model. Thus, the "AI+R"-tree processes high-overlap queries using the AI-tree, and the low-overlap queries using the R-tree. Experiments on real datasets demonstrate that the "AI+R"-tree can enhance the query performance over a traditional R-tree by up to 500%.


title: Evaluating the Explainers: Black-Box Explainable Machine Learning for Student Success Prediction in MOOCs

abstract: Neural networks are ubiquitous in applied machine learning for education. Their pervasive success in predictive performance comes alongside a severe weakness, the lack of explainability of their decisions, especially relevant in human-centric fields. We implement five state-of-the-art methodologies for explaining black-box machine learning models (LIME, PermutationSHAP, KernelSHAP, DiCE, CEM) and examine the strengths of each approach on the downstream task of student performance prediction for five massive open online courses. Our experiments demonstrate that the families of explainers do not agree with each other on feature importance for the same Bidirectional LSTM models with the same representative set of students. We use Principal Component Analysis, Jensen-Shannon distance, and Spearman's rank-order correlation to quantitatively cross-examine explanations across methods and courses. Furthermore, we validate explainer performance across curriculum-based prerequisite relationships. Our results come to the concerning conclusion that the choice of explainer is an important decision and is in fact paramount to the interpretation of the predictive results, even more so than the course the model is trained on. Source code and models are released at http://github.com/epfl-ml4ed/evaluating-explainers.


title: Reduce Indonesian Vocabularies with an Indonesian Sub-word Separator

abstract: Indonesian is an agglutinative language since it has a compounding process of word-formation. Therefore, the translation model of this language requires a mechanism that is even lower than the word level, referred to as the sub-word level. This compounding process leads to a rare word problem since the number of vocabulary explodes. We propose a strategy to address the unique word problem of the neural machine translation (NMT) system, which uses Indonesian as a pair language. Our approach uses a rule-based method to transform a word into its roots and accompanied affixes to retain its meaning and context. Using a rule-based algorithm has more advantages: it does not require corpus data but only applies the standard Indonesian rules. Our experiments confirm that this method is practical. It reduces the number of vocabulary significantly up to 57\%, and on the English to Indonesian translation, this strategy provides an improvement of up to 5 BLEU points over a similar NMT system that does not use this technique.


title: Syndrome-Derived Error Rates as a Benchmark of Quantum Hardware

abstract: Quantum error correcting codes are designed to pinpoint exactly when and where errors occur in quantum circuits. This feature is the foundation of their primary task: to support fault-tolerant quantum computation. However, this feature could used as the basis of benchmarking: By analyzing the outputs of even small-scale quantum error correction circuits, a detailed picture can be constructed of error processes across a quantum device. Here we perform an example of such an analysis, using the results of small repetition codes to determine the error rate of each qubit while idle during a syndrome measurement. This provides an idea of the errors experienced by the qubits across a device while they are part of the kind of circuit that we expect to be typical in fault-tolerant quantum computers.


title: Inference after latent variable estimation for single-cell RNA sequencing data

abstract: In the analysis of single-cell RNA sequencing data, researchers often characterize the variation between cells by estimating a latent variable, such as cell type or pseudotime, representing some aspect of the individual cell's state. They then test each gene for association with the estimated latent variable. If the same data are used for both of these steps, then standard methods for computing p-values and confidence intervals in the second step will fail to achieve statistical guarantees such as Type 1 error control. Furthermore, approaches such as sample splitting that can be applied to solve similar problems in other settings are not applicable in this context. In this paper, we introduce count splitting, a flexible framework that allows us to carry out valid inference in this setting, for virtually any latent variable estimation technique and inference approach, under a Poisson assumption. We demonstrate the Type 1 error control and power of count splitting in a simulation study, and apply count splitting to a dataset of pluripotent stem cells differentiating to cardiomyocytes.


title: FitHuBERT: Going Thinner and Deeper for Knowledge Distillation of Speech Self-Supervised Learning

abstract: Large-scale speech self-supervised learning (SSL) has emerged to the main field of speech processing, however, the problem of computational cost arising from its vast size makes a high entry barrier to academia. In addition, existing distillation techniques of speech SSL models compress the model by reducing layers, which induces performance degradation in linguistic pattern recognition tasks such as phoneme recognition (PR). In this paper, we propose FitHuBERT, which makes thinner in dimension throughout almost all model components and deeper in layer compared to prior speech SSL distillation works. Moreover, we employ a time-reduction layer to speed up inference time and propose a method of hint-based distillation for less performance degradation. Our method reduces the model to 23.8% in size and 35.9% in inference time compared to HuBERT. Also, we achieve 12.1% word error rate and 13.3% phoneme error rate on the SUPERB benchmark which is superior than prior work.


title: Learning to correct spectral methods for simulating turbulent flows

abstract: Despite their ubiquity throughout science and engineering, only a handful of partial differential equations (PDEs) have analytical, or closed-form solutions. This motivates a vast amount of classical work on numerical simulation of PDEs and more recently, a whirlwind of research into data-driven techniques leveraging machine learning (ML). A recent line of work indicates that a hybrid of classical numerical techniques and machine learning can offer significant improvements over either approach alone. In this work, we show that the choice of the numerical scheme is crucial when incorporating physics-based priors. We build upon Fourier-based spectral methods, which are known to be more efficient than other numerical schemes for simulating PDEs with smooth and periodic solutions. Specifically, we develop ML-augmented spectral solvers for three common PDEs of fluid dynamics. Our models are more accurate (2-4x) than standard spectral solvers at the same resolution but have longer overall runtimes (~2x), due to the additional runtime cost of the neural network component. We also demonstrate a handful of key design principles for combining machine learning and numerical methods for solving PDEs.