title: Hyperspectral and LiDAR data for the prediction via machine learning of tree species, volume and biomass: a possible contribution for updating forest management plans

abstract: This work intends to lay the foundations for identifying the prevailing forest types and the delineation of forest units within private forest inventories in the Autonomous Province of Trento (PAT), using currently available remote sensing solutions. In particular, data from LiDAR and hyperspectral surveys of 2014 made available by PAT were acquired and processed. Such studies are very important in the context of forest management scenarios. The method includes defining tree species ground-truth by outlining single tree crowns with polygons and labeling them. Successively two supervised machine learning classifiers, K-Nearest Neighborhood and Support Vector Machine (SVM) were used. The results show that, by setting specific hyperparameters, the SVM methodology gave the best results in classification of tree species. Biomass was estimated using canopy parameters and the Jucker equation for the above ground biomass (AGB) and that of Scrinzi for the tariff volume. Predicted values were compared with 11 field plots of fixed radius where volume and biomass were field-estimated in 2017. Results show significant coefficients of correlation: 0.94 for stem volume and 0.90 for total aboveground tree biomass.


title: Experts in the Loop: Conditional Variable Selection for Accelerating Post-Silicon Analysis Based on Deep Learning

abstract: Post-silicon validation is one of the most critical processes in modern semiconductor manufacturing. Specifically, correct and deep understanding in test cases of manufactured devices is key to enable post-silicon tuning and debugging. This analysis is typically performed by experienced human experts. However, with the fast development in semiconductor industry, test cases can contain hundreds of variables. The resulting high-dimensionality poses enormous challenges to experts. Thereby, some recent prior works have introduced data-driven variable selection algorithms to tackle these problems and achieved notable success. Nevertheless, for these methods, experts are not involved in training and inference phases, which may lead to bias and inaccuracy due to the lack of prior knowledge. Hence, this work for the first time aims to design a novel conditional variable selection approach while keeping experts in the loop. In this way, we expect that our algorithm can be more efficiently and effectively trained to identify the most critical variables under certain expert knowledge. Extensive experiments on both synthetic and real-world datasets from industry have been conducted and shown the effectiveness of our method.


title: Impact of nuclear structure from shell model calculations on nuclear responses to WIMP elastic scattering for $^{19}$F and $^{nat}$Xe targets

abstract: Non-relativistic effective field theory (NREFT) is one approach used for describing the interaction of WIMPs with ordinary matter. Among other factors, these interactions are expected to be affected by the structure of the atomic nuclei in the target. The sensitivity of the nuclear response components of the WIMP-nucleus scattering amplitude is investigated using shell model calculations for $^{19}$F and $^{nat}$Xe. Resulting integrated nuclear response values are shown to be sensitive to some specifics of the nuclear structure calculations.


title: Traffic Sign Classification Using Deep and Quantum Neural Networks

abstract: Quantum Neural Networks (QNNs) are an emerging technology that can be used in many applications including computer vision. In this paper, we presented a traffic sign classification system implemented using a hybrid quantum-classical convolutional neural network. Experiments on the German Traffic Sign Recognition Benchmark dataset indicate that currently QNN do not outperform classical DCNN (Deep Convolutuional Neural Networks), yet still provide an accuracy of over 90% and are a definitely promising solution for advanced computer vision.


title: PointPillars Backbone Type Selection For Fast and Accurate LiDAR Object Detection

abstract: 3D object detection from LiDAR sensor data is an important topic in the context of autonomous cars and drones. In this paper, we present the results of experiments on the impact of backbone selection of a deep convolutional neural network on detection accuracy and computation speed. We chose the PointPillars network, which is characterised by a simple architecture, high speed, and modularity that allows for easy expansion. During the experiments, we paid particular attention to the change in detection efficiency (measured by the mAP metric) and the total number of multiply-addition operations needed to process one point cloud. We tested 10 different convolutional neural network architectures that are widely used in image-based detection problems. For a backbone like MobilenetV1, we obtained an almost 4x speedup at the cost of a 1.13% decrease in mAP. On the other hand, for CSPDarknet we got an acceleration of more than 1.5x at an increase in mAP of 0.33%. We have thus demonstrated that it is possible to significantly speed up a 3D object detector in LiDAR point clouds with a small decrease in detection efficiency. This result can be used when PointPillars or similar algorithms are implemented in embedded systems, including SoC FPGAs. The code is available at https://github.com/vision-agh/pointpillars\_backbone.


title: Cerberus: A Formal Approach to Secure and Efficient Enclave Memory Sharing

abstract: Hardware enclaves rely on a disjoint memory model, which maps each physical address to an enclave to achieve strong memory isolation. However, this severely limits the performance and programmability of enclave programs. While some prior work proposes enclave memory sharing, it does not provide a formal model or verification of their designs. This paper presents Cerberus, a formal approach to secure and efficient enclave memory sharing. To reduce the burden of formal verification, we compare different sharing models and choose a simple yet powerful sharing model. Based on the sharing model, Cerberus extends an enclave platform such that enclave memory can be made immutable and shareable across multiple enclaves via additional operations. We use incremental verification starting with an existing formal model called the Trusted Abstract Platform (TAP). Using our extended TAP model, we formally verify that Cerberus does not break or weaken the security guarantees of the enclaves despite allowing memory sharing. More specifically, we prove the Secure Remote Execution (SRE) property on our formal model. Finally, the paper shows the feasibility of Cerberus by implementing it in an existing enclave platform, RISC-V Keystone.


title: Divergence, thickness and hypergraph index for general Coxeter groups

abstract: We study divergence and thickness for general Coxeter groups $W$. We first characterise linear divergence, and show that if $W$ has superlinear divergence then its divergence is at least quadratic. We then formulate a computable combinatorial invariant, hypergraph index, for arbitrary Coxeter systems $(W,S)$. This generalises Levcovitz's definition for the right-angled case. We prove that if $(W,S)$ has finite hypergraph index $h$, then $W$ is (strongly algebraically) thick of order at most $h$, hence has divergence bounded above by a polynomial of degree $h+1$. We conjecture that these upper bounds on the order of thickness and divergence are in fact equalities, and we prove our conjecture for certain families of Coxeter groups. These families are obtained by a new construction which, given any right-angled Coxeter group, produces infinitely many examples of non-right-angled Coxeter systems with the same hypergraph index. Finally, we give an upper bound on the hypergraph index of any Coxeter system $(W,S)$, and hence on the divergence of $W$, in terms of, unexpectedly, the topology of its associated Dynkin diagram.


title: Stellar Chromospheric Activity Database of Solar-like Stars Based on the LAMOST Low-Resolution Spectroscopic Survey

abstract: $\require{mediawiki-texvc}$A stellar chromospheric activity database of solar-like stars is constructed based on the Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST) Low-Resolution Spectroscopic Survey (LRS). The database contains spectral bandpass fluxes and indexes of Ca II H&K lines derived from 1,330,654 high-quality LRS spectra of solar-like stars. We measure the mean fluxes at line cores of the Ca II H&K lines using a 1 ${\AA}$ rectangular bandpass as well as a 1.09 ${\AA}$ full width at half maximum (FWHM) triangular bandpass, and the mean fluxes of two 20 ${\AA}$ pseudo-continuum bands on the two sides of the lines. Three activity indexes, $S_{\rm rec}$ based on the 1 ${\AA}$ rectangular bandpass, and $S_{\rm tri}$ and $S_L$ based on the 1.09 ${\AA}$ FWHM triangular bandpass, are evaluated from the measured fluxes to quantitatively indicate the chromospheric activity level. The uncertainties of all the obtained parameters are estimated. We also produce spectrum diagrams of Ca II H&K lines for all the spectra in the database. The entity of the database is composed of a catalog of spectral sample and activity parameters, and a library of spectrum diagrams. Statistics reveal that the solar-like stars with high level of chromospheric activity ($S_{\rm rec}>0.6$) tend to appear in the parameter range of $T_{\rm eff}\text{ (effective temperature)}<5500\,{\rm K}$, $4.3<\log\,g\text{ (surface gravity)}<4.6$, and $-0.2<[{\rm Fe/H}]\text{ (metallicity)}<0.3$. This database with more than one million high-quality LAMOST LRS spectra of Ca II H&K lines and basal chromospheric activity parameters can be further used for investigating activity characteristics of solar-like stars and solar-stellar connection.


title: S2P: State-conditioned Image Synthesis for Data Augmentation in Offline Reinforcement Learning

abstract: Offline reinforcement learning (Offline RL) suffers from the innate distributional shift as it cannot interact with the physical environment during training. To alleviate such limitation, state-based offline RL leverages a learned dynamics model from the logged experience and augments the predicted state transition to extend the data distribution. For exploiting such benefit also on the image-based RL, we firstly propose a generative model, S2P (State2Pixel), which synthesizes the raw pixel of the agent from its corresponding state. It enables bridging the gap between the state and the image domain in RL algorithms, and virtually exploring unseen image distribution via model-based transition in the state space. Through experiments, we confirm that our S2P-based image synthesis not only improves the image-based offline RL performance but also shows powerful generalization capability on unseen tasks.


title: Energy Efficient Hardware Acceleration of Neural Networks with Power-of-Two Quantisation

abstract: Deep neural networks virtually dominate the domain of most modern vision systems, providing high performance at a cost of increased computational complexity.Since for those systems it is often required to operate both in real-time and with minimal energy consumption (e.g., for wearable devices or autonomous vehicles, edge Internet of Things (IoT), sensor networks), various network optimisation techniques are used, e.g., quantisation, pruning, or dedicated lightweight architectures. Due to the logarithmic distribution of weights in neural network layers, a method providing high performance with significant reduction in computational precision (for 4-bit weights and less) is the Power-of-Two (PoT) quantisation (and therefore also with a logarithmic distribution). This method introduces additional possibilities of replacing the typical for neural networks Multiply and ACcumulate (MAC -- performing, e.g., convolution operations) units, with more energy-efficient Bitshift and ACcumulate (BAC). In this paper, we show that a hardware neural network accelerator with PoT weights implemented on the Zynq UltraScale + MPSoC ZCU104 SoC FPGA can be at least $1.4x$ more energy efficient than the uniform quantisation version. To further reduce the actual power requirement by omitting part of the computation for zero weights, we also propose a new pruning method adapted to logarithmic quantisation.


title: Transformers for Object Detection in Large Point Clouds

abstract: We present TransLPC, a novel detection model for large point clouds that is based on a transformer architecture. While object detection with transformers has been an active field of research, it has proved difficult to apply such models to point clouds that span a large area, e.g. those that are common in autonomous driving, with lidar or radar data. TransLPC is able to remedy these issues: The structure of the transformer model is modified to allow for larger input sequence lengths, which are sufficient for large point clouds. Besides this, we propose a novel query refinement technique to improve detection accuracy, while retaining a memory-friendly number of transformer decoder queries. The queries are repositioned between layers, moving them closer to the bounding box they are estimating, in an efficient manner. This simple technique has a significant effect on detection accuracy, which is evaluated on the challenging nuScenes dataset on real-world lidar data. Besides this, the proposed method is compatible with existing transformer-based solutions that require object detection, e.g. for joint multi-object tracking and detection, and enables them to be used in conjunction with large point clouds.


title: On the Impossible Safety of Large AI Models

abstract: Large AI Models (LAIMs), of which large language models are the most prominent recent example, showcase some impressive performance. However they have been empirically found to pose serious security issues. This paper systematizes our knowledge about the fundamental impossibility of building arbitrarily accurate and secure machine learning models. More precisely, we identify key challenging features of many of today's machine learning settings. Namely, high accuracy seems to require memorizing large training datasets, which are often user-generated and highly heterogeneous, with both sensitive information and fake users. We then survey statistical lower bounds that, we argue, constitute a compelling case against the possibility of designing high-accuracy LAIMs with strong security guarantees.


title: A Multiple Criteria Decision Analysis based Approach to Remove Uncertainty in SMP Models

abstract: Advanced AI technologies are serving humankind in a number of ways, from healthcare to manufacturing. Advanced automated machines are quite expensive, but the end output is supposed to be of the highest possible quality. Depending on the agility of requirements, these automation technologies can change dramatically. The likelihood of making changes to automation software is extremely high, so it must be updated regularly. If maintainability is not taken into account, it will have an impact on the entire system and increase maintenance costs. Many companies use different programming paradigms in developing advanced automated machines based on client requirements. Therefore, it is essential to estimate the maintainability of heterogeneous software. As a result of the lack of widespread consensus on software maintainability prediction (SPM) methodologies, individuals and businesses are left perplexed when it comes to determining the appropriate model for estimating the maintainability of software, which serves as the inspiration for this research. A structured methodology was designed, and the datasets were preprocessed and maintainability index (MI) range was also found for all the datasets expect for UIMS and QUES, the metric CHANGE is used for UIMS and QUES. To remove the uncertainty among the aforementioned techniques, a popular multiple criteria decision-making model, namely the technique for order preference by similarity to ideal solution (TOPSIS), is used in this work. TOPSIS revealed that GARF outperforms the other considered techniques in predicting the maintainability of heterogeneous automated software.


title: Minimalistic Unsupervised Learning with the Sparse Manifold Transform

abstract: We describe a minimalistic and interpretable method for unsupervised learning, without resorting to data augmentation, hyperparameter tuning, or other engineering designs, that achieves performance close to the SOTA SSL methods. Our approach leverages the sparse manifold transform, which unifies sparse coding, manifold learning, and slow feature analysis. With a one-layer deterministic sparse manifold transform, one can achieve 99.3% KNN top-1 accuracy on MNIST, 81.1% KNN top-1 accuracy on CIFAR-10 and 53.2% on CIFAR-100. With a simple gray-scale augmentation, the model gets 83.2% KNN top-1 accuracy on CIFAR-10 and 57% on CIFAR-100. These results significantly close the gap between simplistic "white-box" methods and the SOTA methods. Additionally, we provide visualization to explain how an unsupervised representation transform is formed. The proposed method is closely connected to latent-embedding self-supervised methods and can be treated as the simplest form of VICReg. Though there remains a small performance gap between our simple constructive model and SOTA methods, the evidence points to this as a promising direction for achieving a principled and white-box approach to unsupervised learning.


title: X-ray emission mechanisms in accreting white dwarfs

abstract: In this chapter we consider the processes which can lead to X-ray emission from different types of cataclysmic variable stars (CVs). CVs are semi-detached, binary star systems where material is transferred from the donor star (also known as the companion or secondary star) onto the white dwarf primary. CVs are divided into several sub-classes based on the observed phenomenology in the optical and X-ray bands, which, in turn, is largely defined by the magnetic field strength of the accretor. In non-magnetic systems, a variety of observed behaviours are identified, depending on the accretion rate: novae, dwarf novae, nova-like variables, symbiotic binaries and supersoft sources are all examples of non-magnetic CVs. In magnetic systems (polars and intermediate polars, or AM Her and DQ Her systems, respectively), the accretion flow is channelled to polar regions, and the observational appearance is different. X-rays are typically produced through hot or energetic processes, and in CVs they are formed via shocks (within a boundary layer or accretion column, or through interactions either internal to the nova ejecta, or between the ejecta and a stellar wind) or from hydrogen burning (either steady fusion, or a thermonuclear runaway). All of these different types of accreting white dwarfs are discussed here, considering both spectral and temporal variability in the different populations.


title: A bootstrap functional central limit theorem for time-varying linear processes

abstract: We provide a functional central limit theorem for a broad class of smooth functions for possibly noncausal multivariate linear processes with time-varying coefficients. Since the limiting processes depend on unknown quantities, we propose a local block bootstrap procedure to circumvent this inconvenience in practical applications. In particular, we prove bootstrap validity for a very broad class of processes. Our results are illustrated by some numerical examples.


title: Diffusion-based Image Translation using Disentangled Style and Content Representation

abstract: Diffusion-based image translation guided by semantic texts or a single target image has enabled flexible style transfer which is not limited to the specific domains. Unfortunately, due to the stochastic nature of diffusion models, it is often difficult to maintain the original content of the image during the reverse diffusion. To address this, here we present a novel diffusion-based unsupervised image translation method using disentangled style and content representation. Specifically, inspired by the splicing Vision Transformer, we extract intermediate keys of multihead self attention layer from ViT model and used them as the content preservation loss. Then, an image guided style transfer is performed by matching the [CLS] classification token from the denoised samples and target image, whereas additional CLIP loss is used for the text-driven style transfer. To further accelerate the semantic change during the reverse diffusion, we also propose a novel semantic divergence loss and resampling strategy. Our experimental results show that the proposed method outperforms state-of-the-art baseline models in both text-guided and image-guided translation tasks.


title: Overparameterized ReLU Neural Networks Learn the Simplest Models: Neural Isometry and Exact Recovery

abstract: The practice of deep learning has shown that neural networks generalize remarkably well even with an extreme number of learned parameters. This appears to contradict traditional statistical wisdom, in which a trade-off between model complexity and fit to the data is essential. We aim to address this discrepancy by adopting a convex optimization and sparse recovery perspective. We consider the training and generalization properties of two-layer ReLU networks with standard weight decay regularization. Under certain regularity assumptions on the data, we show that ReLU networks with an arbitrary number of parameters learn only simple models that explain the data. This is analogous to the recovery of the sparsest linear model in compressed sensing. For ReLU networks and their variants with skip connections or normalization layers, we present isometry conditions that ensure the exact recovery of planted neurons. For randomly generated data, we show the existence of a phase transition in recovering planted neural network models, which is easy to describe: whenever the ratio between the number of samples and the dimension exceeds a numerical threshold, the recovery succeeds with high probability; otherwise, it fails with high probability. Surprisingly, ReLU networks learn simple and sparse models that generalize well even when the labels are noisy . The phase transition phenomenon is confirmed through numerical experiments.


title: Data Poisoning Attacks Against Multimodal Encoders

abstract: Recently, the newly emerged multimodal models, which leverage both visual and linguistic modalities to train powerful encoders, have gained increasing attention. However, learning from a large-scale unlabeled dataset also exposes the model to the risk of potential poisoning attacks, whereby the adversary aims to perturb the model's training data to trigger malicious behaviors in it. In contrast to previous work, only poisoning visual modality, in this work, we take the first step to studying poisoning attacks against multimodal models in both visual and linguistic modalities. Specially, we focus on answering two questions: (1) Is the linguistic modality also vulnerable to poisoning attacks? and (2) Which modality is most vulnerable? To answer the two questions, we propose three types of poisoning attacks against multimodal models. Extensive evaluations on different datasets and model architectures show that all three attacks can achieve significant attack performance while maintaining model utility in both visual and linguistic modalities. Furthermore, we observe that the poisoning effect differs between different modalities. To mitigate the attacks, we propose both pre-training and post-training defenses. We empirically show that both defenses can significantly reduce the attack performance while preserving the model's utility.


title: Comparing bound entanglement of bell diagonal pairs of qutrits and ququarts

abstract: We compare the classification as entangled or separable of Bell diagonal bipartite qudits with positive partial transposition (PPT) and their properties for different dimensions. For dimension $d \geq 3$, a form of entanglement exists that is hard to detect and called bound entanglement due to the fact that such entangled states cannot be used for entanglement distillation. Up to this date, no efficient solution is known to differentiate bound entangled from separable states. We address and compare this problem named separability problem for a family of bipartite Bell diagonal qudits with special algebraic and geometric structures and applications in quantum information processing tasks in different dimensions. Extending analytical and numerical methods and results for Bell diagonal qutrits ($d=3$), we successfully classify more than $75\%$ of representative Bell diagonal PPT states for $d=4$. Via those representative states we are able to estimate the volumes of separable and bound entangled states among PPT ququarts ($d=4$). We find that at least $75.7\%$ of all PPT states are separable, $1.7\%$ bound entangled and for $22.6\%$ it remains unclear whether they are separable or bound entangled. Comparing the structure of bound entangled states and their detectors, we find considerable differences in the detection capabilities for different dimensions and relate those to differences of the Euclidean geometry for qutrits ($d=3$) and ququarts ($d=4$). Finally, using a detailed visual analysis of the set of separable and bound entangled Bell diagonal states in both dimensions, qualitative observations are made that allow to better distinguish bound entangled from separable states.


title: Generative Model Watermarking Based on Human Visual System

abstract: Intellectual property protection of deep neural networks is receiving attention from more and more researchers, and the latest research applies model watermarking to generative models for image processing. However, the existing watermarking methods designed for generative models do not take into account the effects of different channels of sample images on watermarking. As a result, the watermarking performance is still limited. To tackle this problem, in this paper, we first analyze the effects of embedding watermark information on different channels. Then, based on the characteristics of human visual system (HVS), we introduce two HVS-based generative model watermarking methods, which are realized in RGB color space and YUV color space respectively. In RGB color space, the watermark is embedded into the R and B channels based on the fact that HVS is more sensitive to G channel. In YUV color space, the watermark is embedded into the DCT domain of U and V channels based on the fact that HVS is more sensitive to brightness changes. Experimental results demonstrate the effectiveness of the proposed work, which improves the fidelity of the model to be protected and has good universality compared with previous methods.


title: Indirect bounds on new physics for $R(D^{(*)})$

abstract: The Standard Model prediction of the $B_c$ lifetime is discussed, together with the dominant uncertainties and strategies on how to improve them. Furthermore, a new method to compute the $B_c$ lifetime based on the operator product expansion is proposed. It relies on differences of $B,\,D$ and $B_c$ meson decay rates, in which the free-quark contributions cancel out, reducing the uncertainty of the theory prediction.


title: ERNIE-ViL 2.0: Multi-view Contrastive Learning for Image-Text Pre-training

abstract: Recent Vision-Language Pre-trained (VLP) models based on dual encoder have attracted extensive attention from academia and industry due to their superior performance on various cross-modal tasks and high computational efficiency. They attempt to learn cross-modal representation using contrastive learning on image-text pairs, however, the built inter-modal correlations only rely on a single view for each modality. Actually, an image or a text contains various potential views, just as humans could capture a real-world scene via diverse descriptions or photos. In this paper, we propose ERNIE-ViL 2.0, a Multi-View Contrastive learning framework to build intra-modal and inter-modal correlations between diverse views simultaneously, aiming at learning a more robust cross-modal representation. Specifically, we construct multiple views within each modality to learn the intra-modal correlation for enhancing the single-modal representation. Besides the inherent visual/textual views, we construct sequences of object tags as a special textual view to narrow the cross-modal semantic gap on noisy image-text pairs. Pre-trained with 29M publicly available datasets, ERNIE-ViL 2.0 achieves competitive results on English cross-modal retrieval. Additionally, to generalize our method to Chinese cross-modal tasks, we train ERNIE-ViL 2.0 through scaling up the pre-training datasets to 1.5B Chinese image-text pairs, resulting in significant improvements compared to previous SOTA results on Chinese cross-modal retrieval. We release our pre-trained models in https://github.com/PaddlePaddle/ERNIE.


title: Application-Driven AI Paradigm for Human Action Recognition

abstract: Human action recognition in computer vision has been widely studied in recent years. However, most algorithms consider only certain action specially with even high computational cost. That is not suitable for practical applications with multiple actions to be identified with low computational cost. To meet various application scenarios, this paper presents a unified human action recognition framework composed of two modules, i.e., multi-form human detection and corresponding action classification. Among them, an open-source dataset is constructed to train a multi-form human detection model that distinguishes a human being's whole body, upper body or part body, and the followed action classification model is adopted to recognize such action as falling, sleeping or on-duty, etc. Some experimental results show that the unified framework is effective for various application scenarios. It is expected to be a new application-driven AI paradigm for human action recognition.


title: Comment on "Linear stability of a rotating channel flow subjected to a static magnetic field" [Phys. Fluids 34, 054116 (2022)]

abstract: Recently, Sengupta and Ghosh [Phys. Fluids 34, 054116, (2022)] published a linear stability analysis of a pressure-driven channel flow which is subject to rotation around a spanwise axis and a uniform magnetic field applied in the same direction. Unfortunately, the formulation of the magnetohydrodynamic part of the problem contains an elementary error which makes the obtained results unphysical. The error is due to unfounded omission of the electric potential contribution in the induced electric current which, thus, does not satisfy the charge conservation.


title: Compressed sensing radar detectors under the row-orthogonal design model: a statistical mechanics perspective

abstract: Compressed sensing (CS) model of complex-valued data can represent the signal recovery process of a large amount types of radar systems, especially when the measurement matrix is row-orthogonal. Based on debiased least absolute shrinkage and selection operator (LASSO), detection problem under Gaussian random design model, i.e. the elements of measurement matrix are drawn from Gaussian distribution, is studied by literature. However, we find that these approaches are not suitable for row-orthogonal measurement matrices, which are of more practical relevance. In view of statistical mechanics approaches, we provide derivations of more accurate test statistics and thresholds (or p-values) under the row-orthogonal design model, and theoretically analyze the detection performance of the present detector. Such detector can analytically provide the threshold according to given false alarm rate, which is not possible with the conventional CS detector, and the detection performance is proved to be better than that of the traditional LASSO detector. Comparing with other debiased LASSO based detectors, simulation results indicate that the proposed approach can achieve more accurate probability of false alarm when the measurement matrix is row-orthogonal, leading to better detection performance under Neyman-Pearson principle.


title: Online Multi-Agent Decentralized Byzantine-robust Gradient Estimation

abstract: In this paper, we propose an iterative scheme for distributed Byzantineresilient estimation of a gradient associated with a black-box model. Our algorithm is based on simultaneous perturbation, secure state estimation and two-timescale stochastic approximations. We also show the performance of our algorithm through numerical experiments.


title: A Multivariate Complexity Analysis of Qualitative Reasoning Problems

abstract: Qualitative reasoning is an important subfield of artificial intelligence where one describes relationships with qualitative, rather than numerical, relations. Many such reasoning tasks, e.g., Allen's interval algebra, can be solved in $2^{O(n \cdot \log n)}$ time, but single-exponential running times $2^{O(n)}$ are currently far out of reach. In this paper we consider single-exponential algorithms via a multivariate analysis consisting of a fine-grained parameter $n$ (e.g., the number of variables) and a coarse-grained parameter $k$ expected to be relatively small. We introduce the classes FPE and XE of problems solvable in $f(k) \cdot 2^{O(n)}$, respectively $f(k)^n$, time, and prove several fundamental properties of these classes. We proceed by studying temporal reasoning problems and (1) show that the Partially Ordered Time problem of effective width $k$ is solvable in $16^{kn}$ time and is thus included in XE, and (2) that the network consistency problem for Allen's interval algebra with no interval overlapping with more than $k$ others is solvable in $(2nk)^{2k} \cdot 2^{n}$ time and is included in FPE. Our multivariate approach is in no way limited to these to specific problems and may be a generally useful approach for obtaining single-exponential algorithms.


title: Machine Unlearning Method Based On Projection Residual

abstract: Machine learning models (mainly neural networks) are used more and more in real life. Users feed their data to the model for training. But these processes are often one-way. Once trained, the model remembers the data. Even when data is removed from the dataset, the effects of these data persist in the model. With more and more laws and regulations around the world protecting data privacy, it becomes even more important to make models forget this data completely through machine unlearning. This paper adopts the projection residual method based on Newton iteration method. The main purpose is to implement machine unlearning tasks in the context of linear regression models and neural network models. This method mainly uses the iterative weighting method to completely forget the data and its corresponding influence, and its computational cost is linear in the feature dimension of the data. This method can improve the current machine learning method. At the same time, it is independent of the size of the training set. Results were evaluated by feature injection testing (FIT). Experiments show that this method is more thorough in deleting data, which is close to model retraining.


title: Implications of exclusive $J/\psi$ photoproduction in a tamed collinear factorisation approach to NLO

abstract: We discuss exclusive $J/\psi$ photoproduction, initially in conventional collinear factorisation at NLO and then subsequently in a refined approach with a programme of low $x$ resummation and implementation of a crucial low $Q_0$ subtraction included. We compare and contrast predictions in both frameworks and remark about the possibility to constrain and ultimately determine the low $x$ and low scale gluon PDF, emphasising the significance of this for future global PDF analyses.


title: Rethinking skip connection model as a learnable Markov chain

abstract: Over past few years afterward the birth of ResNet, skip connection has become the defacto standard for the design of modern architectures due to its widespread adoption, easy optimization and proven performance. Prior work has explained the effectiveness of the skip connection mechanism from different perspectives. In this work, we deep dive into the model's behaviors with skip connections which can be formulated as a learnable Markov chain. An efficient Markov chain is preferred as it always maps the input data to the target domain in a better way. However, while a model is explained as a Markov chain, it is not guaranteed to be optimized following an efficient Markov chain by existing SGD-based optimizers which are prone to get trapped in local optimal points. In order to towards a more efficient Markov chain, we propose a simple routine of penal connection to make any residual-like model become a learnable Markov chain. Aside from that, the penal connection can also be viewed as a particular model regularization and can be easily implemented with one line of code in the most popular deep learning frameworks~\footnote{Source code: \url{https://github.com/densechen/penal-connection}}. The encouraging experimental results in multi-modal translation and image recognition empirically confirm our conjecture of the learnable Markov chain view and demonstrate the superiority of the proposed penal connection.


title: Combining Theory of Mind and Abduction for Cooperation under Imperfect Information

abstract: In this paper, we formalise and implement an agent model for cooperation under imperfect information. It is based on Theory of Mind (the cognitive ability to understand the mental state of others) and abductive reasoning (the inference paradigm that computes explanations from observations). The combination of these two techniques allows agents to derive the motives behind the actions of their peers, and incorporate this knowledge into their own decision-making. We have implemented this model in a totally domain-independent fashion and successfully tested it for the cooperative card game Hanabi.


title: Learning Transferable Spatiotemporal Representations from Natural Script Knowledge

abstract: Pre-training on large-scale video data has become a common recipe for learning transferable spatiotemporal representations in recent years. Despite some progress, existing methods are mostly limited to highly curated datasets (e.g., K400) and exhibit unsatisfactory out-of-the-box representations. We argue that it is due to the fact that they only capture pixel-level knowledge rather than spatiotemporal semantics, which hinders further progress in video understanding. Inspired by the great success of image-text pre-training (e.g., CLIP), we take the first step to exploit language semantics to boost transferable spatiotemporal representation learning. We introduce a new pretext task, Turning to Video for Transcript Sorting (TVTS), which sorts shuffled ASR scripts by attending to learned video representations. We do not rely on descriptive captions and learn purely from video, i.e., leveraging the natural transcribed speech knowledge to provide noisy but useful semantics over time. Our method enforces the vision model to contextualize what is happening over time so that it can re-organize the narrative transcripts, and can seamlessly apply to large-scale uncurated video data in the real world. Our method demonstrates strong out-of-the-box spatiotemporal representations on diverse benchmarks, e.g., +13.6% gains over VideoMAE on SSV2 via linear probing. The code is available at https://github.com/TencentARC/TVTS.


title: A Lyapunov approach for the exponential stability of a damped Timoshenko beam

abstract: In this technical note, we consider the stability properties of a viscously damped Timoshenko beam equation with spatially varying parameters. With the help of the port-Hamiltonian framework, we first prove the existence of solutions and show, by an appropriate Lyapunov function, that the system is exponentially stable and has an explicit decay rate. The explicit exponential bound is computed for an illustrative example of which we provide some numerical simulations.


title: Optical cluster-state generation with unitary averaging

abstract: Cluster states are the essential resource used in the implementation of Fusion-based quantum computation (FBQC). We introduce a method to generate high-fidelity optical cluster states by utilising the concept of unitary averaging. This error averaging technique is entirely passive and can be readily incorporated into the proposed PsiQuantum's FBQC architecture. Using postselection and the redundant encoding of Fusion gates, we observe an enhancement in the average fidelity of the output cluster state. We also show an improvement in the linear optical Bell-state measurement (BSM) success probability when the BSM is imperfect.


title: Sparse tree-based initialization for neural networks

abstract: Dedicated neural network (NN) architectures have been designed to handle specific data types (such as CNN for images or RNN for text), which ranks them among state-of-the-art methods for dealing with these data. Unfortunately, no architecture has been found for dealing with tabular data yet, for which tree ensemble methods (tree boosting, random forests) usually show the best predictive performances. In this work, we propose a new sparse initialization technique for (potentially deep) multilayer perceptrons (MLP): we first train a tree-based procedure to detect feature interactions and use the resulting information to initialize the network, which is subsequently trained via standard stochastic gradient strategies. Numerical experiments on several tabular data sets show that this new, simple and easy-to-use method is a solid concurrent, both in terms of generalization capacity and computation time, to default MLP initialization and even to existing complex deep learning solutions. In fact, this wise MLP initialization raises the resulting NN methods to the level of a valid competitor to gradient boosting when dealing with tabular data. Besides, such initializations are able to preserve the sparsity of weights introduced in the first layers of the network through training. This fact suggests that this new initializer operates an implicit regularization during the NN training, and emphasizes that the first layers act as a sparse feature extractor (as for convolutional layers in CNN).


title: Diffusive limit approximation of pure jump optimal ergodic control problems

abstract: Motivated by the design of fast reinforcement learning algorithms, we study the diffusive limit of a class of pure jump ergodic stochastic control problems. We show that, whenever the intensity of jumps is large enough, the approximation error is governed by the H{\"o}lder continuity of the Hessian matrix of the solution to the limit ergodic partial differential equation. This extends to this context the results of [1] obtained for finite horizon problems. We also explain how to construct a first order error correction term under appropriate smoothness assumptions. Finally, we quantify the error induced by the use of the Markov control policy constructed from the numerical finite difference scheme associated to the limit diffusive problem, this seems to be new in the literature and of its own interest. This approach permits to reduce very significantly the numerical resolution cost.


title: QUAK: A Synthetic Quality Estimation Dataset for Korean-English Neural Machine Translation

abstract: With the recent advance in neural machine translation demonstrating its importance, research on quality estimation (QE) has been steadily progressing. QE aims to automatically predict the quality of machine translation (MT) output without reference sentences. Despite its high utility in the real world, there remain several limitations concerning manual QE data creation: inevitably incurred non-trivial costs due to the need for translation experts, and issues with data scaling and language expansion. To tackle these limitations, we present QUAK, a Korean-English synthetic QE dataset generated in a fully automatic manner. This consists of three sub-QUAK datasets QUAK-M, QUAK-P, and QUAK-H, produced through three strategies that are relatively free from language constraints. Since each strategy requires no human effort, which facilitates scalability, we scale our data up to 1.58M for QUAK-P, H and 6.58M for QUAK-M. As an experiment, we quantitatively analyze word-level QE results in various ways while performing statistical analysis. Moreover, we show that datasets scaled in an efficient way also contribute to performance improvements by observing meaningful performance gains in QUAK-M, P when adding data up to 1.58M.


title: A refined first-order expansion formula in Rn: Application to interpolation and finite element error estimates

abstract: The aim of this paper is to derive a refined first-order expansion formula in Rn, the goal being to get an optimal reduced remainder, compared to the one obtained by usual Taylor's formula. For a given function, the formula we derived is obtained by introducing a linear combination of the first derivatives, computed at $n+1$ equally spaced points. We show how this formula can be applied to two important applications: the interpolation error and the finite elements error estimates. In both cases, we illustrate under which conditions a significant improvement of the errors can be obtained, namely how the use of the refined expansion can reduce the upper bound of error estimates.


title: Verifiable and Energy Efficient Medical Image Analysis with Quantised Self-attentive Deep Neural Networks

abstract: Convolutional Neural Networks have played a significant role in various medical imaging tasks like classification and segmentation. They provide state-of-the-art performance compared to classical image processing algorithms. However, the major downside of these methods is the high computational complexity, reliance on high-performance hardware like GPUs and the inherent black-box nature of the model. In this paper, we propose quantised stand-alone self-attention based models as an alternative to traditional CNNs. In the proposed class of networks, convolutional layers are replaced with stand-alone self-attention layers, and the network parameters are quantised after training. We experimentally validate the performance of our method on classification and segmentation tasks. We observe a $50-80\%$ reduction in model size, $60-80\%$ lesser number of parameters, $40-85\%$ fewer FLOPs and $65-80\%$ more energy efficiency during inference on CPUs. The code will be available at \href {https://github.com/Rakshith2597/Quantised-Self-Attentive-Deep-Neural-Network}{https://github.com/Rakshith2597/Quantised-Self-Attentive-Deep-Neural-Network}.


title: A Survey: Implementations of Non-fungible Token System in Different Fields

abstract: In the realm of digital art and collectibles, NFTs are sweeping the board. Because of the massive sales to a new crypto audience, the livelihoods of digital artists are being transformed. It is no surprise that celebs are jumping on the bandwagon. It is a fact that NFTs can be used in multiple ways, including digital artwork such as animation, character design, digital painting, collection of selfies or vlogs, and many more digital entities. As a result, they may be used to signify the possession of any specific object, whether it be digital or physical. NFTs are digital tokens that may be used to indicate ownership of one of a-kind goods. For example, I can buy a shoe or T shirt from any store, and then if the store provides me the same 3D model of that T-Shirt or shoe of the exact same design and color, it would be more connected with my feelings. They enable us to tokenize items such as artwork, valuables, and even real estate. NFTs can only be owned by one person at a time, and they are protected by the Ethereum blockchain no one can alter the ownership record or create a new NFT. The word non-fungible can be used to describe items like your furniture, a song file, or your computer. It is impossible to substitute these goods with anything else because they each have their own distinct characteristics. The goal was to find all the existing implementations of Non-fungible Tokens in different fields of recent technology, so that an overall overview of future implementations of NFT can be found and how it can be used to enrich user experiences.


title: Methane sensing in the mid-IR using short wave IR photon counting detectors via non-linear interferometry

abstract: We demonstrate a novel MIR methane sensor shifting measurement wavelength to SWIR (1.55$\mu$m) by using non-linear interferometry. The technique exploits the interference effects seen in three-wave mixing when pump, signal, and idler modes make a double pass through a nonlinear crystal. The method allows sensing at wavelengths where detectors are poor ($>$3$\mu$m) and detection at wavelengths where photon counting sensitivity can be achieved. In a first experimental demonstration, we measured a small methane concentration inside a gas cell with high precision. This interferometer can be built in a compact design for field operations and potentially enable the detection of low concentrations of methane at up to 100m range. Signal-to-noise ratio calculations show that the method can outperform existing short wavelength ($\sim$1.65$\mu$m) integrated path differential absorption direct sensing at high ($>$$10^{-4}$) non-linear gain.


title: CDBB West Cambridge Digital Twin: Lessons Learned

abstract: The report describes the digital architecture developed for the West Cambridge Digital Twin, particularly focussed on real-time sensor data collection and analysis with a privacy framework allowing occupants of the buildings to be first-class participants in the system. The implementation has some notable characteristics. In particular 'push' technology is used throughout such that information streams from the incoming asynchronous individual sensor events through to the end-user web pages with the absolute minimum latency, including real-time generated simple and complex events derived from the the underlying sensor data and the updating of visualisations such as an in-building heatmap. We believe the ability of the entire system to respond in the timescale of individual sensor messages to be unique. JSON structures are used to represent all data types including sensor readings, sensor types, building objects, organisations and people, with the idea that JSON-LD may represent a more suitable way than XML/RDF for managing relations between those objects (such as the 'occupies' relationship of people to offices, or the 'type' relationship of sensors to sensor types).


title: Local power coupling as a predictor of high-gradient breakdown performance

abstract: A novel quantity for predicting the high-gradient performance of radio frequency accelerating structures is presented. The quantity is motivated, derived and compared with earlier high-gradient limits and experiments. This new method models a nascent RF breakdown as a current-carrying antenna and calculates the coupling of the antenna to an RF power source. With the help of an electron emission model to describe a nascent breakdown, the antenna model describes how a breakdown modifies the local surface electric field before it fully develops in any given structure geometry. For the structure geometries that this method was applied to, it was found that the calculated breakdown-loaded electric field was well-correlated with observed spatial breakdown distributions, and gave consistent values for the maximum breakdown-limited accelerating gradient between different geometries.


title: The Minority Matters: A Diversity-Promoting Collaborative Metric Learning Algorithm

abstract: Collaborative Metric Learning (CML) has recently emerged as a popular method in recommendation systems (RS), closing the gap between metric learning and Collaborative Filtering. Following the convention of RS, existing methods exploit unique user representation in their model design. This paper focuses on a challenging scenario where a user has multiple categories of interests. Under this setting, we argue that the unique user representation might induce preference bias, especially when the item category distribution is imbalanced. To address this issue, we propose a novel method called \textit{Diversity-Promoting Collaborative Metric Learning} (DPCML), with the hope of considering the commonly ignored minority interest of the user. The key idea behind DPCML is to include a multiple set of representations for each user in the system. Based on this embedding paradigm, user preference toward an item is aggregated from different embeddings by taking the minimum item-user distance among the user embedding set. Furthermore, we observe that the diversity of the embeddings for the same user also plays an essential role in the model. To this end, we propose a \textit{diversity control regularization} term to accommodate the multi-vector representation strategy better. Theoretically, we show that DPCML could generalize well to unseen test data by tackling the challenge of the annoying operation that comes from the minimum value. Experiments over a range of benchmark datasets speak to the efficacy of DPCML.


title: A Survey: Credit Sentiment Score Prediction

abstract: Manual approvals are still used by banks and other NGOs to approve loans. It takes time and is prone to mistakes because it is controlled by a bank employee. Several fields of machine learning mining technologies have been utilized to enhance various areas of credit rating forecast. A major goal of this research is to look at current sentiment analysis techniques that are being used to generate creditworthiness.


title: Raman Spectra of Titanium Carbide MXene from Machine-Learning Force Field Molecular Dynamics

abstract: MXenes represent one of the largest class of 2D materials with promising applications in many fields and their properties tunable by the surface group composition. Raman spectroscopy is expected to yield rich information about the surface composition, but the interpretation of measured spectra has proven challenging. The interpretation is usually done via comparison to simulated spectra, but there are large discrepancies between the experimental and earlier simulated spectra. In this work, we develop a computational approach to simulate Raman spectra of complex materials that combines machine-learning force-field molecular dynamics and reconstruction of Raman tensors via projection to pristine system modes. The approach can account for the effects of finite temperature, mixed surfaces, and disorder. We apply our approach to simulate Raman spectra of titanium carbide MXene and show that all these effects must be included in order to properly reproduce the experimental spectra, in particular the broad features. We discuss the origin of the peaks and how they evolve with surface composition, which can then be used to interpret experimental results.


title: X-ray performance of a customized large-format scientifc CMOS detector

abstract: In recent years, the performance of Scientifc Complementary Metal Oxide Semiconductor (sCMOS) sensors has been improved signifcantly. Compared with CCD sensors, sCMOS sensors have various advantages, making them potentially better devices for optical and X-ray detection, especially in time-domain astronomy. After a series of tests of sCMOS sensors, we proposed a new dedicated high-speed, large-format X-ray detector in 2016 cooperating with Gpixel Inc. This new sCMOS sensor has a physical size of 6 cm by 6 cm, with an array of 4096 by 4096 pixels and a pixel size of 15 um. The frame rate is 20.1 fps under current condition and can be boosted to a maximum value around 100 fps. The epitaxial thickness is increased to 10 um compared to the previous sCMOS product. We show the results of its frst taped-out product in this work. The dark current of this sCMOS is lower than 10 e/pixel/s at 20C, and lower than 0.02 e/pixel/s at -30C. The Fixed Pattern Noise (FPN) and the readout noise are lower than 5 e in high-gain situation and show a small increase at low temperature. The energy resolution reaches 180.1 eV (3.1%) at 5.90 keV for single-pixel events and 212.3 eV (3.6%) for all split events. The continuous X-ray spectrum measurement shows that this sensor is able to response to X-ray photons from 500 eV to 37 keV. The excellent performance, as demonstrated from these test results, makes sCMOS sensor an ideal detector for X-ray imaging and spectroscopic application.

categories: astro-ph.IM hep-ex nucl-ex physics.ins-det


title: Wake Word Detection Based on Res2Net

abstract: This letter proposes a new wake word detection system based on Res2Net. As a variant of ResNet, Res2Net was first applied to objection detection. Res2Net realizes multiple feature scales by increasing possible receptive fields. This multiple scaling mechanism significantly improves the detection ability of wake words with different durations. Compared with the ResNet-based model, Res2Net also significantly reduces the model size and is more suitable for detecting wake words. The proposed system can determine the positions of wake words from the audio stream without any additional assistance. The proposed method is verified on the Mobvoi dataset containing two wake words. At a false alarm rate of 0.5 per hour, the system reduced the false rejection of the two wake words by more than 12% over prior works.


title: Quantum electron liquid and its possible phase transition

abstract: Purely quantum electron systems exhibit intriguing correlated electronic phases by virtue of quantum fluctuations in addition to electron-electron interactions. To realize such quantum electron systems, a key ingredient is dense electrons decoupled from other degrees of freedom. Here, we report the discovery of a pure quantum electron liquid, which spreads up to ~ 3 {\AA} in the vacuum on the surface of electride crystal. An extremely high electron density and its weak hybridisation with buried atomic orbitals evidence the quantum and pure nature of electrons, that exhibit a polarized liquid phase as demonstrated by our spin-dependent measurement. Further, upon enhancing the electron correlation strength, the dynamics of quantum electrons changes to that of non-Fermi liquid along with an anomalous band deformation, suggestive of a transition to a hexatic liquid crystal phase. Our findings cultivate the frontier of quantum electron systems, and serve as a platform for exploring correlated electronic phases in a pure fashion.


title: GENESIS: Co-location of Geodetic Techniques in Space

abstract: Improving and homogenizing time and space reference systems on Earth and, more directly, realizing the Terrestrial Reference Frame (TRF) with an accuracy of 1mm and a long-term stability of 0.1mm/year are relevant for many scientific and societal endeavors. The knowledge of the TRF is fundamental for Earth and navigation sciences. For instance, quantifying sea level change strongly depends on an accurate determination of the geocenter motion but also of the positions of continental and island reference stations, as well as the ground stations of tracking networks. Also, numerous applications in geophysics require absolute millimeter precision from the reference frame, as for example monitoring tectonic motion or crustal deformation for predicting natural hazards. The TRF accuracy to be achieved represents the consensus of various authorities which has enunciated geodesy requirements for Earth sciences. Today we are still far from these ambitious accuracy and stability goals for the realization of the TRF. However, a combination and co-location of all four space geodetic techniques on one satellite platform can significantly contribute to achieving these goals. This is the purpose of the GENESIS mission, proposed as a component of the FutureNAV program of the European Space Agency. The GENESIS platform will be a dynamic space geodetic observatory carrying all the geodetic instruments referenced to one another through carefully calibrated space ties. The co-location of the techniques in space will solve the inconsistencies and biases between the different geodetic techniques in order to reach the TRF accuracy and stability goals endorsed by the various international authorities and the scientific community. The purpose of this white paper is to review the state-of-the-art and explain the benefits of the GENESIS mission in Earth sciences, navigation sciences and metrology.

categories: physics.ins-det astro-ph.EP astro-ph.IM physics.ao-ph physics.app-ph physics.geo-ph


title: Nonlinear dynamics and bifurcations of a planar undulating magnetic microswimmer

abstract: Swimming micro-organisms such as flagellated bacteria and sperm cells have fascinating locomotion capabilities. Inspired by their natural motion, there is an ongoing effort to develop artificial robotic nano-swimmers for potential in-body biomedical applications. A leading method for actuation of nano-swimmers is by applying a time-varying external magnetic field. Such systems have rich and nonlinear dynamics that calls for simple fundamental models. A previous work studied forward motion of a simple two-link model with passive elastic joint, assuming small-amplitude planar oscillations of the magnetic field about a constant direction. In this work, we found that there exists a faster, backward motion of the swimmer with very rich dynamics. By relaxing the small-amplitude assumption, we analyze the multiplicity of periodic solutions, as well as their bifurcations, symmetry breaking, and stability transitions. We have also found that the net displacement and/or mean swimming speed are maximized for optimal choices of various parameters. Asymptotic calculations are performed for the bifurcation condition and the swimmer's mean speed. The results may enable significantly improving the design aspects of magnetically-actuated robotic microswimmer.


title: Deterministic Performance Guarantees for Bidirectional BFS on Real-World Networks

abstract: A common technique to speed up shortest path queries in graphs is to use a bidirectional search, i.e., performing a forward search from the start and a backward search from the destination until a common vertex on a shortest path is found. In practice, this has a tremendous impact on the performance on some real-world networks, while it only seems to save a constant factor on other types of networks. Even though finding shortest paths is a ubiquitous problem, there are only few studies attempting to understand the apparently asymptotic speedups on some networks, using average case analysis on certain models for real-world networks. In this paper we give a new perspective on this, by analyzing deterministic properties that permit theoretical analysis and that can easily be checked on any particular instance. We prove that these parameters imply sublinear running time for the bidirectional breadth-first search in several regimes, some of which are tight. Moreover, we perform experiments on a large set of real-world networks showing that our parameters capture the concept of practical running time well.


title: Medical Question Understanding and Answering with Knowledge Grounding and Semantic Self-Supervision

abstract: Current medical question answering systems have difficulty processing long, detailed and informally worded questions submitted by patients, called Consumer Health Questions (CHQs). To address this issue, we introduce a medical question understanding and answering system with knowledge grounding and semantic self-supervision. Our system is a pipeline that first summarizes a long, medical, user-written question, using a supervised summarization loss. Then, our system performs a two-step retrieval to return answers. The system first matches the summarized user question with an FAQ from a trusted medical knowledge base, and then retrieves a fixed number of relevant sentences from the corresponding answer document. In the absence of labels for question matching or answer relevance, we design 3 novel, self-supervised and semantically-guided losses. We evaluate our model against two strong retrieval-based question answering baselines. Evaluators ask their own questions and rate the answers retrieved by our baselines and own system according to their relevance. They find that our system retrieves more relevant answers, while achieving speeds 20 times faster. Our self-supervised losses also help the summarizer achieve higher scores in ROUGE, as well as in human evaluation metrics. We release our code to encourage further research.


title: Enumeration of permutations by the parity of descent positions

abstract: Noticing that some recent variations of descent polynomials are special cases of Carlitz and Scoville's four-variable polynomials, which enumerate permutations by the parity of descent and ascent positions, we prove a $q$-analogue of Carlitz-Scoville's generating function by counting the inversion number and a type B analogue by enumerating the signed permutations with respect to the parity of desecnt and ascent positions. As a by-product of our formulas, we obtain a $q$-analogue of Chebikin's formula for alternating descent polynomials, an alternative proof of Sun's gamma-positivity of her bivariate Eulerian polynomials and a type B analogue, the latter refines Petersen's gamma-positivity of the type B Eulerian polynomials.


title: Validating and optimising mismatch tolerance of Doppler backscattering measurements with the beam model

abstract: We use the beam model of Doppler backscattering (DBS), which was previously derived from beam tracing and the reciprocity theorem, to shed light on mismatch attenuation. This attenuation of the backscattered signal occurs when the wavevector of the probe beam's electric field is not in the plane perpendicular to the magnetic field. Correcting for this effect is important for determining the amplitude of the actual density fluctuations. Previous preliminary comparisons between the model and Mega-Ampere Spherical Tokamak (MAST) plasmas were promising. In this work, we quantitatively account for this effect on DIII-D, a conventional tokamak. We compare the predicted and measured mismatch attenuation in various DIII-D, MAST, and MAST-U plasmas, showing that the beam model is applicable in a wide variety of situations. Finally, we performed a preliminary parameter sweep and found that the mismatch tolerance can be improved by optimising the probe beam's width and curvature at launch. This is potentially a design consideration for new DBS systems.


title: Hiding Visual Information via Obfuscating Adversarial Perturbations

abstract: Growing leakage and misuse of visual information raise security and privacy concerns, which promotes the development of information protection. Existing adversarial perturbations-based methods mainly focus on the de-identification against deep learning models. However, the inherent visual information of the data has not been well protected. In this work, inspired by the Type-I adversarial attack, we propose an adversarial visual information hiding method to protect the visual privacy of data. Specifically, the method generates obfuscating adversarial perturbations to obscure the visual information of the data. Meanwhile, it maintains the hidden objectives to be correctly predicted by models. In addition, our method does not modify the parameters of the applied model, which makes it flexible for different scenarios. Experimental results on the recognition and classification tasks demonstrate that the proposed method can effectively hide visual information and hardly affect the performances of models. The code is available in the supplementary material.


title: Proportionally Fair Online Allocation of Public Goods with Predictions

abstract: We design online algorithms for the fair allocation of public goods to a set of $N$ agents over a sequence of $T$ rounds and focus on improving their performance using predictions. In the basic model, a public good arrives in each round, the algorithm learns every agent's value for the good, and must irrevocably decide the amount of investment in the good without exceeding a total budget of $B$ across all rounds. The algorithm can utilize (potentially inaccurate) predictions of each agent's total value for all the goods to arrive. We measure the performance of the algorithm using a proportional fairness objective, which informally demands that every group of agents be rewarded in proportion to its size and the cohesiveness of its preferences. In the special case of binary agent preferences and a unit budget, we show that $O(\log N)$ proportional fairness can be achieved without using any predictions, and that this is optimal even if perfectly accurate predictions were available. However, for general preferences and budget no algorithm can achieve better than $\Theta(T/B)$ proportional fairness without predictions. We show that algorithms with (reasonably accurate) predictions can do much better, achieving $\Theta(\log (T/B))$ proportional fairness. We also extend this result to a general model in which a batch of $L$ public goods arrive in each round and achieve $O(\log (\min(N,L) \cdot T/B))$ proportional fairness. Our exact bounds are parametrized as a function of the error in the predictions and the performance degrades gracefully with increasing errors.


title: Preliminary Analysis of Skywave Effects on MF DGNSS R-Mode Signals During Daytime and Nighttime

abstract: Accurate positioning, navigation, and timing (PNT) performance are prerequisites for several technologies today. In a marine environment, it is difficult to visually identify one's position accurately, leading to safety concerns. Currently, PNT information is provided mainly from Global Navigation Satellite Systems (GNSS); however, it is vulnerable to radio frequency interference, spoofing, and ionospheric anomaly. Therefore, research on a backup system is needed. Ranging Mode (R-Mode), a terrestrial integrated navigation system, is being investigated for use in a marine environment. R-Mode is a positioning technology that integrates terrestrial signals of opportunity such as medium frequency (MF) differential GNSS (DGNSS), very high frequency (VHF) automatic identification system (AIS), and enhanced long-range navigation (eLoran) signals. Previous studies in Europe show that signals in the MF band differ greatly in accuracy between daytime and nighttime. This difference is primarily caused by skywave. In this study, the MF DGNSS R-Mode signal transmitted from Chungju, Korea was received in Daesan and Daejeon, Korea. The skywave effect during daytime and nighttime was compared and investigated. In addition, the continuous wave intensity of the R-Mode signal was increased during the nighttime to compare its effect on the measurement accuracy.


title: Local quantum uncertainty of a two-qubit XY Heisenberg model with different Dzyaloshinskii-Moriya couplings

abstract: This study investigates the local quantum uncertainty (LQU) of a two--qubit Heisenberg XY chain with different directions of Dzyaloshinskii--Moriya (DM) interactions. The DM interaction parameters and coupling coefficient $J$ are demonstrated to be beneficial in managing correlation. The DM interaction's x--axis parameter has more influence on correlation than the DM interaction's z--axis. As a result, adjusting the direction of the DM interaction may be capable of producing a more efficient operation to improve the correlation.


title: Effective Early Stopping of Point Cloud Neural Networks

abstract: Early stopping techniques can be utilized to decrease the time cost, however currently the ultimate goal of early stopping techniques is closely related to the accuracy upgrade or the ability of the neural network to generalize better on unseen data without being large or complex in structure and not directly with its efficiency. Time efficiency is a critical factor in neural networks, especially when dealing with the segmentation of 3D point cloud data, not only because a neural network itself is computationally expensive, but also because point clouds are large and noisy data, making learning processes even more costly. In this paper, we propose a new early stopping technique based on fundamental mathematics aiming to upgrade the trade-off between the learning efficiency and accuracy of neural networks dealing with 3D point clouds. Our results show that by employing our early stopping technique in four distinct and highly utilized neural networks in segmenting 3D point clouds, the training time efficiency of the models is greatly improved, with efficiency gain values reaching up to 94\%, while the models achieving in just a few epochs approximately similar segmentation accuracy metric values like the ones that are obtained in the training of the neural networks in 200 epochs. Also, our proposal outperforms four conventional early stopping approaches in segmentation accuracy, implying a promising innovative early stopping technique in point cloud segmentation.


title: NLO finite system size corrections to $2\to2$ scattering in $\phi^4$ theory using newly derived sum of sinc functions

abstract: Previously an equation of state for the relativistic hydrodynamics encountered in heavy-ion collisions at the LHC and RHIC has been calculated using lattice gauge theory methods. This leads to a prediction of very low viscosity, due to the calculated trace anomaly. Finite system corrections to this trace anomaly could challenge this calculation, since the lattice calculation was done in an effectively infinite system. In order to verify this trace anomaly it is sensible to add phenomenologically relevant finite system corrections. We investigate massive $\phi^4$ theory with periodic boundary conditions on $n$ of the 3 spatial dimensions. $2\to2$ NLO scattering is then computed. Using a newly derived formula for an arbitrary dimensional sum of sinc functions, we show that the NLO finite size corrections preserve unitarity.


title: Astroparticle and particle physics at ultra-high energy: results from the Pierre Auger Observatory

abstract: The scientific achievements of the Pierre Auger Collaboration cover diverse and complementary fields of research. The search for the origin of ultra-high energy cosmic rays (UHECRs) is based on the measurement of the energy spectrum and mass composition of the primaries, on studies of multi-messengers, and on extensive anisotropy searches. With the collected data it is also possible to explore the characteristics of hadronic interactions at energies unreachable at human-made accelerators, and to assess the existence of non-standard physics effects. A selection of the latest results is presented and the emerging picture is discussed.


title: Thermal quantum coherence of two-qutrit Heisenberg XXZ model with Herring-Flicker coupling and Dzyaloshinskii-Moriya interaction under magnetic field

abstract: In this study, we use the concept of $l_1$-norm coherence to characterize the entanglement of a two--qutrit Heisenberg XXZ model for subject to a uniform magnetic field and z--axis Dzyaloshinskii--Moriya interaction with Herring-Flicker coupling. We show the temperature, magnetic field, DM interaction, and distance of Herring-Flicker coupling all can control the entanglement. However, the state system becomes less entangled at high temperatures or strong magnetic fields and vice versa. Our findings also suggest that entanglement rises when the z--axis DM interaction increases. Moreover, by setting the strengths coupling of the spin, we quickly recover the isotropic XY and XXX Heisenberg models. Finally, Herring-Flicker coupling affects the degree of entanglement. In fact, when Herring-Flicker coupling and temperature are at small values, the degree of entanglement is at its highest. Still, when Herring-Flicker coupling is at substantial values, the degree of entanglement tends to stabilize.


title: Strings And Colorings Of Topological Coding Towards Asymmetric Topology Cryptography

abstract: We, for anti-quantum computing, will discuss various number-based strings, such as number-based super-strings, parameterized strings, set-based strings, graph-based strings, integer-partitioned and integer-decomposed strings, Hanzi-based strings, as well as algebraic operations based on number-based strings. Moreover, we introduce number-based string-colorings, magic-constraint colorings, and vector-colorings and set-colorings related with strings. For the technique of encrypting the entire network at once, we propose graphic lattices related with number-based strings, Hanzi-graphic lattices, string groups, all-tree-graphic lattices. We study some topics of asymmetric topology cryptography, such as topological signatures, Key-pair graphs, Key-pair strings, one-encryption one-time and self-certification algorithms. Part of topological techniques and algorithms introduced here are closely related with NP-complete problems or NP-hard problems.


title: Hyperon Physics at BESIII

abstract: Spin polarization and entanglement are utilized by the BESIII experiment to learn more about the production and decay properties of hyperon-antihyperon pairs in a series of recent analyses of its unprecedented datasets at the $J/\psi$ and $\psi'$ resonances. This has lead to the observation of significant transverse polarisation in decays of $J/\psi$ or $\psi'$ into $\Lambda \bar{\Lambda}$, $\Sigma \bar{\Sigma}$, $\Xi \bar{\Xi}$, and $\Omega \bar{\Omega}$. Because of the non-zero polarization, the decay parameters for the most common hadronic weak decays of both hyperons and antihyperons could be determined independently for the first time. Comparing these to each other yields precise tests of direct, $\Delta S = 1$ CP-violation that complement measurements of kaon decays.


title: Did You Get What You Paid For? Rethinking Annotation Cost of Deep Learning Based Computer Aided Detection in Chest Radiographs

abstract: As deep networks require large amounts of accurately labeled training data, a strategy to collect sufficiently large and accurate annotations is as important as innovations in recognition methods. This is especially true for building Computer Aided Detection (CAD) systems for chest X-rays where domain expertise of radiologists is required to annotate the presence and location of abnormalities on X-ray images. However, there lacks concrete evidence that provides guidance on how much resource to allocate for data annotation such that the resulting CAD system reaches desired performance. Without this knowledge, practitioners often fall back to the strategy of collecting as much detail as possible on as much data as possible which is cost inefficient. In this work, we investigate how the cost of data annotation ultimately impacts the CAD model performance on classification and segmentation of chest abnormalities in frontal-view X-ray images. We define the cost of annotation with respect to the following three dimensions: quantity, quality and granularity of labels. Throughout this study, we isolate the impact of each dimension on the resulting CAD model performance on detecting 10 chest abnormalities in X-rays. On a large scale training data with over 120K X-ray images with gold-standard annotations, we find that cost-efficient annotations provide great value when collected in large amounts and lead to competitive performance when compared to models trained with only gold-standard annotations. We also find that combining large amounts of cost efficient annotations with only small amounts of expensive labels leads to competitive CAD models at a much lower cost.


title: FusionRetro: Molecule Representation Fusion via In-Context Learning for Retrosynthetic Planning

abstract: Retrosynthetic planning aims to devise a complete multi-step synthetic route from starting materials to a target molecule. Current strategies use a decoupled approach of single-step retrosynthesis models and search algorithms, taking only the product as the input to predict the reactants for each planning step and ignoring valuable context information along the synthetic route. In this work, we propose a novel framework that utilizes context information for improved retrosynthetic planning. We view synthetic routes as reaction graphs and propose to incorporate context through three principled steps: encode molecules into embeddings, aggregate information over routes, and readout to predict reactants. Our approach is the first attempt to utilize in-context learning for retrosynthesis prediction in retrosynthetic planning. The entire framework can be efficiently optimized in an end-to-end fashion and produce more practical and accurate predictions. Comprehensive experiments demonstrate that by fusing in the context information over routes, our model significantly improves the performance of retrosynthetic planning over baselines that are not context-aware, especially for long synthetic routes. Code is available at https://github.com/SongtaoLiu0823/FusionRetro.


title: Uniqueness in an inverse problem of fractional elasticity

abstract: We study an inverse problem for fractional elasticity. In analogy to the classical problem of linear elasticity, we consider the unique recovery of the Lam\'e parameters associated to a linear, isotropic fractional elasticity operator from fractional Dirichlet-to-Neumann data. In our analysis we make use of a fractional matrix Schr\"odinger equation via a generalization of the so-called Liouville reduction, a technique classically used in the study of the scalar conductivity equation. We conclude that unique recovery is possible if the Lam\'e parameters agree and are constant in the exterior, and their Poisson ratios agree everywhere. Our study is motivated by the significant recent activity in the field of nonlocal elasticity.


title: Convolutional Neural Networks Quantization with Attention

abstract: It has been proven that, compared to using 32-bit floating-point numbers in the training phase, Deep Convolutional Neural Networks (DCNNs) can operate with low precision during inference, thereby saving memory space and power consumption. However, quantizing networks is always accompanied by an accuracy decrease. Here, we propose a method, double-stage Squeeze-and-Threshold (double-stage ST). It uses the attention mechanism to quantize networks and achieve state-of-art results. Using our method, the 3-bit model can achieve accuracy that exceeds the accuracy of the full-precision baseline model. The proposed double-stage ST activation quantization is easy to apply: inserting it before the convolution.


title: Extensions on `A Convex Scheme for the Secrecy Capacity of a MIMO Wiretap Channel with a Single Antenna Eavesdropper'

abstract: One key metric for physical layer security is the secrecy capacity. This is the maximum rate that a system can transmit with perfect secrecy. For a Multiple Input Multiple Output (MIMO) system (a newer technology for 5G, 6G and beyond) the secrecy capacity is not fully understood. For a Gaussian MIMO channel, the secrecy capacity is a non-convex optimisation problem for which a general solution is not available. Previous work by the authors showed that the secrecy capacity of a MIMO system with a single eavesdrop antenna is concave to a cut off point. In this work, which extends the previous paper, results are given for the region beyond this cut off point. It is shown that, for certain parameters, the presented scheme is concave to a point, and convex beyond it, and can therefore be solved efficiently using existing convex optimisation software.


title: Hidden jerk in universal creep and aftershocks

abstract: Most materials exhibit creep memory under the action of a constant load. The memory behavior is governed by Andrade's creep law, which also has an inherent connection with the Omori-Utsu law of earthquake aftershocks. Both empirical laws lack a deterministic interpretation. Coincidentally, the Andrade law is similar to the time-varying part of the creep compliance of the fractional dashpot in anomalous viscoelastic modeling. Consequently, fractional derivatives are invoked, but since they lack a physical interpretation, the physical parameters of the two laws extracted from curve fit lack confidence. In this Letter, we establish an analogous linear physical mechanism that underlies both laws and relates its parameters with the material's macroscopic properties. Surprisingly, the explanation does not require the property of viscosity. Instead, it necessitates the existence of a rheological property that relates strain with the first order time derivative of stress, which involves jerk. Further, we justify the constant quality factor model of acoustic attenuation in complex media. The obtained results are validated in light of the established observations.


title: Bounded Robustness in Reinforcement Learning via Lexicographic Objectives

abstract: Policy robustness in Reinforcement Learning may not be desirable at any cost: the alterations caused by robustness requirements from otherwise optimal policies should be explainable, quantifiable and formally verifiable. In this work we study how policies can be maximally robust to arbitrary observational noise by analysing how they are altered by this noise through a stochastic linear operator interpretation of the disturbances, and establish connections between robustness and properties of the noise kernel and of the underlying MDPs. Then, we construct sufficient conditions for policy robustness, and propose a robustness-inducing scheme, applicable to any policy gradient algorithm, that formally trades off expected policy utility for robustness through lexicographic optimisation, while preserving convergence and sub-optimality in the policy synthesis.


title: Leveraging variational autoencoders for multiple data imputation

abstract: Missing data persists as a major barrier to data analysis across numerous applications. Recently, deep generative models have been used for imputation of missing data, motivated by their ability to capture highly non-linear and complex relationships in the data. In this work, we investigate the ability of deep models, namely variational autoencoders (VAEs), to account for uncertainty in missing data through multiple imputation strategies. We find that VAEs provide poor empirical coverage of missing data, with underestimation and overconfident imputations, particularly for more extreme missing data values. To overcome this, we employ $\beta$-VAEs, which viewed from a generalized Bayes framework, provide robustness to model misspecification. Assigning a good value of $\beta$ is critical for uncertainty calibration and we demonstrate how this can be achieved using cross-validation. In downstream tasks, we show how multiple imputation with $\beta$-VAEs can avoid false discoveries that arise as artefacts of imputation.


title: Wi-attack: Cross-technology Impersonation Attack against iBeacon Services

abstract: iBeacon protocol is widely deployed to provide location-based services. By receiving its BLE advertisements, nearby devices can estimate the proximity to the iBeacon or calculate indoor positions. However, the open nature of these advertisements brings vulnerability to impersonation attacks. Such attacks could lead to spam, unreliable positioning, and even security breaches. In this paper, we propose Wi-attack, revealing the feasibility of using WiFi devices to conduct impersonation attacks on iBeacon services. Different from impersonation attacks using BLE compatible hardware, Wi-attack is not restricted by broadcasting intervals and is able to impersonate multiple iBeacons at the same time. Effective attacks can be launched on iBeacon services without modifications to WiFi hardware or firmware. To enable direct communication from WiFi to BLE, we use the digital emulation technique of cross technology communication. To enhance the packet reception along with its stability, we add redundant packets to eliminate cyclic prefix error entirely. The emulation provides an iBeacon packet reception rate up to 66.2%. We conduct attacks on three iBeacon services scenarios, point deployment, multilateration, and fingerprint-based localization. The evaluation results show that Wi-attack can bring an average distance error of more than 20 meters on fingerprint-based localization using only 3 APs.


title: SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation

abstract: Recent advances in image captioning have focused on scaling the data and model size, substantially increasing the cost of pre-training and finetuning. As an alternative to large models, we present SmallCap, which generates a caption conditioned on an input image and related captions retrieved from a datastore. Our model is lightweight and fast to train, as the only learned parameters are in newly introduced cross-attention layers between a pre-trained CLIP encoder and GPT-2 decoder. SmallCap can transfer to new domains without additional finetuning and can exploit large-scale data in a training-free fashion since the contents of the datastore can be readily replaced. Our experiments show that SmallCap, trained only on COCO, has competitive performance on this benchmark, and also transfers to other domains without retraining, solely through retrieval from target-domain data. Further improvement is achieved through the training-free exploitation of diverse human-labeled and web data, which proves to be effective for a range of domains, including the nocaps benchmark, designed to test generalization to unseen visual concepts.


title: Dirac inequality for highest weight Harish-Chandra modules I

abstract: Let $G$ be a connected simply connected noncompact classical simple Lie group of Hermitian type. Then $G$ has unitary highest weight representations. The proof of the classification of unitary highest weight representations of $G$ given by Enright, Howe and Wallach is based on the Dirac inequality of Parthasarathy, Jantzen's formula and Howe's theory of dual pairs where one group in the pair is compact. In this paper we focus on the Dirac inequality which can be used to prove the classification in a more direct way.


title: Symphony: Localizing Multiple Acoustic Sources with a Single Microphone Array

abstract: Sound recognition is an important and popular function of smart devices. The location of sound is basic information associated with the acoustic source. Apart from sound recognition, whether the acoustic sources can be localized largely affects the capability and quality of the smart device's interactive functions. In this work, we study the problem of concurrently localizing multiple acoustic sources with a smart device (e.g., a smart speaker like Amazon Alexa). The existing approaches either can only localize a single source, or require deploying a distributed network of microphone arrays to function. Our proposal called Symphony is the first approach to tackle the above problem with a single microphone array. The insight behind Symphony is that the geometric layout of microphones on the array determines the unique relationship among signals from the same source along the same arriving path, while the source's location determines the DoAs (direction-of-arrival) of signals along different arriving paths. Symphony therefore includes a geometry-based filtering module to distinguish signals from different sources along different paths and a coherence-based module to identify signals from the same source. We implement Symphony with different types of commercial off-the-shelf microphone arrays and evaluate its performance under different settings. The results show that Symphony has a median localization error of 0.694m, which is 68% less than that of the state-of-the-art approach.


title: Simultaneous ground-state cooling of two mechanical modes of a levitated nanoparticle

abstract: The quantum ground state of a massive mechanical system is a steppingstone for investigating macroscopic quantum states and building high fidelity sensors. With the recent achievement of ground-state cooling of a single motional mode, levitated nanoparticles have entered the quantum domain. To overcome detrimental cross-coupling and decoherence effects, quantum control needs to be expanded to more system dimensions, but the effect of a decoupled dark mode has thus far hindered cavity-based ground state cooling of multiple mechanical modes. Here, we demonstrate two-dimensional (2D) ground-state cooling of an optically levitated nanoparticle. Utilising coherent scattering into an optical cavity mode, we reduce the occupation numbers of two separate centre-of-mass modes to 0.83 and 0.81, respectively. By controlling the frequency separation and the cavity coupling strengths of the nanoparticle's mechanical modes, we show the transition from 1D to 2D ground-state cooling while avoiding the effect of dark modes. Our results lay the foundations for generating quantum-limited high orbital angular momentum states with applications in rotation sensing. The demonstrated 2D control, combined with already shown capabilities of ground-state cooling along the third motional axis, opens the door for full 3D ground-state cooling of a massive object.


title: Design, Construction and Commissioning of a Technological Prototype of a Highly Granular SiPM-on-tile Scintillator-Steel Hadronic Calorimeter

abstract: The CALICE collaboration is developing highly granular electromagnetic and hadronic calorimeters for detectors at future energy frontier electron-positron colliders. After successful tests of a physics prototype, a technological prototype of the Analog Hadron Calorimeter has been built, based on a design and construction techniques scalable to a collider detector. The prototype consists of a steel absorber structure and active layers of small scintillator tiles that are individually read out by directly coupled SiPMs. Each layer has an active area of $72 \times 72\,{\rm cm}^{2}$ and a tile size of $3 \times 3\,{\rm cm}^{2}$. With $38$ active layers, the prototype has nearly $22,000$ readout channels, and its total thickness amounts to $4.4$ nuclear interaction lengths. The dedicated readout electronics provide time stamping of each hit with an expected resolution of about $1\,{\rm ns}$. The prototype was constructed in 2017 and commissioned in beam tests at DESY. It recorded muons, hadron showers and electron showers at different energies in test beams at CERN in 2018. In this paper, the design of the prototype, its construction and commissioning are described. The methods used to calibrate the detector are detailed, and the performance achieved in terms of uniformity and stability is presented.


title: Sparse Random Networks for Communication-Efficient Federated Learning

abstract: One main challenge in federated learning is the large communication cost of exchanging weight updates from clients to the server at each round. While prior work has made great progress in compressing the weight updates through gradient compression methods, we propose a radically different approach that does not update the weights at all. Instead, our method freezes the weights at their initial \emph{random} values and learns how to sparsify the random network for the best performance. To this end, the clients collaborate in training a \emph{stochastic} binary mask to find the optimal sparse random network within the original one. At the end of the training, the final model is a sparse network with random weights -- or a subnetwork inside the dense random network. We show improvements in accuracy, communication (less than $1$ bit per parameter (bpp)), convergence speed, and final model size (less than $1$ bpp) over relevant baselines on MNIST, EMNIST, CIFAR-10, and CIFAR-100 datasets, in the low bitrate regime under various system configurations.


title: SpeechLM: Enhanced Speech Pre-Training with Unpaired Textual Data

abstract: How to boost speech pre-training with textual data is an unsolved problem due to the fact that speech and text are very different modalities with distinct characteristics. In this paper, we propose a cross-modal Speech and Language Model (SpeechLM) to explicitly align speech and text pre-training with a pre-defined unified discrete representation. Specifically, we introduce two alternative discrete tokenizers to bridge the speech and text modalities, including phoneme-unit and hidden-unit tokenizers, which can be trained using a small amount of paired speech-text data. Based on the trained tokenizers, we convert the unlabeled speech and text data into tokens of phoneme units or hidden units. The pre-training objective is designed to unify the speech and the text into the same discrete semantic space with a unified Transformer network. We evaluate SpeechLM on various spoken language processing tasks including speech recognition, speech translation, and universal representation evaluation framework SUPERB, demonstrating significant improvements on content-related tasks. Code and models are available at https://aka.ms/SpeechLM.


title: New Perspectives on Spontaneous Scalarization in Black Holes and Neutron Stars

abstract: Although general relativity passes all precision tests to date, there are several reasons to go beyond the current model of gravitation and search for new fundamental physics. This means looking for new, so far undetected, fields. Scalars are the easiest fields to consider and they are ubiquitous in both extensions of the Standard Model and in alternative theories of gravity. That is why a lot of attention has been drawn towards the investigation of scalar-tensor theories, where gravity is described by both the metric tensor and a scalar field. A particularly interesting phenomenon that has recently gained increasing interest is spontaneous scalarization. In gravity theories that exhibit this mechanism, astrophysical objects are identical to their general relativistic counterpart until they reach a specific threshold, usually either in compactness, curvature or, as recently shown, in spin. Beyond this threshold, they acquire a nontrivial scalar configuration, which also affects their structure. In this thesis, we focus on the study of this mechanism in generalized scalar-tensor theories. We identify a minimal action that contains all of the terms that can potentially trigger spontaneous scalarization. We first focus on the onset of scalarization in this specific theory and determine the relevant thresholds in terms of the contributing coupling constants and the properties of the compact object. Finally, we study the effect of this model on the properties of both scalarized black holes and neutron stars, such as affecting their domain of existence or the amount of scalar charge they carry.