title: Design and Optimization of Gregorian-based Reflector Systems for THz Imaging System Optics

abstract: Application of reflector antenna configurations in designing the optical section of terahertz imaging systems has attracted great attention during recent years. Advantages of reflective optics in comparison with refractive optics is one of the main reasons for this trend. Specular reflection in broad spectral range, no or little reflection and transmission loss, no chromatic aberration, high reliability in high power applications and even cancellation of off-axis aberrations as a result of precise optimized configuration are just some of these advantages. Moreover, utilizing novel satellite communication reflector antenna systems in an optical section of imaging systems has improved many imaging performance factors and provided a reliable platform for different imaging objectives. In this paper, we will design a Gregorian-based reflector antenna system for the optical section of terahertz imaging systems and using optical techniques, we optimize the structure for optimum imaging performance.


title: Temperature-dependent thermal transport of single molecular junctions from semi-classical Langevin molecular dynamics

abstract: Thermal conductance of single molecular junctions at room temperature has been measured recently using picowatt-resolution scanning probes. However, fully understanding thermal transport in a much wider temperature range is needed for the exploration of energy transfer at single-molecular limit and the development of single-molecular devices. Here, employing a semiclassical Langevin molecular dynamics method, a comparative study is performed on the thermal transport of an alkane chain between Au and graphene electrodes, respectively. We illustrate the different roles of quantum statistics and anharmonic interaction in the two types of junctions. For a graphene junction, quantum statistics is essential at room temperature, while the anharmonic interaction is negligible. For a Au junction, it is the other way. Our study paves the way for theoretically understanding thermal transport of realistic single-molecular junctions in the full temperature range by including both quantum statistics and anharmonic interaction within one theoretical framework.


title: Adversarial Graph Contrastive Learning with Information Regularization

abstract: Contrastive learning is an effective unsupervised method in graph representation learning. Recently, the data augmentation based contrastive learning method has been extended from images to graphs. However, most prior works are directly adapted from the models designed for images. Unlike the data augmentation on images, the data augmentation on graphs is far less intuitive and much harder to provide high-quality contrastive samples, which are the key to the performance of contrastive learning models. This leaves much space for improvement over the existing graph contrastive learning frameworks. In this work, by introducing an adversarial graph view and an information regularizer, we propose a simple but effective method, Adversarial Graph Contrastive Learning (ARIEL), to extract informative contrastive samples within a reasonable constraint. It consistently outperforms the current graph contrastive learning methods in the node classification task over various real-world datasets and further improves the robustness of graph contrastive learning. The code is at https://github.com/Shengyu-Feng/ARIEL.


title: Polynomial $\alpha$-attractors

abstract: Inflationary $\alpha$-attractor models can be naturally implemented in supergravity with hyperbolic geometry. They have stable predictions for observables, such as $n_s=1-{2/ N_e} $, assuming that the potential in terms of the original geometric variables, as well as its derivatives, are not singular at the boundary of the hyperbolic disk, or half-plane. In these models, the potential in the canonically normalized inflaton field $\varphi$ has a plateau, which is approached exponentially fast at large $\varphi$. We call them exponential $\alpha$-attractors. We present a closely related class of models, where the potential is not singular, but its derivative is singular at the boundary. The resulting inflaton potential is also a plateau potential, but it approaches the plateau polynomially. We call them polynomial $\alpha$-attractors. Predictions of these two families of attractors completely cover the sweet spot of the Planck/BICEP/Keck data. The exponential ones are on the left, the polynomial are on the right.


title: FLHub: a Federated Learning model sharing service

abstract: As easy-to-use deep learning libraries such as Tensorflow and Pytorch are popular, it has become convenient to develop machine learning models. Due to privacy issues with centralized machine learning, recently, federated learning in the distributed computing framework is attracting attention. The central server does not collect sensitive and personal data from clients in federated learning, but it only aggregates the model parameters. Though federated learning helps protect privacy, it is difficult for machine learning developers to share the models that they could utilize for different-domain applications. In this paper, we propose a federated learning model sharing service named Federated Learning Hub (FLHub). Users can upload, download, and contribute the model developed by other developers similarly to GitHub. We demonstrate that a forked model can finish training faster than the existing model and that learning progressed more quickly for each federated round.


title: BROOK Dataset: A Playground for Exploiting Data-Driven Techniques in Human-Vehicle Interactive Designs

abstract: Emerging Autonomous Vehicles (AV) breed great potentials to exploit data-driven techniques for adaptive and personalized Human-Vehicle Interactions. However, the lack of high-quality and rich data supports limits the opportunities to explore the design space of data-driven techniques, and validate the effectiveness of concrete mechanisms. Our goal is to initialize the efforts to deliver the building block for exploring data-driven Human-Vehicle Interaction designs. To this end, we present BROOK dataset, a multi-modal dataset with facial video records. We first brief our rationales to build BROOK dataset. Then, we elaborate how to build the current version of BROOK dataset via a year-long study, and give an overview of the dataset. Next, we present three example studies using BROOK to justify the applicability of BROOK dataset. We also identify key learning lessons from building BROOK dataset, and discuss about how BROOK dataset can foster an extensive amount of follow-up studies.


title: HUT: Enabling High-UTility, Batched Queries under Differential Privacy Protection for Internet-of-Vehicles

abstract: The emerging trends of Internet-of-Vehicles (IoV) demand centralized servers to collect/process sensitive data with limited computational resources on a single vehicle. Such centralizations of sensitive data demand practical privacy protections. One widely-applied paradigm, Differential Privacy, can provide strong guarantees over sensitive data by adding noises. However, directly applying DP for IoV incurs significant challenges for data utility and effective protection. We observe that the key issue about DP-enabled protection in IoV lies in how to synergistically combine DP with special characteristics of IoV, whose query sequences are usually formed as unbalanced batches due to frequent interactions between centralized servers and edge vehicles. To this end, we propose HUT, a new algorithm to enable High UTility for DP-enabled protection in IoV. Our key insight is to leverage the inherent characteristics in IoV: the unbalanced batches. Our key idea is to aggregate local batches and apply Order Constraints, so that information loss from DP protection can be mitigated. We evaluate the effectiveness of HUT against the state-of-the-art DP protection mechanisms. The results show that HUT can provide much lower information loss by 95.69\% and simultaneously enable strong mathematically-guaranteed protection over sensitive data.


title: NEDMP: Neural Enhanced Dynamic Message Passing

abstract: Predicting stochastic spreading processes on complex networks is critical in epidemic control, opinion propagation, and viral marketing. We focus on the problem of inferring the time-dependent marginal probabilities of states for each node which collectively quantifies the spreading results. Dynamic Message Passing (DMP) has been developed as an efficient inference algorithm for several spreading models, and it is asymptotically exact on locally tree-like networks. However, DMP can struggle in diffusion networks with lots of local loops. We address this limitation by using Graph Neural Networks (GNN) to learn the dependency amongst messages implicitly. Specifically, we propose a hybrid model in which the GNN module runs jointly with DMP equations. The GNN module refines the aggregated messages in DMP iterations by learning from simulation data. We demonstrate numerically that after training, our model's inference accuracy substantially outperforms DMP in conditions of various network structure and dynamics parameters. Moreover, compared to pure data-driven models, the proposed hybrid model has a better generalization ability for out-of-training cases, profiting from the explicitly utilized dynamics priors in the hybrid model. A PyTorch implementation of our model is at https://github.com/FeiGSSS/NEDMP.


title: Universal and Efficient p-Doping of Organic Semiconductors by Electrophilic Attack of Cations

abstract: Doping is of great importance to tailor the electrical properties of semiconductors. However, the present doping methodologies for organic semiconductors (OSCs) are either inefficient or can only apply to a small number of OSCs, seriously limiting their general application. Herein, we reveal a novel p-doping mechanism by investigating the interactions between the dopant trityl cation and poly(3-hexylthiophene) (P3HT). It is found that electrophilic attack of the trityl cations on thiophenes results in the formation of alkylated ions that induce electron transfer from neighboring P3HT chains, resulting in p-doping. This unique p-doping mechanism can be employed to dope various OSCs including those with high ionization energy (IE=5.8 eV). Moreover, this doping mechanism endows trityl cation with strong doping ability, leading to polaron yielding efficiency of 100 % and doping efficiency of over 80 % in P3HT. The discovery and elucidation of this novel doping mechanism not only points out that strong electrophiles are a class of efficient p-dopants for OSCs, but also provides new opportunities towards highly efficient doping of OSCs.


title: Task-Adaptive Feature Transformer with Semantic Enrichment for Few-Shot Segmentation

abstract: Few-shot learning allows machines to classify novel classes using only a few labeled samples. Recently, few-shot segmentation aiming at semantic segmentation on low sample data has also seen great interest. In this paper, we propose a learnable module that can be placed on top of existing segmentation networks for performing few-shot segmentation. This module, called the task-adaptive feature transformer (TAFT), linearly transforms task-specific high-level features to a set of task agnostic features well-suited to conducting few-shot segmentation. The task-conditioned feature transformation allows an effective utilization of the semantic information in novel classes to generate tight segmentation masks. We also propose a semantic enrichment (SE) module that utilizes a pixel-wise attention module for high-level feature and an auxiliary loss from an auxiliary segmentation network conducting the semantic segmentation for all training classes. Experiments on PASCAL-$5^i$ and COCO-$20^i$ datasets confirm that the added modules successfully extend the capability of existing segmentators to yield highly competitive few-shot segmentation performances.


title: Real World Large Scale Recommendation Systems Reproducibility and Smooth Activations

abstract: Real world recommendation systems influence a constantly growing set of domains. With deep networks, that now drive such systems, recommendations have been more relevant to the user's interests and tasks. However, they may not always be reproducible even if produced by the same system for the same user, recommendation sequence, request, or query. This problem received almost no attention in academic publications, but is, in fact, very realistic and critical in real production systems. We consider reproducibility of real large scale deep models, whose predictions determine such recommendations. We demonstrate that the celebrated Rectified Linear Unit (ReLU) activation, used in deep models, can be a major contributor to irreproducibility. We propose the use of smooth activations to improve recommendation reproducibility. We describe a novel family of smooth activations; Smooth ReLU (SmeLU), designed to improve reproducibility with mathematical simplicity, with potentially cheaper implementation. SmeLU is a member of a wider family of smooth activations. While other techniques that improve reproducibility in real systems usually come at accuracy costs, smooth activations not only improve reproducibility, but can even give accuracy gains. We report metrics from real systems in which we were able to productionalize SmeLU with substantial reproducibility gains and better accuracy-reproducibility trade-offs. These include click-through-rate (CTR) prediction systems, content, and application recommendation systems.


title: A note on the topological stability theorem from RCD spaces to Riemannian manifolds

abstract: Inspired by a recent work of Wang-Zhao, in this note we prove that for a fixed $n$-dimensional closed Riemannian manifold $(M^n, g)$, if an $\mathrm{RCD}(K, n)$ space $(X, \mathsf{d}, \mathfrak{m})$ is Gromov-Hausdorff close to $M^n$, then there exists a regular homeomorphism $F$ from $X$ to $M^n$ such that $F$ is Lipschitz continuous and that $F^{-1}$ is H\"older continuous, where the Lipschitz constant of $F$, the H\"older exponent and the H\"older constant of $F^{-1}$ can be chosen arbitrary close to $1$. This is sharp in the sense that in general such a map cannot be improved to being bi-Lipschitz. Moreover if $X$ is smooth, then such a homeomorphism can be chosen as a diffeomorphism. It is worth mentioning that the Lipschitz-H\"older continuity of $F$ improves the intrinsic Reifenberg theorem for closed manifolds with Ricci curvature bounded below established by Cheeger-Colding. The Nash embedding theorem plays a key role in the proof.


title: Gradient models of moving heat sources for powder bed fusion applications

abstract: In this paper, we derive closed form solutions for the quasi-stationary problems of moving heat sources within the gradient theory of heat transfer. This theory can be formally deduced from the two-temperature model and it can be treated as a generalized variant of the Guyer-Krumhansl model with the fourth order governing equation. We show that considered variant of the gradient theory allows to obtain a useful singularity-free solutions for the moving point and line heat sources that can be used for the refined analysis of the melt pool shape in the laser powder bed fusion processes. Derived solutions contain single additional length scale parameter that can be related to the mean particles size of the powder bed. Namely, we show that developed gradient models allow to describe the decrease of the melt pool depth with the increase of the powder's particles size that was observed previously in the experiments. We also derive the dimensionless relations that can be used for the experimental identification of the model's length scale parameter for different materials. Semi-analytical solution for the Gaussian laser beam is also derived and studied based on the Green function method within the considered theory.


title: Joint Modeling and Prediction of Massive Spatio-Temporal Wildfire Count and Burnt Area Data with the INLA-SPDE Approach

abstract: This paper describes the methodology used by the team RedSea in the data competition organized for EVA 2021 conference. We develop a novel two-part model to jointly describe the wildfire count data and burnt area data provided by the competition organizers with covariates. Our proposed methodology relies on the integrated nested Laplace approximation combined with the stochastic partial differential equation (INLA-SPDE) approach. In the first part, a binary non-stationary spatio-temporal model is used to describe the underlying process that determines whether or not there is wildfire at a specific time and location. In the second part, we consider a non-stationary model that is based on log-Gaussian Cox processes for positive wildfire count data, and a non-stationary log-Gaussian model for positive burnt area data. Dependence between the positive count data and positive burnt area data is captured by a shared spatio-temporal random effect. Our two-part modeling approach performs well in terms of the prediction score criterion chosen by the data competition organizers. Moreover, our model results show that surface pressure is the most influential driver for the occurrence of a wildfire, whilst surface net solar radiation and surface pressure are the key drivers for large numbers of wildfires, and temperature and evaporation are the key drivers of large burnt areas.


title: Adaptive Graph Convolutional Networks for Weakly Supervised Anomaly Detection in Videos

abstract: For weakly supervised anomaly detection, most existing work is limited to the problem of inadequate video representation due to the inability of modeling long-term contextual information. To solve this, we propose a novel weakly supervised adaptive graph convolutional network (WAGCN) to model the complex contextual relationship among video segments. By which, we fully consider the influence of other video segments on the current one when generating the anomaly probability score for each segment. Firstly, we combine the temporal consistency as well as feature similarity of video segments to construct a global graph, which makes full use of the association information among spatial-temporal features of anomalous events in videos. Secondly, we propose a graph learning layer in order to break the limitation of setting topology manually, which can extract graph adjacency matrix based on data adaptively and effectively. Extensive experiments on two public datasets (i.e., UCF-Crime dataset and ShanghaiTech dataset) demonstrate the effectiveness of our approach which achieves state-of-the-art performance.


title: Analytic Learning of Convolutional Neural Network For Pattern Recognition

abstract: Training convolutional neural networks (CNNs) with back-propagation (BP) is time-consuming and resource-intensive particularly in view of the need to visit the dataset multiple times. In contrast, analytic learning attempts to obtain the weights in one epoch. However, existing attempts to analytic learning considered only the multilayer perceptron (MLP). In this article, we propose an analytic convolutional neural network learning (ACnnL). Theoretically we show that ACnnL builds a closed-form solution similar to its MLP counterpart, but differs in their regularization constraints. Consequently, we are able to answer to a certain extent why CNNs usually generalize better than MLPs from the implicit regularization point of view. The ACnnL is validated by conducting classification tasks on several benchmark datasets. It is encouraging that the ACnnL trains CNNs in a significantly fast manner with reasonably close prediction accuracies to those using BP. Moreover, our experiments disclose a unique advantage of ACnnL under the small-sample scenario when training data are scarce or expensive.


title: Opinions Vary? Diagnosis First!

abstract: With the advancement of deep learning techniques, an increasing number of methods have been proposed for optic disc and cup (OD/OC) segmentation from the fundus images. Clinically, OD/OC segmentation is often annotated by multiple clinical experts to mitigate the personal bias. However, it is hard to train the automated deep learning models on multiple labels. A common practice to tackle the issue is majority vote, e.g., taking the average of multiple labels. However such a strategy ignores the different expertness of medical experts. Motivated by the observation that OD/OC segmentation is often used for the glaucoma diagnosis clinically, in this paper, we propose a novel strategy to fuse the multi-rater OD/OC segmentation labels via the glaucoma diagnosis performance. Specifically, we assess the expertness of each rater through an attentive glaucoma diagnosis network. For each rater, its contribution for the diagnosis will be reflected as an expertness map. To ensure the expertness maps are general for different glaucoma diagnosis models, we further propose an Expertness Generator (ExpG) to eliminate the high-frequency components in the optimization process. Based on the obtained expertness maps, the multi-rater labels can be fused as a single ground-truth which we dubbed as Diagnosis First Ground-truth (DiagFirstGT). Experimental results show that by using DiagFirstGT as ground-truth, OD/OC segmentation networks will predict the masks with superior glaucoma diagnosis performance.


title: E-Polynomials of Generic $\text{GL}_n\rtimes\!<\!\sigma\!>\!~$-Character Varieties: Branched Case

abstract: For any branched double covering of compact Riemann surfaces, we consider the associated character varieties that are unitary in the global sense, which we call $\text{GL}_n\rtimes\!<\!\sigma\!>\!~$-character varieties. We restrict the monodromies around the ramification points to generic semi-simple conjugacy classes contained in $\text{GL}_n\sigma$, and compute the E-polynomials of these character varieties using the character table of $\text{GL}_n(q)\rtimes\!<\!\sigma\!>\!$. The result is expressed as the inner product of certain symmetric functions associated to the wreath products $(\mathbb{Z}/2\mathbb{Z})^N\rtimes\mathfrak{S}_N$. We are then led to a conjectural formula for the mixed Hodge polynomial, which involves (modified) Macdonald polynomials and wreath Macdonald polynomials.


title: EMGSE: Acoustic/EMG Fusion for Multimodal Speech Enhancement

abstract: Multimodal learning has been proven to be an effective method to improve speech enhancement (SE) performance, especially in challenging situations such as low signal-to-noise ratios, speech noise, or unseen noise types. In previous studies, several types of auxiliary data have been used to construct multimodal SE systems, such as lip images, electropalatography, or electromagnetic midsagittal articulography. In this paper, we propose a novel EMGSE framework for multimodal SE, which integrates audio and facial electromyography (EMG) signals. Facial EMG is a biological signal containing articulatory movement information, which can be measured in a non-invasive way. Experimental results show that the proposed EMGSE system can achieve better performance than the audio-only SE system. The benefits of fusing EMG signals with acoustic signals for SE are notable under challenging circumstances. Furthermore, this study reveals that cheek EMG is sufficient for SE.


title: Some Cubic and Quartic Inequalities of Four Variables

abstract: Let $\mathcal{H} \subset \mathcal{H}_{n,d} := \mathbb{R}[x_1$,$\ldots$, $x_n]_d$ be a vector space, and $A$ be a compact semialgebraic subset of $\mathbb{P}_{\mathbb{R}}^{n-1}$. We shall study some PSD cones $\mathcal{P} = \mathcal{P}(A$, $\mathcal{H}) := \big\{f \in \mathcal{H}$ $\big|$ $f(a) \geq 0$ ($\forall a \in A$)$\big\}$. Our interests are (1) to determine the extremal elements of $\mathcal{P}$, (2) to determine discriminants of $\mathcal{P}$, (3) to describe $\mathcal{P}$ as a union of basic semialgebraic subsets, and (4) to find a nice test set when $\dim \mathcal{H}$ is low. In this article, we present (1), (2), (3) and (4) for $\mathcal{P}(\mathbb{R}^4$, $\mathcal{H}_{4,4}^{s0})$ and $\mathcal{P}(\mathbb{R}_+^4$, $\mathcal{H}_{4,4}^{s0})$, where $\mathcal{H}_{n,d}^{s0} := \big\{f \in \mathcal{H}_{n,d}$ $\big|$ $f$ is symmetric and $f(1,\ldots,1)=0 \big\}$. We also provide (1) -- (4) for $\mathcal{P}(\mathbb{R}_+^4$, $\mathcal{H}_{4,3}^{c0})$, where $\mathcal{H}_{n,d}^{c0} := \big\{f \in \mathcal{H}_{n,d}$ $\big|$ $f$ is cyclic and $f(1,\ldots,1)=0 \big\}$.


title: PR-PL: A Novel Transfer Learning Framework with Prototypical Representation based Pairwise Learning for EEG-Based Emotion Recognition

abstract: Affective brain-computer interfaces based on electroencephalography (EEG) is an important branch in the field of affective computing. However, individual differences and noisy labels seriously limit the effectiveness and generalizability of EEG-based emotion recognition models. In this paper, we propose a novel transfer learning framework with Prototypical Representation based Pairwise Learning (PR-PL) to learn discriminative and generalized prototypical representations for emotion revealing across individuals and formulate emotion recognition as pairwise learning for alleviating the reliance on precise label information. Extensive experiments are conducted on two benchmark databases under four cross-validation evaluation protocols (cross-subject cross-session, cross-subject within-session, within-subject cross-session, and within-subject within-session). The experimental results demonstrate the superiority of the proposed PR-PL against the state-of-the-arts under all four evaluation protocols, which shows the effectiveness and generalizability of PR-PL in dealing with the ambiguity of EEG responses in affective studies. The source code is available at https://github.com/KAZABANA/PR-PL.


title: Mixing and Shifting: Exploiting Global and Local Dependencies in Vision MLPs

abstract: Token-mixing multi-layer perceptron (MLP) models have shown competitive performance in computer vision tasks with a simple architecture and relatively small computational cost. Their success in maintaining computation efficiency is mainly attributed to avoiding the use of self-attention that is often computationally heavy, yet this is at the expense of not being able to mix tokens both globally and locally. In this paper, to exploit both global and local dependencies without self-attention, we present Mix-Shift-MLP (MS-MLP) which makes the size of the local receptive field used for mixing increase with respect to the amount of spatial shifting. In addition to conventional mixing and shifting techniques, MS-MLP mixes both neighboring and distant tokens from fine- to coarse-grained levels and then gathers them via a shifting operation. This directly contributes to the interactions between global and local tokens. Being simple to implement, MS-MLP achieves competitive performance in multiple vision benchmarks. For example, an MS-MLP with 85 million parameters achieves 83.8% top-1 classification accuracy on ImageNet-1K. Moreover, by combining MS-MLP with state-of-the-art Vision Transformers such as the Swin Transformer, we show MS-MLP achieves further improvements on three different model scales, e.g., by 0.5% on ImageNet-1K classification with Swin-B. The code is available at: https://github.com/JegZheng/MS-MLP.


title: GAMMA Challenge:Glaucoma grAding from Multi-Modality imAges

abstract: Color fundus photography and Optical Coherence Tomography (OCT) are the two most cost-effective tools for glaucoma screening. Both two modalities of images have prominent biomarkers to indicate glaucoma suspected. Clinically, it is often recommended to take both of the screenings for a more accurate and reliable diagnosis. However, although numerous algorithms are proposed based on fundus images or OCT volumes in computer-aided diagnosis, there are still few methods leveraging both of the modalities for the glaucoma assessment. Inspired by the success of Retinal Fundus Glaucoma Challenge (REFUGE) we held previously, we set up the Glaucoma grAding from Multi-Modality imAges (GAMMA) Challenge to encourage the development of fundus \& OCT-based glaucoma grading. The primary task of the challenge is to grade glaucoma from both the 2D fundus images and 3D OCT scanning volumes. As part of GAMMA, we have publicly released a glaucoma annotated dataset with both 2D fundus color photography and 3D OCT volumes, which is the first multi-modality dataset for glaucoma grading. In addition, an evaluation framework is also established to evaluate the performance of the submitted methods. During the challenge, 1272 results were submitted, and finally, top-10 teams were selected to the final stage. We analysis their results and summarize their methods in the paper. Since all these teams submitted their source code in the challenge, a detailed ablation study is also conducted to verify the effectiveness of the particular modules proposed. We find many of the proposed techniques are practical for the clinical diagnosis of glaucoma. As the first in-depth study of fundus \& OCT multi-modality glaucoma grading, we believe the GAMMA Challenge will be an essential starting point for future research.


title: Benchmarking of DL Libraries and Models on Mobile Devices

abstract: Deploying deep learning (DL) on mobile devices has been a notable trend in recent years. To support fast inference of on-device DL, DL libraries play a critical role as algorithms and hardware do. Unfortunately, no prior work ever dives deep into the ecosystem of modern DL libs and provides quantitative results on their performance. In this paper, we first build a comprehensive benchmark that includes 6 representative DL libs and 15 diversified DL models. We then perform extensive experiments on 10 mobile devices, which help reveal a complete landscape of the current mobile DL libs ecosystem. For example, we find that the best-performing DL lib is severely fragmented across different models and hardware, and the gap between those DL libs can be rather huge. In fact, the impacts of DL libs can overwhelm the optimizations from algorithms or hardware, e.g., model quantization and GPU/DSP-based heterogeneous computing. Finally, atop the observations, we summarize practical implications to different roles in the DL lib ecosystem.


title: Context-Preserving Instance-Level Augmentation and Deformable Convolution Networks for SAR Ship Detection

abstract: Shape deformation of targets in SAR image due to random orientation and partial information loss caused by occlusion of the radar signal, is an essential challenge in SAR ship detection. In this paper, we propose a data augmentation method to train a deep network that is robust to partial information loss within the targets. Taking advantage of ground-truth annotations for bounding box and instance segmentation mask, we present a simple and effective pipeline to simulate information loss on targets in instance-level, while preserving contextual information. Furthermore, we adopt deformable convolutional network to adaptively extract shape-invariant deep features from geometrically translated targets. By learning sampling offset to the grid of standard convolution, the network can robustly extract the features from targets with shape variations for SAR ship detection. Experiments on the HRSID dataset including comparisons with other deep networks and augmentation methods, as well as ablation study, demonstrate the effectiveness of our proposed method.


title: Symbol Length of Classes in Milnor $K$-groups

abstract: Given a field $F$, a positive integer $m$ and an integer $n\geq 2$, we prove that the symbol length of classes in Milnor's $K$-groups $K_n F/2^m K_n F$ that are equivalent to single symbols under the embedding into $K_n F/2^{m+1} K_n F$ is at most $2^{n-1}$ under the assumption that $F \supseteq \mu_{2^{m+1}}$. Since for $n=2$, $K_2 F/2^m K_2 F \cong {_{2^m}Br(F)}$, this coincides with the upper bound of $2$ for the symbol length of central simple algebras of exponent $2^m$ that are Brauer equivalent to a single symbol algebra of degree $2^{m+1}$ proved by Tignol in 1983. We also consider the cases where the embedding into $K_n F/2^{m+1} K_n F$ is of symbol length 2, 3 and 4 (the latter when $n=2$). We finish with studying the symbol length of classes in $K_3/3^m K_3 F$ whose embedding into $K_3 F/3^{m+1} K_3 F$ is one symbol when $F \supseteq \mu_{3^{m+1}}$.


title: The scale and redshift variation of density and velocity distributions in dark matter flow and two-thirds law for pairwise velocity

abstract: A halo-based non-projection approach is proposed to study the scale and redshift dependence of density and velocity distributions (PDF) in dark matter flow. All particles are divided into halo and out-of-halo particles such that PDF can be studied separately. Without projecting particle fields onto grid, scale dependence is analyzed by counting all pairs on different scales $r$. Redshift dependence is studied via generalized kurtosis. From this analysis, we can demonstrate: i) Delaunay tessellation can be used to reconstruct density field. Density correlations/spectrum are obtained, modeled and compared with theory; ii) $m$th moment of pairwise velocity can be analytically modelled. On small scale, even order moments can be modelled by a two-thirds law $\langle(\Delta u_L)^{2n}\rangle\propto{(-\epsilon_ur)}^{2/3}$, while odd order moments $\langle(\Delta u_L)^{2n+1}\rangle=(2n+1)\langle(\Delta u_L)^{2n}\rangle\langle\Delta u_L\rangle\propto{r}$ and satisfy a generalized stable clustering hypothesis (GSCH); iii) Scale dependence is studied for longitudinal velocity $u_L$ or $u_L^{'}$, pairwise velocity (velocity difference) $\Delta u_L$=$u_L^{'}$-$u_L$ and velocity sum $\Sigma u_L$=$u^{'}_L$+$u_L$. Fully developed velocity fields are never Gaussian on any scale; iv) On small scale, both $u_L$ and $\Sigma u_L$ can be modelled by a $X$ distribution to maximize system entropy. Distributions of $\Delta u_L$ is different with its moments analytically derived; v) On large scale, both $\Delta u_L$ and $\Sigma u_L$ can be modelled by a logistic function; vi) Redshift evolution of velocity distributions follows prediction of $X$ distribution with a decreasing shape parameter $\alpha(z)$ to continuously maximize system entropy.


title: Contact angle measurement on curved wetting surface in multiphase lattice Boltzmann method

abstract: Contact angle is an essential physical quantity that characterizes the wettability of a substrate. Although it is widely used in the studies of surface wetting, capillary phenomena and moving contact lines, measuring contact angles in experiments and simulations is still complicated and time-consuming. In this paper, we present an efficient scheme for the real-time and on-the-spot measurement of contact angles on curved wetting surfaces in lattice Boltzmann simulations. The measuring results are in excellent agreement with the theoretical predictions by the spherical cap method without considering the gravity effect. A series of the simulations with various drop sizes and surface curvatures confirm that the present scheme is grid-independent. Then, it is verified in gravitational environments by simulating the deformations of sessile and pendent droplets on the curved wetting surface. The numerical results are highly consistent with experimental observations and support the theoretical analysis that the microscopic contact angle is independent of gravity. Furthermore, the scheme is applied to capture the dynamic contact angle hysteresis on homogeneous or chemically heterogeneous curved surfaces. Importantly, the accurate contact angle measurement enables the mechanical analysis at moving contact lines. The present measurement is simple and efficient, and can be extended to implement in various multiphase lattice Boltzmann models.


title: Semantic Matching from Different Perspectives

abstract: In this paper, we pay attention to the issue which is usually overlooked, i.e., \textit{similarity should be determined from different perspectives}. To explore this issue, we release a Multi-Perspective Text Similarity (MPTS) dataset, in which sentence similarities are labeled from twelve perspectives. Furthermore, we conduct a series of experimental analysis on this task by retrofitting some famous text matching models. Finally, we obtain several conclusions and baseline models, laying the foundation for the following investigation of this issue. The dataset and code are publicly available at Github\footnote{\url{https://github.com/autoliuweijie/MPTS}


title: Entanglement and Causal Relation in distributed quantum computation

abstract: In this thesis, we investigate two different aspects of entanglement and classical communication in distributed quantum computation (DQC). In the first part, we analyze implementable computation over a given quantum network resource by introducing a new concept, quantum network coding for quantum computation. We consider a setting of networks where quantum communication for each edge of a network is restricted to sending one-qubit, but classical communication is unrestricted. Specifically, we analyze implementable $k$-qubit unitary operations over a certain class of networks, called cluster networks. We show that any two-qubit unitary operation is implementable over the butterfly network and the grail network, which are fundamental primitive networks for network coding. We also obtain necessary and sufficient conditions for the probabilistic implementability of unitary operations over cluster networks. In the second part, we investigate resource tradeoffs in DQC. First, we show that entanglement required for local state discrimination can be substituted by less entanglement by increasing the rounds of classical communication. Second, we develop a new framework of deterministic joint quantum operations by using a causal relation between the outputs and inputs of the local operations without predefined causal order, called "classical communication" without predefined causal order (CC*). We show that local operations and CC* (LOCC*) is equivalent to the separable operation (SEP). This result indicates that entanglement-assisted LOCC implementing SEP can be simulated by LOCC* without entanglement. We also investigate the relationship between LOCC* and another formalism for deterministic joint quantum operations without assuming predefined causal order based on the quantum process formalism. As a result, we construct an example of non-LOCC SEP by using LOCC*.


title: Modified Poisson-Nernst-Planck theory for low-to-mid frequency immittance of electric double-layer capacitors

abstract: Understanding the system-level spectral immittance response of capacitive energy storage devices with analytically tractable physics-based models is not only important for the progress of the technology, but also allows to develop new physical insights more easily. Here, we report a modified Poisson--Nernst--Planck (PNP) system describing charge concentration and electric potential as a model of electro-kinetics for electrodes showing mixed resistive-capacitive behavior. This is done by (i) incorporating time shifts between the current fluxes and both concentration gradients of charged species and the electric field, and (ii) introducing time fractional derivatives in the continuity equation. The aim is to characterize the deviation of immittance from that of ideal capacitors both at close-to-dc frequencies where the impedance angle for example is larger than -90 deg., and also at mid-range frequencies where the system veers progressively toward resistive behavior. This latter tendency is important to model in order to identify the extend of the capacitive bandwidth of the device from the rest. Solution and simulation results to the one-dimensional modified PNP system for symmetric electrolyte/blocking electrode configuration are presented and discussed.


title: Doubly heavy tetraquarks in a chiral-diquark picture

abstract: Energy spectrum of doubly heavy tetraquarks, $T_{QQ}$ ($QQ \bar{q} \bar{q}$ with $Q = c, b$ and $q = u, d, s$), is studied in the potential chiral-diquark model. Using the chiral effective theory of diquarks and the quark-diquark-based potential model, the $T_{bb}$, $T_{cc}$, and $T_{cb}$ tetraquarks are described as a three-body system composed of two heavy quarks and an antidiquark. We find several $T_{bb}$ bound states, while no $T_{cc}$ and $T_{cb}$ (deep) bound state is seen. We also study the change of the $T_{QQ}$ tetraquark masses under restoration of chiral symmetry.


title: Source Code Summarization with Structural Relative Position Guided Transformer

abstract: Source code summarization aims at generating concise and clear natural language descriptions for programming languages. Well-written code summaries are beneficial for programmers to participate in the software development and maintenance process. To learn the semantic representations of source code, recent efforts focus on incorporating the syntax structure of code into neural networks such as Transformer. Such Transformer-based approaches can better capture the long-range dependencies than other neural networks including Recurrent Neural Networks (RNNs), however, most of them do not consider the structural relative correlations between tokens, e.g., relative positions in Abstract Syntax Trees (ASTs), which is beneficial for code semantics learning. To model the structural dependency, we propose a Structural Relative Position guided Transformer, named SCRIPT. SCRIPT first obtains the structural relative positions between tokens via parsing the ASTs of source code, and then passes them into two types of Transformer encoders. One Transformer directly adjusts the input according to the structural relative distance; and the other Transformer encodes the structural relative positions during computing the self-attention scores. Finally, we stack these two types of Transformer encoders to learn representations of source code. Experimental results show that the proposed SCRIPT outperforms the state-of-the-art methods by at least 1.6%, 1.4% and 2.8% with respect to BLEU, ROUGE-L and METEOR on benchmark datasets, respectively. We further show that how the proposed SCRIPT captures the structural relative dependencies.


title: Dynamics of semigroups of H\'{e}non maps

abstract: The goal of this article is two fold. Firstly, we explore the dynamics of a semigroup of polynomial automorphisms of $\mathbb{C}^2$, generated by a finite collection of H\'enon maps. In particular, we construct the positive and negative dynamical Green's functions $G_{\mathscr{G}}^\pm$ and the corresponding dynamical Green's currents $\mu_{\mathscr{G}}^\pm$ for a semigroup $\mathcal{S}$, generated by a collection ${\mathscr{G}}.$ Using them, we show that the positive (or negative) Julia set of the semigroup $\mathcal{S}$, i.e., $\mathcal{J}_{\mathcal{S}}^+$ (or $\mathcal{J}_{\mathcal{S}}^-$) is equal to the closure of the union of individual positive (or negative) Julia sets of the maps, in the semigroup $\mathcal{S}$. Furthermore, we prove that $\mu_{\mathscr{G}}^+$ is supported on the whole of $\mathcal{J}_{\mathcal{S}}^+$ and is also the unique positive closed $(1,1)$-current supported on $\mathcal{J}_{\mathcal{S}}^+$, satisfying a semi-invariance relation that depends on the generating set ${\mathscr{G}}$. Secondly, we study the dynamics of a non-autonomous sequence of H\'{e}non maps, say $\{h_k\}$, contained in the semigroup $\mathcal{S}$. Similarly, as above, here too, we construct the non-autonomous dynamical positive and negative Green's function and the corresponding dynamical Green's currents. Further, we use the properties of Green's function to conclude that the non-autonomous attracting basin of any such sequence $\{h_k\}$, sharing a common attracting fixed point, is biholomorphic to $\mathbb{C}^2.$


title: MetaShift: A Dataset of Datasets for Evaluating Contextual Distribution Shifts and Training Conflicts

abstract: Understanding the performance of machine learning models across diverse data distributions is critically important for reliable applications. Motivated by this, there is a growing focus on curating benchmark datasets that capture distribution shifts. While valuable, the existing benchmarks are limited in that many of them only contain a small number of shifts and they lack systematic annotation about what is different across different shifts. We present MetaShift--a collection of 12,868 sets of natural images across 410 classes--to address this challenge. We leverage the natural heterogeneity of Visual Genome and its annotations to construct MetaShift. The key construction idea is to cluster images using its metadata, which provides context for each image (e.g. "cats with cars" or "cats in bathroom") that represent distinct data distributions. MetaShift has two important benefits: first, it contains orders of magnitude more natural data shifts than previously available. Second, it provides explicit explanations of what is unique about each of its data sets and a distance score that measures the amount of distribution shift between any two of its data sets. We demonstrate the utility of MetaShift in benchmarking several recent proposals for training models to be robust to data shifts. We find that the simple empirical risk minimization performs the best when shifts are moderate and no method had a systematic advantage for large shifts. We also show how MetaShift can help to visualize conflicts between data subsets during model training.


title: Tight integration of neural- and clustering-based diarization through deep unfolding of infinite Gaussian mixture model

abstract: Speaker diarization has been investigated extensively as an important central task for meeting analysis. Recent trend shows that integration of end-to-end neural (EEND)-and clustering-based diarization is a promising approach to handle realistic conversational data containing overlapped speech with an arbitrarily large number of speakers, and achieved state-of-the-art results on various tasks. However, the approaches proposed so far have not realized {\it tight} integration yet, because the clustering employed therein was not optimal in any sense for clustering the speaker embeddings estimated by the EEND module. To address this problem, this paper introduces a {\it trainable} clustering algorithm into the integration framework, by deep-unfolding a non-parametric Bayesian model called the infinite Gaussian mixture model (iGMM). Specifically, the speaker embeddings are optimized during training such that it better fits iGMM clustering, based on a novel clustering loss based on Adjusted Rand Index (ARI). Experimental results based on CALLHOME data show that the proposed approach outperforms the conventional approach in terms of diarization error rate (DER), especially by substantially reducing speaker confusion errors, that indeed reflects the effectiveness of the proposed iGMM integration.


title: Nonlinear semigroup approach to Hamilton-Jacobi equations -- A toy model

abstract: In this paper, we discuss the existence and multiplicity problem of viscosity solution to the Hamilton-Jacobi equation $$h(x,d_x u)+\lambda(x)u=c,\quad x\in M,$$ where $M$ is a closed manifold and $\lambda:M\rightarrow\mathbb{R}$ changes signs on $M$, via nonlinear semigroup method. It turns out that a bifurcation phenomenon occurs when parameter $c$ strides over the critical value. As an application of the main result, we analyse the structure of the set of viscosity solutions of an one-dimensional example in detail.


title: Benign Overfitting in Two-layer Convolutional Neural Networks

abstract: Modern neural networks often have great expressive power and can be trained to overfit the training data, while still achieving a good test performance. This phenomenon is referred to as "benign overfitting". Recently, there emerges a line of works studying "benign overfitting" from the theoretical perspective. However, they are limited to linear models or kernel/random feature models, and there is still a lack of theoretical understanding about when and how benign overfitting occurs in neural networks. In this paper, we study the benign overfitting phenomenon in training a two-layer convolutional neural network (CNN). We show that when the signal-to-noise ratio satisfies a certain condition, a two-layer CNN trained by gradient descent can achieve arbitrarily small training and test loss. On the other hand, when this condition does not hold, overfitting becomes harmful and the obtained CNN can only achieve a constant level test loss. These together demonstrate a sharp phase transition between benign overfitting and harmful overfitting, driven by the signal-to-noise ratio. To the best of our knowledge, this is the first work that precisely characterizes the conditions under which benign overfitting can occur in training convolutional neural networks.


title: Non-Roelcke precompactness of groups of surface homeomorphisms

abstract: We prove that no subgroup of the group of boundary-fixing homeomorphisms of a compact surface whose action on the interior of the surface is sufficiently transitive can be Roelcke precompact with the topology inherited from the compact-open topology.


title: Photoinduced 120-degree spin order in the Kondo-lattice model on a triangular lattice

abstract: We theoretically predict the emergence of 120-degree spin order as a nonequilibrium steady state in the photodriven Kondo-lattice model on a triangular lattice. In the system away from the half filling with ferromagnetic ground state, the photoexcitation of conduction electrons and the photoinduced renormalization of bandwidth cause reconstruction of band structure and subsequent redistribution of the electrons through relaxations, which result in an electronic structure similar to that in the half-filled system at equilibrium, where the 120-degree spin order is stabilized. In this photoinduced 120-degree spin ordered phase, domains of different spin-ordered planes are formed, and vortices of spin chirality vectors called $Z_2$ vortices appear at points where multiple domains meet. We also discuss favorable conditions and experimental feasibility to observe the predicted photoinduced magnetic phase transition by investigating dependencies on the light parameters (amplitude, frequency, and polarization), the electron filling, the strength of Kondo coupling, and the effects of antiferromagnetic coupling among the localized spins. Photoinduced magnetic structures proposed so far have been limited to simple collinear (anti)ferromagnetic orders or local magnetic defects in magnets. The present work paves a way to optical creation of complex noncollinear magnetisms as global nonequilibrium steady phase in photodriven systems.


title: A Polymer Chain with Dipolar Active Forces in Connection to Spatial Organization of Chromatin

abstract: A living cell is an active environment where the organization and dynamics of chromatin are affected by different forms of activity. Optical experiments report that loci show subdiffusive dynamics and the chromatin fiber is seen to be coherent over micrometer-scale regions. Using a bead-spring polymer chain with dipolar active forces, we study how the subdiffusive motion of the loci generate large-scale coherent motion of the chromatin. We show that in the presence of extensile (contractile) activity, the dynamics of loci grows faster (slower) and the spatial correlation length increases (decreases) compared to the case with no dipolar forces. Hence, both the dipolar active forces modify the elasticity of the chain. Interestingly in our model, the dynamics and organization of such dipolar active chains largely differ from the passive chain with renormalized elasticity.


title: Modular Pulse Synthesizer for Transcranial Magnetic Stimulation with Flexible User-Defined Pulse Shaping and Rapidly Changing Pulses in Sequences

abstract: The temporal shape of a pulse in transcranial magnetic stimulation (TMS) influences which neuron populations are activated preferentially as well as the strength and even direction of neuromodulation effects. Furthermore, various pulse shapes differ in their efficiency, coil heating, sensory perception, and clicking sound. However, the available TMS pulse shape repertoire is still very limited to a few pulses with sinusoidal or near-rectangular shapes. Monophasic pulses, though found to be more selective and stronger in neuromodulation, are generated inefficiently and therefore only available in simple low-frequency repetitive protocols. Despite a strong interest to exploit the temporal effects of TMS pulse shapes and pulse sequences, waveform control is relatively inflexible and only possible parametrically within certain limits. Previously proposed approaches for flexible pulse shape control, such as through power electronic inverters, have significant limitations: Existing semiconductor switches can fail under the immense electrical stress associated with free pulse shaping, and most conventional power inverter topologies are incapable of generating smooth electric fields or existing pulse shapes. Leveraging intensive preliminary work on modular power electronics, we present a modular pulse synthesizer (MPS) technology that can, for the first time, flexibly generate high-power TMS pulses with user-defined electric field shape as well as rapid sequences of pulses with high output quality. The circuit topology breaks the problem of simultaneous high power and switching speed into smaller, manageable portions. MPS TMS can synthesize practically any pulse shape, including conventional ones, with fine quantization of the induced electric field.


title: Spectrum of the quantum integrable $D^{(2)}_2$ spin chain with generic boundary fields

abstract: Exact solution of the quantum integrable $D^{(2)}_2$ spin chain with generic integrable boundary fields is constructed. It is found that the transfer matrix of this model can be factorized as the product of those of two open staggered anisotropic XXZ spin chains. Based on this identity, the eigenvalues and Bethe ansatz equations of the $D^{(2)}_2$ model are derived via off-diagonal Bethe ansatz.

categories: math-ph cond-mat.str-el hep-th math.MP nlin.SI


title: Joint Design of Hybrid Beamforming and Reflection Coefficients in RIS-aided mmWave MIMO Systems

abstract: This paper considers a reconfigurable intelligent surface (RIS)-aided millimeter wave (mmWave) downlink communication system where hybrid analog-digital beamforming is employed at the base station (BS). We formulate a power minimization problem by jointly optimizing hybrid beamforming at the BS and the response matrix at the RIS, under the signal-to-interference-plus-noise ratio (SINR) constraints at all users. The problem is highly challenging to solve due to the non-convex SINR constraints as well as the unit-modulus phase shift constraints for both the RIS reflection coefficients and the analog beamformer. A two-layer penalty-based algorithm is proposed to decouple variables in SINR constraints, and manifold optimization is adopted to handle the non-convex unit-modulus constraints. {We also propose a low-complexity sequential optimization method, which optimizes the RIS reflection coefficients, the analog beamformer, and the digital beamformer sequentially without iteration.} Furthermore, the relationship between the power minimization problem and the max-min fairness (MMF) problem is discussed. Simulation results show that the proposed penalty-based algorithm outperforms the state-of-the-art semidefinite relaxation (SDR)-based algorithm. Results also demonstrate that the RIS plays an important role in the power reduction.


title: An Introduction to Neural Data Compression

abstract: Neural compression is the application of neural networks and other machine learning methods to data compression. Recent advances in statistical machine learning have opened up new possibilities for data compression, allowing compression algorithms to be learned end-to-end from data using powerful generative models such as normalizing flows, variational autoencoders, diffusion probabilistic models, and generative adversarial networks. The present article aims to introduce this field of research to a broader machine learning audience by reviewing the necessary background in information theory (e.g., entropy coding, rate-distortion theory) and computer vision (e.g., image quality assessment, perceptual metrics), and providing a curated guide through the essential ideas and methods in the literature thus far.


title: Super-replication prices with multiple-priors in discrete time

abstract: In the frictionless discrete time financial market of Bouchard and Nutz (2015), we propose a full characterization of the quasi-sure super-replication price: as the supremum of the mono-prior super-replication prices, through an extreme prior and through martingale measures.


title: Coefficient Decomposition of Spatial Regressive Models Based on Standardized Variables

abstract: Spatial autocorrelation analysis is the basis for spatial autoregressive modeling. However, the relationships between spatial correlation coefficients and spatial regression models are not yet well clarified. The paper is devoted to explore the deep structure of spatial regression coefficients. By means of mathematical reasoning, a pair of formulae of canonical spatial regression coefficients are derived from a general spatial regression model based on standardized variables. The spatial auto- and lag-regression coefficients are reduced to a series of statistic parameters and measurements, including conventional regressive coefficient, Pearson correlation coefficient, Moran's indexes, spatial cross-correlation coefficients, and the variance of prediction residuals. The formulae show determinate inherent relationships between spatial correlation coefficients and spatial regression coefficients. New finding is as below: the spatial autoregressive coefficient mainly depends on the Moran's index of the independent variable, while the spatial lag-regressive coefficient chiefly depends on the cross-correlation coefficient of independent variable and dependent variable. The observational data of an urban system in Beijing, Tianjin, and Hebei region of China were employed to verify the newly derived formulae, and the results are satisfying. The new formulae and their variates are helpful for understand spatial regression models from the perspective of spatial correlation and can be used to assist spatial regression modeling.


title: The conformal cosmological potential

abstract: We discuss qualitative features of the conformal relation between certain classes of gravity theories and general relativity, common to different themes such as $f(R)$, Brans-Dicke-type, and string theories. We focus primarily on the frame relations of the fields involved, slice energy, traceless and Palatini extensions, and selected cosmological applications.


title: Counter-intuitive Ferroelectric Property And Non-negligible Orbital Magnetic Moment In Cr/Cu Based Perovskite Metal-Organic Frameworks

abstract: Metal-organic frameworks (MOFs) possess a hybrid nature, combining the inorganic properties from the metal ions and the organic properties from the molecular linkers. Stroppa, \textit{et al.}, showed that the perovskite-type MOF [C(NH$_2$)$_3$]M[(HCOO)$_3$] (M = Cr, Cu) exhibits the magneto-electric coupled multiferroicity [Angew. Chem. Int. Ed. 50, 5847 (2011) and Adv. Mater. 25, 2284 (2013)]. Moreover, their ferroelectricity arises from the hybrid improper mechanism, which also explains the magneto-electric coupling. In this work, we further examine the electric and magnetic properties of [C(NH$_2$)$_3$]M[(HCOO)$_3$]. We find that the hybrid mode composed of non-polar modes induces purely electronic polarization even without the polar mode. The polar mode compensates for the purely electronic polarization. It leads to a counter-intuitive argument that the inversion of the polar mode rather enhances the polarization. We provide microscopic origin and macroscopic analysis for this polarization property. In addition, we find that the orbital magnetic moment is comparable to the spin contribution in the Cu-based MOF. Finally, we establish the model for the orbital magnetic moment based on the perturbation theory.


title: QA4QG: Using Question Answering to Constrain Multi-Hop Question Generation

abstract: Multi-hop question generation (MQG) aims to generate complex questions which require reasoning over multiple pieces of information of the input passage. Most existing work on MQG has focused on exploring graph-based networks to equip the traditional Sequence-to-sequence framework with reasoning ability. However, these models do not take full advantage of the constraint between questions and answers. Furthermore, studies on multi-hop question answering (QA) suggest that Transformers can replace the graph structure for multi-hop reasoning. Therefore, in this work, we propose a novel framework, QA4QG, a QA-augmented BART-based framework for MQG. It augments the standard BART model with an additional multi-hop QA module to further constrain the generated question. Our results on the HotpotQA dataset show that QA4QG outperforms all state-of-the-art models, with an increase of 8 BLEU-4 and 8 ROUGE points compared to the best results previously reported. Our work suggests the advantage of introducing pre-trained language models and QA module for the MQG task.


title: Deduplicating Training Data Mitigates Privacy Risks in Language Models

abstract: Past work has shown that large language models are susceptible to privacy attacks, where adversaries generate sequences from a trained model and detect which sequences are memorized from the training set. In this work, we show that the success of these attacks is largely due to duplication in commonly used web-scraped training sets. We first show that the rate at which language models regenerate training sequences is superlinearly related to a sequence's count in the training set. For instance, a sequence that is present 10 times in the training data is on average generated ~1000 times more often than a sequence that is present only once. We next show that existing methods for detecting memorized sequences have near-chance accuracy on non-duplicated training sequences. Finally, we find that after applying methods to deduplicate training data, language models are considerably more secure against these types of privacy attacks. Taken together, our results motivate an increased focus on deduplication in privacy-sensitive applications and a reevaluation of the practicality of existing privacy attacks.


title: GeMSE: a Low-Background Facility for Gamma-Spectrometry at Moderate Rock Overburden

abstract: The GeMSE (Germanium Material and meteorite Screening Experiment) facility operates a low-background HPGe crystal in an underground laboratory with a moderate rock overburden of 620$\,$m.w.e. in Switzerland. It has been optimized for continuous remote operation. A multi-layer passive shielding, a muon veto, and a boil-off nitrogen purge line inside the measurement cavity minimize the instrument's background rate, which decreased by 33% to (164$\pm$2)$\,$counts/day (100-2700$\,$keV) after five years of underground operation. This agrees with the prediction based on the expected decay of short-lived isotopes. A fit to the known background components, modeled via a precise simulation of the detector, shows that the GeMSE background is now muon-dominated. We also present updates towards a more accurate detection efficiency calculation for the screened samples: the thickness of the crystal's outer dead-layer is precisely determined and the efficiency can now be easily calculated for any sample geometry. The advantage of this feature is showcased via the determination of the $^{40}$K content in the screening of a complex-shaped object: a banana.


title: Pathway: a protocol for algorithmic pricing of a DAO governance token

abstract: In this paper, we will consider a governance token pricing algorithm that conducts liquidity operations on AMM (CPMM) DEXs (automated market maker decentralized exchanges) with liquidity that belongs to a decentralized autonomous organization (DAO), also called protocol-owned liquidity (POL). The primary aim of the protocol is maintaining a price peg by determining algorithmically when and how to carry out interventions that consist of two steps: extracting liquidity from an AMM liquidity pool and conducting "token swap" operations. We will cover setting up an optimal peg function as a weighted sum of certain normalized factors, which are to be determined collectively by the DAO. In particular, we will review various arithmetic invariants of liquidity intervention, which brings the price to a peg while leaving total liquidity intact, and show how such interventions can be substituted in practice by so-called PMM (proactive market maker) protocols.


title: Tensionless Strings and Killing(-Yano) Tensors

abstract: We construct invariants for bosonic and spinning tensionless (null) strings in backgrounds that carry Killing tensors or Killing-Yano tensors of mixed type. This is facilitated by the close relation of these strings to point particles. We apply the construction to the Minkowski and to the Kerr-Newman backgrounds.


title: Exact Dynamical Correlations of Hard-Core Anyons in One-Dimensional Lattices

abstract: The dynamical correlations of a strongly correlated system is an essential ingredient to describe its non-equilibrium properties. We present a general method to calculate exactly the dynamical correlations of hard-core anyons in one-dimensional lattices, valid for any type of confining potential and any temperature. We obtain exact explicit expressions of the Green's function, the spectral function, and the out-of-time-ordered correlators (OTOCs). We find that the anyonic spectral function displays three main singularity lines which can be explained as a double spectrum in analogy to the Lieb-Liniger gas. The dispersion relations of these lines can be given explicitly and they cross at a \emph{hot point} $(q_m,\omega_m)$, which induces a peak in the momentum distribution function at $q_m$ and a power-law singularity in the local spectral function at $\omega_m$. We also find that the anyonic statistics can induces spatial asymmetry in the Green's function, its spectrum, and the OTOC. Moreover, the information spreading characterized by the OTOCs shows light-cone dynamics, asymmetric for general statistics and low temperatures, but symmetric at infinite temperature. Our results pave the way toward studying the non-equilibrium dynamics of hard-core anyons and experimentally probing anyonic statistics through spectral functions.


title: Exact SOHS decompositions of trigonometric univariate polynomials with Gaussian coefficients

abstract: Certifying the positivity of trigonometric polynomials is of first importance for design problems in discrete-time signal processing. It is well known from the Riesz-Fej\'ez spectral factorization theorem that any trigonometric univariate polynomial positive on the unit circle can be decomposed as a Hermitian square with complex coefficients. Here we focus on the case of polynomials with Gaussian integer coefficients, i.e., with real and imaginary parts being integers. We design, analyze and compare, theoretically and practically,three hybrid numeric-symbolic algorithms computing weighted sums of Hermitian squares decompositions for trigonometric univariate polynomials positive on the unit circle with Gaussian coefficients. The numerical steps the first and second algorithm rely on are complex root isolation and semidefinite programming, respectively. An exact sum of Hermitian squares decomposition is obtained thanks to compensation techniques. The third algorithm, also based on complex semidefinite programming, is an adaptation of the rounding and projection algorithm by Peyrl and Parrilo. For all three algorithms, we prove bit complexity and output size estimates that are polynomial in the degree of the input and linear in the maximum bitsize of its coefficients. We compare their performance on randomly chosen benchmarks, and further design a certified finite impulse filter.


title: Provably Efficient Causal Model-Based Reinforcement Learning for Systematic Generalization

abstract: In the sequential decision making setting, an agent aims to achieve systematic generalization over a large, possibly infinite, set of environments. Such environments are modeled as discrete Markov decision processes with both states and actions represented through a feature vector. The underlying structure of the environments allows the transition dynamics to be factored into two components: one that is environment-specific and another that is shared. Consider a set of environments that share the laws of motion as an example. In this setting, the agent can take a finite amount of reward-free interactions from a subset of these environments. The agent then must be able to approximately solve any planning task defined over any environment in the original set, relying on the above interactions only. Can we design a provably efficient algorithm that achieves this ambitious goal of systematic generalization? In this paper, we give a partially positive answer to this question. First, we provide a tractable formulation of systematic generalization by employing a causal viewpoint. Then, under specific structural assumptions, we provide a simple learning algorithm that guarantees any desired planning error up to an unavoidable sub-optimality term, while showcasing a polynomial sample complexity.


title: Coalgebraic Semantics for Nominal Automata

abstract: This paper provides a coalgebraic approach to the language semantics of two types of non-deterministic automata over nominal sets: non-deterministic orbit-finite automata (NOFAs) and regular nominal non-deterministic automata (RNNAs), which were introduced in previous work. While NOFAs are a straightforward nominal version of non-deterministic automata, RNNAs feature ordinary as well as name binding transitions. Correspondingly, words accepted by RNNAs are strings formed by ordinary letters and name binding letters. Bar languages are sets of such words modulo $\alpha$-equivalence, and to every state of an RNNA one associates its accepted bar language. We show that the semantics of NOFAs and RNNAs, respectively, arise both as an instance of the Kleisli-style coalgebraic trace semantics as well as an instance of the coalgebraic language semantics obtained via generalized determinization. On the way we revisit coalgebraic trace semantics in general and give a new compact proof for the main result in that theory stating that an initial algebra for a functor yields the terminal coalgebra for the Kleisli extension of the functor. Our proof requires fewer assumptions on the functor than all previous ones.


title: Video2IMU: Realistic IMU features and signals from videos

abstract: Human Activity Recognition (HAR) from wearable sensor data identifies movements or activities in unconstrained environments. HAR is a challenging problem as it presents great variability across subjects. Obtaining large amounts of labelled data is not straightforward, since wearable sensor signals are not easy to label upon simple human inspection. In our work, we propose the use of neural networks for the generation of realistic signals and features using human activity monocular videos. We show how these generated features and signals can be utilized, instead of their real counterparts, to train HAR models that can recognize activities using signals obtained with wearable sensors. To prove the validity of our methods, we perform experiments on an activity recognition dataset created for the improvement of industrial work safety. We show that our model is able to realistically generate virtual sensor signals and features usable to train a HAR classifier with comparable performance as the one trained using real sensor data. Our results enable the use of available, labelled video data for training HAR models to classify signals from wearable sensors.


title: A resource-efficient deep learning framework for low-dose brain PET image reconstruction and analysis

abstract: 18F-fluorodeoxyglucose (18F-FDG) Positron Emission Tomography (PET) imaging usually needs a full-dose radioactive tracer to obtain satisfactory diagnostic results, which raises concerns about the potential health risks of radiation exposure, especially for pediatric patients. Reconstructing the low-dose PET (L-PET) images to the high-quality full-dose PET (F-PET) ones is an effective way that both reduces the radiation exposure and remains diagnostic accuracy. In this paper, we propose a resource-efficient deep learning framework for L-PET reconstruction and analysis, referred to as transGAN-SDAM, to generate F-PET from corresponding L-PET, and quantify the standard uptake value ratios (SUVRs) of these generated F-PET at whole brain. The transGAN-SDAM consists of two modules: a transformer-encoded Generative Adversarial Network (transGAN) and a Spatial Deformable Aggregation Module (SDAM). The transGAN generates higher quality F-PET images, and then the SDAM integrates the spatial information of a sequence of generated F-PET slices to synthesize whole-brain F-PET images. Experimental results demonstrate the superiority and rationality of our approach.


title: High-flux neutron generation by laser-accelerated ions from single- and double-layer targets

abstract: Contemporary ultraintense, short-pulse laser systems provide extremely compact setups for the production of high-flux neutron beams, such as those required for nondestructive probing of dense matter, research on neutron-induced damage in fusion devices or laboratory astrophysics studies. Here, by coupling particle-in-cell and Monte Carlo numerical simulations, we examine possible strategies to optimise neutron sources from ion-induced nuclear reactions using 1-PW, 20-fs-class laser systems. To improve the ion acceleration, the laser-irradiated targets are chosen to be ultrathin solid foils, either standing alone or preceded by a plasma layer of near-critical density to enhance the laser focusing. We compare the performance of these single- and double-layer targets, and determine their optimum parameters in terms of energy and angular spectra of the accelerated ions. These are then sent into a converter to generate neutrons via nuclear reactions on beryllium and lead nuclei. Overall, we identify configurations that result in neutron yields as high as $\sim 10^{10}\,\rm n\,sr^{-1}$ in $\sim 1$-cm-thick converters or instantaneous neutron fluxes above $10^{23}\,\rm n\,cm^{-2}\,s^{-1}$ at the backside of $\lesssim 100$-$\mu$m-thick converters. Considering a realistic repetition rate of one laser shot per minute, the corresponding time-averaged neutron yields are predicted to reach values ($\gtrsim 10^7\,\rm n \,sr^{-1}\,s^{-1}$) well above the current experimental record, and this even with a mere thin foil as a primary target. A further increase in the time-averaged yield up to above $10^8\,\rm sr^{-1}\,s^{-1}$ is foreseen using double-layer targets.


title: Effect of combined heaving and pitching on propulsion of single and tandem flapping foils

abstract: In this study, we present two and three-dimensional numerical investigation to understand the combined effects of the non-dimensional heave amplitude varying from 0 to 1 and the pitch amplitude ranging from 0 to 30 on the propulsive performance for a single and tandem foil system at Reynolds number 1100 and reduced frequency 0.2. We initially present a systematic analysis on the thrust generation due to the kinematic parameters for a single foil. The significance of effective angle of attack and the projected area of the foil has been emphasized in explaining the dynamics of lift and drag forces and their relationship with the propulsion. We next investigate the relation between the streamwise gap and kinematic parameters on propulsion for the tandem foil system. We show that the propulsive performance strongly depends on the upstream wake interacting with the downstream foil, and the timing of the interaction due to the gap between the foils. Through a control volume analysis, the time-averaged pressure and streamwise velocity have been investigated to explain the effect of kinematic parameters on the hydrodynamic forces. Typically in the literature, the formation of jet in the wake has been attributed to thrust generation. However, in this study, we emphasize and show the significance of the time-averaged pressure in the wake apart from the streamwise velocity (jet) for predicting the thrust forces. The study is concluded with a three-dimensional demonstration of the tandem foils to understand the possible three-dimensional effects due to the large amplitude flapping and wake-foil interaction.


title: Second-Order Topological Insulator in Two-Dimensional C2N and Its Derivatives

abstract: Quadrupole phase, as a novel high-order topological phase, exhibits nontrivial gapless states at the boundaries whose dimension is lower than bulk by two. However, this phase has not been observed experimentally in two-dimensional (2D) materials up to now. In this work, using first-principles calculations and tight-binding (TB) model, we propose that the experimentally synthesized C2N is a 2D quadrupole topological insulator with one-dimensional gapped edge states and zero-dimensional gapless corner states. C2N is found to have a large bulk gap of 2.45 eV and an edge gap of 0.32 eV, making it an excellent candidate to evidently present the nontrivial corner states in experiments. The robustness of the corner states against the edge disorders has been explicitly identified. Moreover, another three C2N-like materials are also found to host the nontrivial quadrupole phase including an experimentally synthesized material aza-fused microporous polymers (CMP). The four 2D quadrupole topological phases proposed in our present work provide excellent candidates for studying the novel high-order topological properties in future experiments.


title: An excursion to multiplications and convolutions on modulation spaces

abstract: We give a self-contained introduction to (quasi-)Banach modulation spaces of ultradistributions, and review results on boundedness for multiplications and convolutions for elements in such spaces. Furthermore, we use these results to study the Gabor product. As an example, we show how it appears in a phase-space formulation of the nonlinear cubic Schr\"odinger equation.


title: Composition operators on Harmonic Bloch-type spaces

abstract: In this paper we consider composition operators on Harmonic-Bloch type spaces and we compute the spectrum of composition operators. Also, we characterize isometric composition operators on harmonic Bloch type spaces.


title: Analog Physical-Layer Relay Attacks with Application to Bluetooth and Phase-Based Ranging

abstract: Today, we use smartphones as multi-purpose devices that communicate with their environment to implement context-aware services, including asset tracking, indoor localization, contact tracing, or access control. As a de-facto standard, Bluetooth is available in virtually every smartphone to provide short-range wireless communication. Importantly, many Bluetooth-driven applications such as Phone as a Key (PaaK) for vehicles and buildings require proximity of legitimate devices, which must be protected against unauthorized access. In earlier access control systems, attackers were able to violate proximity-verification through relay station attacks. However, the vulnerability of Bluetooth against such attacks was yet unclear as existing relay attack strategies are not applicable or can be defeated through wireless distance measurement. In this paper, we design and implement an analog physical-layer relay attack based on low-cost off-the-shelf radio hardware to simultaneously increase the wireless communication range and manipulate distance measurements. Using our setup, we successfully demonstrate relay attacks against Bluetooth-based access control of a car and a smart lock. Further, we show that our attack can arbitrarily manipulate Multi-Carrier Phase-based Ranging (MCPR) while relaying signals over 90 m.


title: High-Dimensional Dynamic Stochastic Model Representation

abstract: We propose a scalable method for computing global solutions of nonlinear, high-dimensional dynamic stochastic economic models. First, within a time iteration framework, we approximate economic policy functions using an adaptive, high-dimensional model representation scheme, combined with adaptive sparse grids to address the ubiquitous challenge of the curse of dimensionality. Moreover, the adaptivity within the individual component functions increases sparsity since grid points are added only where they are most needed, that is, in regions with steep gradients or at nondifferentiabilities. Second, we introduce a performant vectorization scheme for the interpolation compute kernel. Third, the algorithm is hybrid parallelized, leveraging both distributed- and shared-memory architectures. We observe significant speedups over the state-of-the-art techniques, and almost ideal strong scaling up to at least $1,000$ compute nodes of a Cray XC$50$ system at the Swiss National Supercomputing Center. Finally, to demonstrate our method's broad applicability, we compute global solutions to two variates of a high-dimensional international real business cycle model up to $300$ continuous state variables. In addition, we highlight a complementary advantage of the framework, which allows for a priori analysis of the model complexity.


title: Hybrid in-beam PET- and Compton prompt-gamma imaging aimed at enhanced proton-range verification

abstract: We report on an hybrid in-beam PET and prompt-gamma Compton imaging system aimed at quasi real-time ion-range verification in proton-therapy treatments. Proof-of-concept experiments were carried out at the radiobiology beam line of the CNA cyclotron facility using a set of two synchronous Compton imagers and different target materials. The time structure of the 18~MeV proton beam was shaped with a series of beam-on and beam-off intervals, thereby mimicking a pulsed proton beam on a long time scale. During beam-on intervals, Compton imaging was performed utilizing the high energy $\gamma$-rays promptly emitted from the nuclear reactions occurring in the targets. In the course of the beam-off intervals in-situ positron-emission tomography was accomplished with the same imagers using the $\beta^{+}$ decay of activated nuclei. The targets used were stacks of different materials covering also various proton ranges and energies. A systematic study on the performance of these two complementary imaging techniques is reported and the experimental results interpreted on the basis of Monte Carlo calculations. The results demonstrate the possibility to combine both imaging techniques in a concomitant way, where high-efficiency prompt-gamma imaging is complemented with the high spatial accuracy of PET. Empowered by these results we suggest that a pulsed beam with a suitable duty cycle, in conjunction with in-situ Compton- and PET-imaging may help to attain complementary information and quasi real-time range monitoring with high accuracy.


title: Reinforcement Learning in Presence of Discrete Markovian Context Evolution

abstract: We consider a context-dependent Reinforcement Learning (RL) setting, which is characterized by: a) an unknown finite number of not directly observable contexts; b) abrupt (discontinuous) context changes occurring during an episode; and c) Markovian context evolution. We argue that this challenging case is often met in applications and we tackle it using a Bayesian approach and variational inference. We adapt a sticky Hierarchical Dirichlet Process (HDP) prior for model learning, which is arguably best-suited for Markov process modeling. We then derive a context distillation procedure, which identifies and removes spurious contexts in an unsupervised fashion. We argue that the combination of these two components allows to infer the number of contexts from data thus dealing with the context cardinality assumption. We then find the representation of the optimal policy enabling efficient policy learning using off-the-shelf RL algorithms. Finally, we demonstrate empirically (using gym environments cart-pole swing-up, drone, intersection) that our approach succeeds where state-of-the-art methods of other frameworks fail and elaborate on the reasons for such failures.


title: Saute RL: Almost Surely Safe Reinforcement Learning Using State Augmentation

abstract: Satisfying safety constraints almost surely (or with probability one) can be critical for the deployment of Reinforcement Learning (RL) in real-life applications. For example, plane landing and take-off should ideally occur with probability one. We address the problem by introducing Safety Augmented (Saute) Markov Decision Processes (MDPs), where the safety constraints are eliminated by augmenting them into the state-space and reshaping the objective. We show that Saute MDP satisfies the Bellman equation and moves us closer to solving Safe RL with constraints satisfied almost surely. We argue that Saute MDP allows viewing the Safe RL problem from a different perspective enabling new features. For instance, our approach has a plug-and-play nature, i.e., any RL algorithm can be "Sauteed". Additionally, state augmentation allows for policy generalization across safety constraints. We finally show that Saute RL algorithms can outperform their state-of-the-art counterparts when constraint satisfaction is of high importance.


title: Modelling Underwater Acoustic Propagation using One-way Wave Equations

abstract: The primary contribution of this paper is to characterize the propagation of acoustic signal carrying information through any medium and the interaction of the travelling acoustic signal with the surrounding medium. We will use the concept of damped harmonic oscillator to model the medium and Milne's oscillator technique to map the interaction of the acoustic signal with the medium. The acoustic signal itself will be modelled using the one-way wave equation formulated in terms of acoustic pressure and velocity of acoustic waves through the medium. Using the above-mentioned concepts, we calculated the effective signal strength, phase shift and time period of the communicated signal. Numerical results are generated to present the evolution of signal strength and received signal envelope in underwater environment.


title: General relativistic Lagrangian continuum theories -- Part I: reduced variational principles and junction conditions for hydrodynamics and elasticity

abstract: We establish a Lagrangian variational framework for general relativistic continuum theories that permits the development of the process of Lagrangian reduction by symmetry in the relativistic context. Starting with a continuum version of the Hamilton principle for the relativistic particle, we deduce two classes of reduced variational principles that are associated to either spacetime covariance, which is an axiom of the continuum theory, or material covariance, which is related to particular properties of the system such as isotropy. The covariance hypotheses and the Lagrangian reduction process are efficiently formulated by making explicit the dependence of the theory on given material and spacetime tensor fields that are transported by the world-tube of the continuum via the push-forward and pull-back operations. It is shown that the variational formulation, when augmented with the Gibbons-Hawking-York (GHY) boundary terms, also yields the Israel-Darmois junction conditions between the solution at the interior of the relativistic continua and the solution describing the gravity field produced outside from it. The expression of the first variation of the GHY term with respect to the hypersurface involves some extensions of previous results that we also derive in the paper. We consider in details the application of the variational framework to relativistic fluids and relativistic elasticity. For the latter case, our setting also allows to clarify the relation between formulations of relativistic elasticity based on the relativistic right Cauchy-Green tensor or on the relativistic Cauchy deformation tensor. The setting developed here will be further exploited for modelling purpose in subsequent parts of the paper.


title: Decreasing Minimization on Base-Polyhedra: Relation Between Discrete and Continuous Cases

abstract: This paper is concerned with the relationship between the discrete and the continuous decreasing minimization problem on base-polyhedra. The continuous version (under the name of lexicographically optimal base of a polymatroid) was solved by Fujishige in 1980, with subsequent elaborations described in his book (1991). The discrete counterpart of the dec-min problem (concerning M-convex sets) was settled only recently by the present authors, with a strongly polynomial algorithm to compute not only a single decreasing minimal element but also the matroidal structure of all decreasing minimal elements and the dual object called the canonical partition. The objective of this paper is to offer a complete picture on the relationship between the continuous and discrete dec-min problems on base-polyhedra by establishing novel technical results and integrating known results. In particular, we derive proximity results, asserting the geometric closeness of the decreasingly minimal elements in the continuous and discrete cases, by revealing the relation between the principal partition and the canonical partition. We also describe decomposition-type algorithms for the discrete case following the approach of Fujishige and Groenevelt.


title: Gamekins: Gamifying Software Testing in Jenkins

abstract: Developers have to write thorough tests for their software in order to find bugs and to prevent regressions. Writing tests, however, is not every developer's favourite occupation, and if a lack of motivation leads to a lack of tests, then this may have dire consequences, such as programs with poor quality or even project failures. This paper introduces Gamekins, a tool that uses gamification to motivate developers to write more and better tests. Gamekins is integrated into the Jenkins continuous integration platform where game elements are based on commits to the source code repository: Developers can earn points for completing test challenges and quests posed by Gamekins, compete with other developers or developer teams on a leaderboard, and are rewarded for their test-related achievements.


title: Saving RNN Computations with a Neuron-Level Fuzzy Memoization Scheme

abstract: Recurrent Neural Networks (RNNs) are a key technology for applications such as automatic speech recognition or machine translation. Unlike conventional feed-forward DNNs, RNNs remember past information to improve the accuracy of future predictions and, therefore, they are very effective for sequence processing problems. For each application run, recurrent layers are executed many times for processing a potentially large sequence of inputs (words, images, audio frames, etc.). In this paper, we observe that the output of a neuron exhibits small changes in consecutive invocations.~We exploit this property to build a neuron-level fuzzy memoization scheme, which dynamically caches each neuron's output and reuses it whenever it is predicted that the current output will be similar to a previously computed result, avoiding in this way the output computations. The main challenge in this scheme is determining whether the new neuron's output for the current input in the sequence will be similar to a recently computed result. To this end, we extend the recurrent layer with a much simpler Bitwise Neural Network (BNN), and show that the BNN and RNN outputs are highly correlated: if two BNN outputs are very similar, the corresponding outputs in the original RNN layer are likely to exhibit negligible changes. The BNN provides a low-cost and effective mechanism for deciding when fuzzy memoization can be applied with a small impact on accuracy. We evaluate our memoization scheme on top of a state-of-the-art accelerator for RNNs, for a variety of different neural networks from multiple application domains. We show that our technique avoids more than 26.7\% of computations, resulting in 21\% energy savings and 1.4x speedup on average.


title: Ergodic Achievable Rate Analysis and Optimization of RIS-assisted Millimeter-Wave MIMO Communication Systems

abstract: Reconfigurable intelligent surfaces (RISs) have emerged as a prospective technology for next-generation wireless networks due to their potential in coverage and capacity enhancement. Previous works on achievable rate analysis of RIS-assisted communication systems have mainly focused on the rich-scattering environment where Rayleigh and Rician channel models can be applied. This work studies the ergodic achievable rate of RIS-assisted multiple-input multiple-output communication systems in millimeter-wave band with limited scattering under the Saleh-Valenzuela channel model. Firstly, we derive an upper bound of the ergodic achievable rate by means of majorization theory and Jensen's inequality. The upper bound shows that the ergodic achievable rate increases logarithmically with the number of antennas at the base station (BS) and user, the number of the reflection units at the RIS, and the eigenvalues of the steering matrices associated with the BS, user and RIS. Then, we aim to maximize the ergodic achievable rate by jointly optimizing the transmit covariance matrix at the BS and the reflection coefficients at the RIS. Specifically, the transmit covariance matrix is optimized by the water-filling algorithm and the reflection coefficients are optimized using the Riemannian conjugate gradient algorithm. Simulation results validate the effectiveness of the proposed optimization algorithms.


title: Single-stage Rotate Object Detector via Two Points with Solar Corona Heatmap

abstract: Oriented object detection is a crucial task in computer vision. Current top-down oriented detection methods usually directly detect entire objects, and not only neglecting the authentic direction of targets, but also do not fully utilise the key semantic information, which causes a decrease in detection accuracy. In this study, we developed a single-stage rotating object detector via two points with a solar corona heatmap (ROTP) to detect oriented objects. The ROTP predicts parts of the object and then aggregates them to form a whole image. Herein, we meticulously represent an object in a random direction using the vertex, centre point with width, and height. Specifically, we regress two heatmaps that characterise the relative location of each object, which enhances the accuracy of locating objects and avoids deviations caused by angle predictions. To rectify the central misjudgement of the Gaussian heatmap on high-aspect ratio targets, we designed a solar corona heatmap generation method to improve the perception difference between the central and non-central samples. Additionally, we predicted the vertex relative to the direction of the centre point to connect two key points that belong to the same goal. Experiments on the HRSC 2016, UCASAOD, and DOTA datasets show that our ROTP achieves the most advanced performance with a simpler modelling and less manual intervention.


title: On $p$-adic $L$-functions for $\operatorname{GL}(2)\times\operatorname{GL}(3)$ via pullbacks of Saito--Kurokawa lifts

abstract: We build a one-variable $p$-adic $L$-function attached to two Hida families of ordinary $p$-stabilised newforms $\mathbf{f}$, $\mathbf{g}$, interpolating the algebraic part of the central values of the complex $L$-series $L(f \otimes \textrm{Ad}(g), s)$ when $f$ and $g$ range over the classical specialisations of $\mathbf{f}$, $\mathbf{g}$ on a suitable line of the weight space. The construction rests on two major results: an explicit formula for the relevant complex central $L$-values, and the existence of non-trivial $\Lambda$-adic Shintani liftings and Saito--Kurokawa liftings studied in a previous work by the authors. We also illustrate that, under an appropriate sign assumption, this $p$-adic $L$-function arises as a factor of a triple product $p$-adic $L$-function attached to $\mathbf{f}$, $\mathbf{g}$, and $\mathbf{g}$.


title: Observed dependence of characteristics of liquid-pool fires on swirl magnitude

abstract: One dozen vertically oriented thin rectangular vanes, 62 cm tall and 15.2 cm wide, were placed 27 cm from the center of heptane and ethanol pool fires in continuously fed, floor-flush pans 3.2 cm and 5.1 cm in diameter in the laboratory. The vanes were all oriented at the same fixed angles from the radial direction, for 9 different angles, ranging from 0 to 85 degrees, thereby imparting 9 different levels of circulation to the air entrained by each pool fire. The different swirl levels were observed to engender dramatically different pool-fire structures. Moderate swirl suppresses the global puffing instability, replacing it by a global helical instability that generates a tall fire whirl, the height of which increases with increasing circulation. Except for the largest heptane pool, higher swirl levels produced vortex breakdown, resulting in the emergence of a bubble-like recirculation region with a ring vortex encircling the axis. Measured burning rates increase with increasing swirl levels as a consequence of the associated increasing inflow velocities reducing the thickness of the boundary layer within which combustion occurs right above the liquid surface, eventually forming detached edge flames in the boundary layer that move closer to the axis as the circulation is increased. Still higher circulation reduces the burning rate by decreasing the surface area of the liquid covered by the flame, thereby reducing the height of the fire whirl. Even higher circulation causes edge-flame detachment, resulting in formation of the blue whirl identified in recent literature, often meandering over the surface of the liquid in the present experiments. This sequence of events is documented herein.