title: Tracer particles coupled to an interacting boson gas

abstract: In this work, we investigate the mean-field limit of a model consisting in $m \geq 1 $ tracer particles, coupled to an interacting boson field. We assume the mass of the tracer particles and the expected number of bosons to be of the same order of magnitude $N \geq 1 $ and we investigate the $N\rightarrow \infty $ limit. In particular, we show that the limiting system can be effectively described by a pair of variables $( \textbf{X}_t ,\varphi_t ) \in \mathbb{R}^{3m} \times H^1(\mathbb{R}^3)$ that solve a mean-field equation. Our methods are based on proving estimates for the number of bosonic particles in a suitable \textit{fluctuation state} $\Omega_{N,t }$. The main diffculty of the problem comes from the fact that the interaction with the tracer particles can create or destroy bosons for states close to the vacuum.


title: Controlling resonant enhancement in higher-order harmonic generation

abstract: We present a method to tune the resonantly enhanced harmonic emission from engineered potentials, which would be experimentally feasible in the purview of the recent advances in atomic and condensed matter physics. The recombination of the electron from the potential dependent excited state to the ground state causes the emission of photons with a specific energy. The energy of the emitted photons can be controlled by appropriately tweaking the potential parameters. The resonant enhancement in high-harmonic generation enables the emission of very intense extreme ultra-violet or soft x-ray radiations. The scaling law of the resonant harmonic emission with the model parameter of the potential is also obtained by numerically solving the time-dependent Schr\"odinger equation in two dimensions.


title: Density of compressible types and some consequences

abstract: We study compressible types in the context of (local and global) NIP. By extending a result in machine learning theory (the existence of a bound on the recursive teaching dimension), we prove density of compressible types. Using this, we obtain explicit uniform honest definitions for NIP formulas (answering a question of Eshel and the second author), and build compressible models in countable NIP theories.


title: Finding a Maximum Clique in a Grounded 1-Bend String Graph

abstract: A grounded 1-bend string graph is an intersection graph of a set of polygonal lines, each with one bend, such that the lines lie above a common horizontal line $\ell$ and have exactly one endpoint on $\ell$. We show that the problem of finding a maximum clique in a grounded 1-bend string graph is APX-hard, even for strictly $y$-monotone strings. For general 1-bend strings, the problem remains APX-hard even if we restrict the position of the bends and end-points to lie on at most three parallel horizontal lines. We give fast algorithms to compute a maximum clique for different subclasses of grounded segment graphs, which are formed by restricting the strings to various forms of $L$-shapes.


title: Towards High-Precision Parton Distributions From Lattice QCD via Distillation

abstract: We apply the Distillation spatial smearing program to the extraction of the unpolarized isovector valence PDF of the nucleon. The improved volume sampling and control of excited-states afforded by distillation leads to a dramatically improved determination of the requisite Ioffe-time Pseudo-distribution (pITD). The impact of higher-twist effects is subsequently explored by extending the Wilson line length present in our non-local operators to one half the spatial extent of the lattice ensemble considered. The valence PDF is extracted by analyzing both the matched Ioffe-time Distribution (ITD), as well as a direct matching of the pITD to the PDF. Through development of a novel prescription to obtain the PDF from the pITD, we establish a concerning deviation of the pITD from the expected DGLAP evolution of the pseudo-PDF. The presence of DGLAP evolution is observed once more following introduction of a discretization term into the PDF extractions. Observance and correction of this discrepancy further highlights the utility of distillation in such structure studies.


title: A Splitting Scheme for Flip-Free Distortion Energies

abstract: We introduce a robust optimization method for flip-free distortion energies used, for example, in parametrization, deformation, and volume correspondence. This method can minimize a variety of distortion energies, such as the symmetric Dirichlet energy and our new symmetric gradient energy. We identify and exploit the special structure of distortion energies to employ an operator splitting technique, leading us to propose a novel Alternating Direction Method of Multipliers (ADMM) algorithm to deal with the non-convex, non-smooth nature of distortion energies. The scheme results in an efficient method where the global step involves a single matrix multiplication and the local steps are closed-form per-triangle/per-tetrahedron expressions that are highly parallelizable. The resulting general-purpose optimization algorithm exhibits robustness to flipped triangles and tetrahedra in initial data as well as during the optimization. We establish the convergence of our proposed algorithm under certain conditions and demonstrate applications to parametrization, deformation, and volume correspondence.


title: Deep Risk Model: A Deep Learning Solution for Mining Latent Risk Factors to Improve Covariance Matrix Estimation

abstract: Modeling and managing portfolio risk is perhaps the most important step to achieve growing and preserving investment performance. Within the modern portfolio construction framework that built on Markowitz's theory, the covariance matrix of stock returns is a required input to calculate portfolio risk. Traditional approaches to estimate the covariance matrix are based on human-designed risk factors, which often require tremendous time and effort to design better risk factors to improve the covariance estimation. In this work, we formulate the quest of mining risk factors as a learning problem and propose a deep learning solution to effectively ``design'' risk factors with neural networks. The learning objective is also carefully set to ensure the learned risk factors are effective in explaining the variance of stock returns as well as having desired orthogonality and stability. Our experiments on the stock market data demonstrate the effectiveness of the proposed solution: our method can obtain $1.9\%$ higher explained variance measured by $R^2$ and also reduce the risk of a global minimum variance portfolio. The incremental analysis further supports our design of both the architecture and the learning objective.


title: Delta Sampling R-BERT for limited data and low-light action recognition

abstract: We present an approach to perform supervised action recognition in the dark. In this work, we present our results on the ARID dataset. Most previous works only evaluate performance on large, well illuminated datasets like Kinetics and HMDB51. We demonstrate that our work is able to achieve a very low error rate while being trained on a much smaller dataset of dark videos. We also explore a variety of training and inference strategies including domain transfer methodologies and also propose a simple but useful frame selection strategy. Our empirical results demonstrate that we beat previously published baseline models by 11%.


title: Quantum Illumination with three-mode Gaussian State

abstract: The quantum illumination is examined by making use of the three-mode maximally entangled Gaussian state, which involves one signal and two idler beams. It is shown that the quantum Bhattacharyya bound between $\rho$ (state for target absence) and $\sigma$ (state for target presence) is less than the previous result derived by two-mode Gaussian state when $N_S$, average photon number per signal, is less than $0.295$. This indicates that the quantum illumination with three-mode Gaussian state gives less error probability compared to that with two-mode Gaussian state when $N_S < 0.295$.


title: Sliding Spectrum Decomposition for Diversified Recommendation

abstract: Content feed, a type of product that recommends a sequence of items for users to browse and engage with, has gained tremendous popularity among social media platforms. In this paper, we propose to study the diversity problem in such a scenario from an item sequence perspective using time series analysis techniques. We derive a method called sliding spectrum decomposition (SSD) that captures users' perception of diversity in browsing a long item sequence. We also share our experiences in designing and implementing a suitable item embedding method for accurate similarity measurement under long tail effect. Combined together, they are now fully implemented and deployed in Xiaohongshu App's production recommender system that serves the main Explore Feed product for tens of millions of users every day. We demonstrate the effectiveness and efficiency of the method through theoretical analysis, offline experiments and online A/B tests.


title: Connectedness of affine Deligne-Lusztig varieties for unramified groups

abstract: For unramified reductive groups, we determine the connected components of affine Deligne-Lusztig varieties in the partial affine flag varieties. Based on the work of Hamacher-Kim and Zhou, this result allows us to verify, in the unramified group case, the He-Rapoport axioms, the ``almost product structure" of Newton strata, and the precise description of mod $p$ isogeny classes predicted by the Langlands-Rapoport conjecture, for the Kisin-Pappas integral models of Shimura varieties of Hodge type with parahoric level structure.


title: Total mass density slopes of early-type galaxies using Jeans dynamical modelling at redshifts $0.29 < z < 0.55$

abstract: The change of the total mass density slope, $\gamma$, of early-type galaxies through cosmic time is a probe of evolutionary pathways. Hydrodynamical cosmological simulations show that at high redshifts density profiles of early-type galaxies were on average steep ($\gamma \sim -3$). As redshift approaches zero, gas-poor mergers progressively cause the total mass density slope to approach the `isothermal' slope of $\gamma \sim -2$. Simulations therefore predict steep density slopes at high redshifts, with little to no evolution in density slopes below $z \sim 1$. Gravitational lensing results in the same redshift range find the opposite, namely a significant trend of shallow density slopes at high redshifts, becoming steeper as redshift approaches zero. Gravitational lensing results indicate a different evolutionary mechanism for early-type galaxies than dry merging, such as continued gas accretion or off-axis mergers. At redshift zero, isothermal solutions are obtained by both simulations and dynamical modelling. This work applies the Jeans dynamical modelling technique to observations of galaxies at intermediate redshifts ($0.29 < z < 0.55 $) in order to derive density slopes to address the tension between observations and simulations. We combine two-dimensional kinematic fields from MUSE data with Hubble Space Telescope photometry. The density slopes of 90 early-type galaxies from the Frontier Fields project are presented. The total sample has a median of ${\gamma = -2.11 \pm 0.03}$ (standard error), in agreement with dynamical modelling studies at redshift zero. The lack of evolution in total density slopes in the past 4-6 Gyrs supports a dry merging model for early-type galaxy evolution.


title: Implications of vanishing Krein parameters on Delsarte designs, with applications in finite geometry

abstract: In this paper we show that if $\theta$ is a $T$-design of an association scheme $(\Omega, \mathcal{R})$, and the Krein parameters $q_{i,j}^h$ vanish for some $h \not \in T$ and all $i, j \not \in T$ ($i, j, h \neq 0$), then $\theta$ consists of precisely half of the vertices of $(\Omega, \mathcal{R})$ or it is a $T'$-design, where $|T'|>|T|$. We then apply this result to various problems in finite geometry. In particular, we show for the first time that nontrivial $m$-ovoids of generalised octagons of order $(s, s^2)$ do not exist. We give short proofs of similar results for (i) partial geometries with certain order conditions; (ii) thick generalised quadrangles of order $(s,s^2)$; (iii) the dual polar spaces $\mathsf{DQ}(2d, q)$, $\mathsf{DW}(2d-1,q)$ and $\mathsf{DH}(2d-1,q^2)$, for $d \ge 3$; (iv) the Penttila-Williford scheme. In the process of (iv), we also consider a natural generalisation of the Penttila-Williford scheme in $\mathsf{Q}^-(2n-1, q)$, $n\geqslant 3$.


title: Perspective on witnessing entanglement in hybrid quantum systems

abstract: Hybrid quantum systems aim at combining the advantages of different physical systems and to produce novel quantum devices. In particular, the hybrid combination of superconducting circuits and spins in solid-state crystals is a versatile platform to explore many quantum electrodynamics problems. Recently, the remote coupling of nitrogen-vacancy center spins in diamond via a superconducting bus was demonstrated. However, a rigorous experimental test of the quantum nature of this hybrid system and in particular entanglement is still missing. We review the theoretical ideas to generate and detect entanglement, and present our own scheme to achieve this.


title: Properties of spin-1/2 heavy baryons at nonzero temperature

abstract: The spectroscopic properties of single heavy spin-1/2 $\Lambda_{Q}$, $\Sigma_{Q}$, $\Xi^{(\prime)}_{Q}$ and $ \Omega_{Q}$ baryons are investigated at finite temperature in the framework of thermal QCD sum rule. We discuss the behavior of the mass and residue of these baryons with respect to temperature taking into account contributions of non-perturbative operators up to dimension eight. We include additional operators coming from the Wilson expansion due to breaking the Lorentz invariance at non-zero temperature. The obtained results show that the mass of these baryons remain stable up to roughly $T=108$ MeV while their residue are unchanged up to $T=93$ MeV. After these points, the mass and residue start to diminish by increasing the temperature. The shifts in the mass and residue for both the bottom and charm channels are considerably large and we observe the melting of these baryons near to the pseudo-critical temperature determined by recent lattice QCD calculations. We present our results for the mass of these baryons with both the positive and negative parity at $ T\rightarrow 0 $ limit, which are consistent with the existing theoretical predictions as well as experimental data.


title: Non-vanishing sharp-fronted travelling wave solutions of the Fisher-Kolmogorov model

abstract: The Fisher-KPP model, and generalisations thereof, is a simple reaction-diffusion models of biological invasion that assumes individuals in the population undergo linear diffusion with diffusivity $D$, and logistic proliferation with rate $\lambda$. Biologically-relevant initial conditions lead to long-time travelling wave solutions that move with speed $c=2\sqrt{\lambda D}$. Despite these attractive features, there are several biological limitations of travelling wave solutions of the Fisher-KPP model. First, these travelling wave solutions do not predict a well-defined invasion front. Second, biologically-relevant initial conditions lead to travelling waves that move with speed $c=2\sqrt{\lambda D} > 0$. This means that, for biologically-relevant initial data, the Fisher-KPP model can not be used to study invasion with $c \ne 2\sqrt{\lambda D}$, or retreating travelling waves with $c < 0$. Here, we reformulate the Fisher-KPP model as a moving boundary problem on $x < s(t)$, and we show that this reformulated model alleviates the key limitations of the Fisher-KPP model. Travelling wave solutions of the moving boundary problem predict a well-defined front, and can propagate with any wave speed, $-\infty < c < \infty$. Here, we establish these results using a combination of high-accuracy numerical simulations of the time-dependent partial differential equation, phase plane analysis and perturbation methods. All software required to replicate this work is available on GitHub.


title: The Bloch theorem in the presence of an additional conserved charge

abstract: The Bloch theorem is a general theorem restricting the persistent current associated with a conserved U(1) charge in a ground state or in a thermal equilibrium. It gives an upper bound of the magnitude of the current density, which is inversely proportional to the system size. In a recent paper, Else and Senthil applied the argument for the Bloch theorem to a generalized Gibbs ensemble, assuming the presence of an additional conserved charge, and predicted a nonzero current density in the nonthermal steady state [D. V. Else and T. Senthil, Phys. Rev. B 104, 205132 (2021)]. In this work, we provide a complementary derivation based on the canonical ensemble, given that the additional charge is strictly conserved within the system by itself. Furthermore, using the example where the additional conserved charge is the momentum operator, we discuss that the persistent current tends to vanish when the system is in contact with an external momentum reservoir in the co-moving frame of the reservoir.

categories: cond-mat.stat-mech cond-mat.other cond-mat.quant-gas cond-mat.str-el cond-mat.supr-con


title: Spectrum Composition of Galactic Center X-ray Emission with Point and Diffuse X-ray Sources

abstract: This paper reports that the X-ray spectrum from the Galactic Center X-ray Emission (GCXE) is expressed by the assembly of active binaries, non-magnetic Cataclysmic Variables, magnetic Cataclysmic Variables (X-ray active star: XAS), cold matter and diffuse sources. In the fitting of the limited components of the XASs, the GCXE spectrum exhibits significant excesses with $\chi^2/d.o.f. =5.67$. The excesses are found at the energies of K$\alpha$, He$\alpha$, Ly$\alpha$ and radiative recombination continuum of S, Fe and Ni. By adding components of the cold matter and the diffuse sources, the GCXE spectrum is nicely reproduced with $\chi^2/d.o.f. = 1.53$, which is a first quantitative model for the origin of the GCXE spectrum. The drastic improvement is mainly due to the recombining plasmas in the diffuse sources, which indicate the presence of high-energy activity of Sgr A$^*$ in the past of $> 1000$~years.


title: Application of the Hilbert-Huang transform for analyzing standing-accretion-shock-instability induced gravitational waves in a core-collapse supernova

abstract: Through numerical simulations, it is predicted that the gravitational waves (GWs) reflect the characteristics of the core-collapse supernova (CCSN) explosion mechanism. There are multiple GW excitation processes that occur inside a star before its explosion, and it is suggested that the GWs originating from the CCSN have a mode for each excitation process in terms of time-frequency representation. Therefore, we propose an application of the Hilbert-Huang Transform (HHT), which is a high-resolution time-frequency analysis method, to analyze these GW modes for theoretically probing and increasing our understanding of the explosion mechanism. The HHT defines frequency as a function of time, and is not bound by the trade-off between time and frequency resolutions. In this study, we analyze a gravitational waveform obtained from a three-dimensional general-relativistic CCSN model that showed a vigorous activity of the standing-accretion-shock-instability (SASI). We succeed in extracting the SASI induced GWs with high resolution on a time-frequency representation using the HHT and we examine their instantaneous frequencies.


title: Split, embed and merge: An accurate table structure recognizer

abstract: Table structure recognition is an essential part for making machines understand tables. Its main task is to recognize the internal structure of a table. However, due to the complexity and diversity in their structure and style, it is very difficult to parse the tabular data into the structured format which machines can understand easily, especially for complex tables. In this paper, we introduce Split, Embed and Merge (SEM), an accurate table structure recognizer. Our model takes table images as input and can correctly recognize the structure of tables, whether they are simple or a complex tables. SEM is mainly composed of three parts, splitter, embedder and merger. In the first stage, we apply the splitter to predict the potential regions of the table row (column) separators, and obtain the fine grid structure of the table. In the second stage, by taking a full consideration of the textual information in the table, we fuse the output features for each table grid from both vision and language modalities. Moreover, we achieve a higher precision in our experiments through adding additional semantic features. Finally, we process the merging of these basic table grids in a self-regression manner. The correspondent merging results is learned through the attention mechanism. In our experiments, SEM achieves an average F1-Measure of 97.11% on the SciTSR dataset which outperforms other methods by a large margin. We also won the first place in the complex table and third place in all tables in ICDAR 2021 Competition on Scientific Literature Parsing, Task-B. Extensive experiments on other publicly available datasets demonstrate that our model achieves state-of-the-art.


title: Large anomalous Nernst effect in non-crystalline Gd-Fe ferrimagnetic alloy films for flexible thermoelectric applications

abstract: The anomalous Nernst effect (ANE), a heat-charge conversion mechanism based on a magnetic metal, has been extensively studied for application in thin thermoelectric devices. The low magnetization and fabrication at room temperature are important for flexible ANE thermoelectric devices on plastic substrates. Therefore, we investigated the ANE in ferrimagnetic GdxFe100-x films with low magnetization in this study by systematically varying the Gd composition x. Although the Gd33Fe67 film with a Gd composition close to magnetic compensation composition exhibited very low magnetization, an ANE coefficient |S_ANE| of 2.13 uV/K was obtained, which is close to the highest value reported thus far. Finally, we demonstrated the ANE in a Gd33Fe67 film deposited on a flexible sheet. A sufficient ANE voltage was obtained while maintaining the flexibility of the sample, indicating the potential application of this material in thermoelectric devices exploiting the ANE of Gd-Fe films.


title: A Simple Reward-free Approach to Constrained Reinforcement Learning

abstract: In constrained reinforcement learning (RL), a learning agent seeks to not only optimize the overall reward but also satisfy the additional safety, diversity, or budget constraints. Consequently, existing constrained RL solutions require several new algorithmic ingredients that are notably different from standard RL. On the other hand, reward-free RL is independently developed in the unconstrained literature, which learns the transition dynamics without using the reward information, and thus naturally capable of addressing RL with multiple objectives under the common dynamics. This paper bridges reward-free RL and constrained RL. Particularly, we propose a simple meta-algorithm such that given any reward-free RL oracle, the approachability and constrained RL problems can be directly solved with negligible overheads in sample complexity. Utilizing the existing reward-free RL solvers, our framework provides sharp sample complexity results for constrained RL in the tabular MDP setting, matching the best existing results up to a factor of horizon dependence; our framework directly extends to a setting of tabular two-player Markov games, and gives a new result for constrained RL with linear function approximation.


title: Cautious Actor-Critic

abstract: The oscillating performance of off-policy learning and persisting errors in the actor-critic (AC) setting call for algorithms that can conservatively learn to suit the stability-critical applications better. In this paper, we propose a novel off-policy AC algorithm cautious actor-critic (CAC). The name cautious comes from the doubly conservative nature that we exploit the classic policy interpolation from conservative policy iteration for the actor and the entropy-regularization of conservative value iteration for the critic. Our key observation is the entropy-regularized critic facilitates and simplifies the unwieldy interpolated actor update while still ensuring robust policy improvement. We compare CAC to state-of-the-art AC methods on a set of challenging continuous control problems and demonstrate that CAC achieves comparable performance while significantly stabilizes learning.


title: Hawking-Page phase transition, Page curve and islands in black holes

abstract: We study the effect of the Hawking-Page phase transition on the Page Curve for the BTZ black hole coupled to two thermal baths and with the inclusion of island. The Page Curve is shown by us when the Hawking-Page phase transition happens. The results show that the Hawking-Page phase transition may happen before the Page time or after the Page time under certain conditions. We also study the holographic entanglement entropy when the Hawking-Page phase transition happens for the BTZ black hole in the gauge/gravity setup and derive a first law of entanglement in the boundary and bulk. If a first law of entanglement thermodynamics is universally true, then we can conjecture that all the information of the black hole will come out at the critical temperature when the Hawking-Page phase transition happens. Furthermore, We further speculate that the effect of the first-order phase transition of black holes on the black hole information is universal. These results mean that black holes information does not have to escape by the radiation, and the first-order phase transition of black holes can also cause information to escape.


title: CatVRNN: Generating Category Texts via Multi-task Learning

abstract: Controlling the model to generate texts of different categories is a challenging task that is receiving increasing attention. Recently, generative adversarial networks (GANs) have shown promising results for category text generation. However, the texts generated by GANs usually suffer from problems of mode collapse and training instability. To avoid the above problems, in this study, inspired by multi-task learning, a novel model called category-aware variational recurrent neural network (CatVRNN) is proposed. In this model, generation and classification tasks are trained simultaneously to generate texts of different categories. The use of multi-task learning can improve the quality of the generated texts, when the classification task is appropriate. In addition, a function is proposed to initialize the hidden state of the CatVRNN to force the model to generate texts of a specific category. Experimental results on three datasets demonstrate that the model can outperform state-of-the-art text generation methods based on GAN in terms of diversity of generated texts.


title: On the undecidability of the Panopticon detection problem

abstract: The Panopticon (which means "watcher of everything") is a well-known structure of continuous surveillance and discipline proposed by Bentham in 1785. This device was, later, used by Foucault and other philosophers as a paradigm and metaphor for the study of constitutional power and knowledge as well as a model of individuals' deprivation of freedom. Nowadays, technological achievements have given rise to new, non-physical (unlike prisons), means of constant surveillance that transcend physical boundaries. This, combined with the confession of some governmental institutions that they actually collaborate with these Internet giants to collect or deduce information about people, creates a worrisome situation of several co-existing Panopticons that can act separately or in close collaboration. Thus, they can only be detected and identified through the expense of (perhaps considerable) effort. In this paper we provide a theoretical framework for studying the detectability status of Panopticons that fall under two theoretical, but not unrealistic, definitions. We show, using Oracle Turing Machines, that detecting modern day, ICT-based, Panopticons is an undecidable problem. Furthermore, we show that for each sufficiently expressive formal system, we can effectively construct a Turing Machine for which it is impossible to prove, within the formal system, either that it is a Panopticon or it is not a Panopticon.


title: A Catalogue of Potential Post Common Envelope Binaries

abstract: We present a catalogue containing 839 candidate post common envelope systems. Common envelope evolution is very important in stellar astrophysics, particularly in the context of very compact and short-period binaries, including cataclysmic variables, as progenitors of e.g. supernovae type Ia or mergers of black holes and/or neutron stars. At the same time it is a barely understood process in binary evolution. Due to limitations, since partially remedied, on direct simulation, early investigations were mainly focused on providing analytic prescriptions of the outcome of common envelope evolution. In recent years, detailed hydrodynamical calculations have produced deeper insight into the previously elusive process of envelope ejection. However, a direct link between observations and theory of this relatively short-lived phase in binary evolution has not been forthcoming. Therefore, the main insight to be gained from observations has to be derived from the current state of systems likely to have gone through a common envelope. Here we present an extensive catalogue of such observations as found in the literature. The aim of this paper is to provide a reliable set of data, obtained from observations, to be used in the theoretical modelling of common envelope evolution. In this catalogue, the former common envelope donor star is commonly observed as a white dwarf star or as a hot sub-dwarf star. This catalogue includes period and mass estimates, wherever obtainable. Some binaries are border line cases to allow an investigation of the transition between a common envelope formation and other mass-transfer processes.


title: Perceptual-based deep-learning denoiser as a defense against adversarial attacks on ASR systems

abstract: In this paper we investigate speech denoising as a defense against adversarial attacks on automatic speech recognition (ASR) systems. Adversarial attacks attempt to force misclassification by adding small perturbations to the original speech signal. We propose to counteract this by employing a neural-network based denoiser as a pre-processor in the ASR pipeline. The denoiser is independent of the downstream ASR model, and thus can be rapidly deployed in existing systems. We found that training the denoisier using a perceptually motivated loss function resulted in increased adversarial robustness without compromising ASR performance on benign samples. Our defense was evaluated (as a part of the DARPA GARD program) on the 'Kenansville' attack strategy across a range of attack strengths and speech samples. An average improvement in Word Error Rate (WER) of about 7.7% was observed over the undefended model at 20 dB signal-to-noise-ratio (SNR) attack strength.


title: BERT-like Pre-training for Symbolic Piano Music Classification Tasks

abstract: This article presents a benchmark study of symbolic piano music classification using the masked language modelling approach of the Bidirectional Encoder Representations from Transformers (BERT). Specifically, we consider two types of MIDI data: MIDI scores, which are musical scores rendered directly into MIDI with no dynamics and precisely aligned with the metrical grid notated by its composer and MIDI performances, which are MIDI encodings of human performances of musical scoresheets. With five public-domain datasets of single-track piano MIDI files, we pre-train two 12-layer Transformer models using the BERT approach, one for MIDI scores and the other for MIDI performances, and fine-tune them for four downstream classification tasks. These include two note-level classification tasks (melody extraction and velocity prediction) and two sequence-level classification tasks (style classification and emotion classification). Our evaluation shows that the BERT approach leads to higher classification accuracy than recurrent neural network (RNN)-based baselines.


title: Fock State-enhanced Expressivity of Quantum Machine Learning Models

abstract: The data-embedding process is one of the bottlenecks of quantum machine learning, potentially negating any quantum speedups. In light of this, more effective data-encoding strategies are necessary. We propose a photonic-based bosonic data-encoding scheme that embeds classical data points using fewer encoding layers and circumventing the need for nonlinear optical components by mapping the data points into the high-dimensional Fock space. The expressive power of the circuit can be controlled via the number of input photons. Our work shed some light on the unique advantages offers by quantum photonics on the expressive power of quantum machine learning models. By leveraging the photon-number dependent expressive power, we propose three different noisy intermediate-scale quantum-compatible binary classification methods with different scaling of required resources suitable for different supervised classification tasks.


title: Compositional Vulnerability Detection with Insecurity Separation Logic (Extended Version)

abstract: Memory-safety issues and information leakage are known to be depressingly common. We consider the compositional static detection of these kinds of vulnerabilities in first-order C-like programs. Indeed the latter are relational hyper-safety violations, comparing pairs of program executions, making them more challenging to detect than the former, which require reasoning only over individual executions. Existing symbolic leakage detection methods treat only non-interactive programs, avoiding the challenges of nondeterminism. Also, being whole-program analyses they cannot be applied one-function-at-a-time, thereby ruling out incremental analysis. We remedy these shortcomings by presenting Insecurity Separation Logic (InsecSL), an under-approximate relational program logic for soundly detecting information leakage and memory-safety issues in interactive programs. Importantly, InsecSL reasons about pairs of executions, and so is relational, but purposefully resembles the non-relational Incorrectness Separation Logic (ISL) that is already automated in the Infer tool. We show how InsecSL can be automated by bi-abduction based symbolic execution, and we evaluate two implementations of this idea (one based on Infer) on various case-studies.


title: Large-time limit of nonlinearly coupled measure-valued equations that model many-server queues with reneging

abstract: The large-time behavior of a nonlinearly coupled pair of measure-valued transport equations with discontinuous boundary conditions, parameterized by a positive real-valued parameter $\lambda$, is considered. These equations describe the hydrodynamic or fluid limit of many-server queues with reneging (with traffic intensity $\lambda$), which model phenomena in diverse disciplines, including biology and operations research. For a broad class of reneging distributions with finite mean and service distributions with finite mean and hazard rate function that is either decreasing or bounded away from zero and infinity, it is shown that if the fluid equations have a unique invariant state, then the Dirac measure at this state is the unique random fixed point of the fluid equations, which implies that the stationary distributions of scaled $N$-server systems converge to the unique invariant state of the corresponding fluid equations. Moreover, when $\lambda\ne 1$, it is shown that the solution to the fluid equation starting from any initial condition converges to this unique invariant state in the large time limit. The proof techniques are different under the two sets of assumptions on the service distribution. When the hazard rate function is decreasing, a reformulation of the dynamics in terms of a certain renewal equation is used, in conjunction with recursive asymptotic estimates. When the hazard rate function is bounded away from zero and infinity, the proof uses an extended relative entropy functional as a Lyapunov function. Analogous large-time convergence results are also established for a system of coupled measure-valued equations modeling a multiclass queue.


title: A Sublinear Bound on the Page Number of Upward Planar Graphs

abstract: The page number of a directed acyclic graph $G$ is the minimum $k$ for which there is a topological ordering of $G$ and a $k$-coloring of the edges such that no two edges of the same color cross, i.e., have alternating endpoints along the topological ordering. We address the long-standing open problem asking for the largest page number among all upward planar graphs. We improve the best known lower bound to $5$ and present the first asymptotic improvement over the trivial $O(n)$ upper bound, where $n$ denotes the number of vertices in $G$. Specifically, we first prove that the page number of every upward planar graph is bounded in terms of its width, as well as its height. We then combine both approaches to show that every $n$-vertex upward planar graph has page number $O(n^{2/3} \log(n)^{2/3})$.


title: Distinguishability and "which pathway" information in multidimensional interferometric spectroscopy with a single entangled photon-pair

abstract: Correlated photons inspire abundance of metrology-related platforms, which benefit from quantum (anti-) correlations and outperform their classical-light counterparts. While such demonstrations mainly focus on entanglement, the role of photon exchange-phase and degree of distinguishability have not been widely utilized in quantum-enhanced applications. Using an interferometric setup we show that even at low degree entanglement, when a two-photon wave-function is coupled to matter, it is encoded with a reliable "which pathway?" information. An interferometric exchange-phase-cycling protocol is developed, which enables phase-sensitive discrimination between microscopic interaction histories (pathways). We find that quantum-light interferometry facilitates utterly different set of time-delay variables, which are unbound by uncertainty to the inverse bandwidth of the wave-packet. We illustrate our findings on an exciton model-system, and demonstrate how to probe intraband dephasing in time-domain without temporal resolution at the detection. The exotic scaling of multiphoton coincidence with respect to the applied intensity is discussed.


title: Generalized coherent states of exceptional Scarf-I potential: Their spatio-temporal and statistical properties

abstract: We construct generalized coherent states for the rationally extended Scarf-I potential. Statistical and geometrical properties of these states are investigated. Special emphasis is given to the study of spatio-temporal properties of the coherent states via the quantum carpet structure and the auto-correlation function. Through this study, we aim to find the signature of the `"rationalisation" of the conventional potentials and the classical orthogonal polynomials.


title: Predicting sepsis in multi-site, multi-national intensive care cohorts using deep learning

abstract: Despite decades of clinical research, sepsis remains a global public health crisis with high mortality, and morbidity. Currently, when sepsis is detected and the underlying pathogen is identified, organ damage may have already progressed to irreversible stages. Effective sepsis management is therefore highly time-sensitive. By systematically analysing trends in the plethora of clinical data available in the intensive care unit (ICU), an early prediction of sepsis could lead to earlier pathogen identification, resistance testing, and effective antibiotic and supportive treatment, and thereby become a life-saving measure. Here, we developed and validated a machine learning (ML) system for the prediction of sepsis in the ICU. Our analysis represents the largest multi-national, multi-centre in-ICU study for sepsis prediction using ML to date. Our dataset contains $156,309$ unique ICU admissions, which represent a refined and harmonised subset of five large ICU databases originating from three countries. Using the international consensus definition Sepsis-3, we derived hourly-resolved sepsis label annotations, amounting to $26,734$ ($17.1\%$) septic stays. We compared our approach, a deep self-attention model, to several clinical baselines as well as ML baselines and performed an extensive internal and external validation within and across databases. On average, our model was able to predict sepsis with an AUROC of $0.847 \pm 0.050$ (internal out-of sample validation) and $0.761 \pm 0.052$ (external validation). For a harmonised prevalence of $17\%$, at $80\%$ recall our model detects septic patients with $39\%$ precision 3.7 hours in advance.


title: Localized heat diffusion in topological thermal materials

abstract: Various unusual behaviors of artificial materials are governed by their topological properties, among which the edge state at the boundary of a photonic or phononic lattice has been captivated as a popular notion. However, this remarkable bulk-boundary correspondence and the related phenomena are missing in thermal materials. One reason is that heat diffusion is described in a non-Hermitian framework because of its dissipative nature. The other is that the relevant temperature field is mostly composed of modes that extend over wide ranges, making it difficult to be rendered within the tight-binding theory as commonly employed in wave physics. Here, we overcome the above challenges and perform systematic studies on heat diffusion in thermal lattices. Based on a continuum model, we introduce a state vector to link the Zak phase with the existence of the edge state, and thereby analytically prove the thermal bulk-boundary correspondence. We experimentally demonstrate the predicted edge states with a topologically protected and localized heat dissipation capacity. Our finding sets up a solid foundation to explore the topology in novel heat transfer manipulations.


title: Reconstruction of a source domain from the Cauchy data: II. Three dimensional case

abstract: This paper is concerned with reconstruction issue of some typical inverse problems and consists of three parts. First a framework of the enclosure method for an inverse source problem governed by the Helmholtz equation at a fixed wave number in three dimensions is introduced. It is based on the nonvanishing of the coefficient of the leading profile of an oscillatory integral over a domain having a conical singularity. Second an explicit formula of the coefficient for a domain having a circular cone singularity and its implication under the framework are given. Third, an application under the framework to an inverse obstacle problem governed by an inhomogeneous Helmholtz equation at a fixed wave number in three dimensions is given.


title: UniSpeech at scale: An Empirical Study of Pre-training Method on Large-Scale Speech Recognition Dataset

abstract: Recently, there has been a vast interest in self-supervised learning (SSL) where the model is pre-trained on large scale unlabeled data and then fine-tuned on a small labeled dataset. The common wisdom is that SSL helps resource-limited tasks in which only a limited amount of labeled data is available. The benefit of SSL keeps diminishing when the labeled training data amount increases. To our best knowledge, at most a few thousand hours of labeled data was used in the study of SSL. In contrast, the industry usually uses tens of thousands of hours of labeled data to build high-accuracy speech recognition (ASR) systems for resource-rich languages. In this study, we take the challenge to investigate whether and how SSL can improve the ASR accuracy of a state-of-the-art production-scale Transformer-Transducer model, which was built with 65 thousand hours of anonymized labeled EN-US data.


title: $\mathfrak{sl}_2$ triples whose nilpositive elements are in a space which is spanned by the real root vectors in rank 2 symmetric hyperbolic Kac-Moody Lie algebras

abstract: In analogy to the theory of nilpotent orbit in finite-dimensional semisimple Lie algebras, it is known that the principal $\mathfrak{sl}_2$ subalgebras can be constructed in hyperbolic Kac-Moody Lie algebras. We obtained a series of $\mathfrak{sl}_2$ subalgebras in rank 2 symmetric hyperbolic Kac-Moody Lie algebras by extending the aforementioned construction. We present this result and also discuss $\mathfrak{sl}_2$ modules obtained by the action of the $\mathfrak{sl}_2$ subalgebras on the original Lie algebras.


title: Position-enhanced and Time-aware Graph Convolutional Network for Sequential Recommendations

abstract: Most of the existing deep learning-based sequential recommendation approaches utilize the recurrent neural network architecture or self-attention to model the sequential patterns and temporal influence among a user's historical behavior and learn the user's preference at a specific time. However, these methods have two main drawbacks. First, they focus on modeling users' dynamic states from a user-centric perspective and always neglect the dynamics of items over time. Second, most of them deal with only the first-order user-item interactions and do not consider the high-order connectivity between users and items, which has recently been proved helpful for the sequential recommendation. To address the above problems, in this article, we attempt to model user-item interactions by a bipartite graph structure and propose a new recommendation approach based on a Position-enhanced and Time-aware Graph Convolutional Network (PTGCN) for the sequential recommendation. PTGCN models the sequential patterns and temporal dynamics between user-item interactions by defining a position-enhanced and time-aware graph convolution operation and learning the dynamic representations of users and items simultaneously on the bipartite graph with a self-attention aggregator. Also, it realizes the high-order connectivity between users and items by stacking multi-layer graph convolutions. To demonstrate the effectiveness of PTGCN, we carried out a comprehensive evaluation of PTGCN on three real-world datasets of different sizes compared with a few competitive baselines. Experimental results indicate that PTGCN outperforms several state-of-the-art models in terms of two commonly-used evaluation metrics for ranking.


title: Nonlinear two-level dynamics of quantum time crystals

abstract: A time crystal is a macroscopic quantum system in periodic motion in its ground state, stable only if isolated from energy exchange with the environment. For this reason, coupling separate time crystals is challenging, and time crystals in a dynamic environment have yet not been studied. In our experiments, two coupled time crystals made of spin-wave quasiparticles (magnons) form a macroscopic two-level system. The two levels evolve in time as determined intrinsically by a nonlinear feedback. Magnons move from the ground level to the excited level driven by the Landau-Zener effect, combined with Rabi population oscillations. We thus demonstrate how to arrange spontaneous dynamics between interacting time crystals. Our experiments allow access to every aspect and detail of the interaction in a single run of the experiment, inviting technological exploitation-- potentially even at room temperature.


title: On the Stable category of maximal Cohen-Macaulay modules over Gorenstein rings

abstract: Let $(A,\mathfrak{m})$ be a Gorenstein local ring and let $CMS(A)$ be its stable category of maximal CM $A$-modules. Suppose $CMS(A) \cong CMS(B)$ as triangulated categories. Then we show (1) If $A$ is a complete intersection of codimension $c$ then so is $B$. (2) If $A, B$ are Henselian and not hypersurfaces then $\dim A = \dim B$. (3) If $A, B$ are Henselian and $A$ is an isolated singularity then so is $B$. We also give some applications of our results. It should be remarked that if $R,S$ are complete CM but not necessarily Gorenstein and if there is an triangle isomorphism between the singularity categories of $R$ and $S$ then it is possible that $\dim R - \dim S$ is odd, see M.~Kalck; Adv. Math. 390 (2021), Paper No. 107913.


title: Training of deep cross-modality conversion models with a small dataset, and their application in megavoltage CT to kilovoltage CT conversion

abstract: In recent years, deep-learning-based image processing has emerged as a valuable tool for medical imaging owing to its high performance. However, the quality of deep-learning-based methods heavily relies on the amount of training data; the high cost of acquiring a large dataset is a limitation to their utilization in medical fields. Herein, based on deep learning, we developed a computed tomography (CT) modality conversion method requiring only a few unsupervised images. The proposed method is based on CycleGAN with several extensions tailored for CT images, which aims at preserving the structure in the processed images and reducing the amount of training data. This method was applied to realize the conversion of megavoltage computed tomography (MVCT) to kilovoltage computed tomography (kVCT) images. Training was conducted using several datasets acquired from patients with head and neck cancer. The size of the datasets ranged from 16 slices (two patients) to 2745 slices (137 patients) for MVCT and 2824 slices (98 patients) for kVCT. The required size of the training data was found to be as small as a few hundred slices. By statistical and visual evaluations, the quality improvement and structure preservation of the MVCT images converted by the proposed model were investigated. As a clinical benefit, it was observed by medical doctors that the converted images enhanced the precision of contouring. We developed an MVCT to kVCT conversion model based on deep learning, which can be trained using only a few hundred unpaired images. The stability of the model against changes in data size was demonstrated. This study promotes the reliable use of deep learning in clinical medicine by partially answering commonly asked questions, such as "Is our data sufficient?" and "How much data should we acquire?"


title: Phase-change perovskite tunable microlaser

abstract: Since the invention of the laser, adoption of new gain media and device architectures has provided solutions to a variety of applications requiring specific power, size, spectral, spatial, and temporal tunability. Here we introduce a fundamentally new type of tunable semiconductor laser based on a phase-change perovskite metasurface that acts simultaneously as gain medium and optical cavity. As a proof of principle demonstration, we fabricate a subwavelength-thin perovskite metasurface supporting bound states in the continuum (BICs). Upon the perovskite structural phase transitions, both its refractive index and gain vary substantially, inducing fast (1.35 nm/K rate) and broad spectral tunability (>15 nm in the near-infrared), deterministic spatial mode hopping between polarization vortexes, and hysteretic optical bistability of the microlaser. These features highlight the uniqueness of phase-change perovskite tunable lasers, which may find wide applications in compact and low-cost optical multiplexers, sensors, memories, and LIDARs.


title: Linear Quadratic Leader-follower Stochastic Differential Games: Closed-Loop Solvability

abstract: In this paper, a leader-follower stochastic differential game is studied for a linear stochastic differential equation with a quadratic cost functional. The coefficients in the state equation and the weighting matrices in the cost functionals are all deterministic. Closed-loop strategies are introduced, which require to be independent of initial states; and such a nature makes it very useful and convenient in applications. The follower first solves a stochastic linear quadratic optimal control problem, and his optimal closed-loop strategy is characterized by a Riccati equation, together with an adapted solution to a linear backward stochastic differential equation. Then the leader turns to solve a stochastic linear quadratic optimal control problem of a forward-backward stochastic differential equation, necessary conditions for the existence of optimal closed-loop strategies for the leader is given by the existence of a Riccati equation. Some examples are also given.


title: Prb-GAN: A Probabilistic Framework for GAN Modelling

abstract: Generative adversarial networks (GANs) are very popular to generate realistic images, but they often suffer from the training instability issues and the phenomenon of mode loss. In order to attain greater diversity in GAN synthesized data, it is critical to solving the problem of mode loss. Our work explores probabilistic approaches to GAN modelling that could allow us to tackle these issues. We present Prb-GANs, a new variation that uses dropout to create a distribution over the network parameters with the posterior learnt using variational inference. We describe theoretically and validate experimentally using simple and complex datasets the benefits of such an approach. We look into further improvements using the concept of uncertainty measures. Through a set of further modifications to the loss functions for each network of the GAN, we are able to get results that show the improvement of GAN performance. Our methods are extremely simple and require very little modification to existing GAN architecture.


title: Real time large scale $\textit{in vivo}$ observations by light-sheet microscopy reveal intrinsic synchrony, plasticity and growth cone dynamics of midline crossing axons at the ventral floor plate of the zebrafish spinal cord

abstract: Axonal growth and guidance at the ventral floor plate is here followed $\textit{in vivo}$ in real time at high resolution by light-sheet microscopy along several hundred micrometers of the zebrafish spinal cord. The recordings show the strikingly stereotyped spatio-temporal control that governs midline crossing. Commissural axons are observed crossing the ventral floor plate midline perpendicularly at about 20 microns/h, in a manner dependent on the Robo3 receptor and with a growth rate minimum around the midline, confirming previous observations. At guidance points, commissural axons are seen to decrease their growth rate and growth cones increase in size. Commissural filopodia appear to interact with the nascent neural network, and thereby trigger immediate plastic and reversible sinusoidal-shaped bending movements of neighboring commissural shafts. Ipsilateral axons extend concurrently, but straight and without bends, at three to six times higher growth rates than commissurals, indicating they project their path on a substrate-bound surface rather than relying on diffusible guidance cues. Growing axons appeared to be under stretch, an observation that is of relevance for tension-based models of cortical morphogenesis. The \textit{in vivo} observations provide for a discussion of the current distinction between substrate-bound and diffusible guidance cues. The study applies the transparent zebrafish model that provides an experimental model system to explore further the cellular, molecular and physical mechanisms involved during axonal growth, guidance and midline crossing through a combination of $\textit{in vitro}$ and $\textit{in vivo}$ approaches.


title: Putting words into the system's mouth: A targeted attack on neural machine translation using monolingual data poisoning

abstract: Neural machine translation systems are known to be vulnerable to adversarial test inputs, however, as we show in this paper, these systems are also vulnerable to training attacks. Specifically, we propose a poisoning attack in which a malicious adversary inserts a small poisoned sample of monolingual text into the training set of a system trained using back-translation. This sample is designed to induce a specific, targeted translation behaviour, such as peddling misinformation. We present two methods for crafting poisoned examples, and show that only a tiny handful of instances, amounting to only 0.02% of the training set, is sufficient to enact a successful attack. We outline a defence method against said attacks, which partly ameliorates the problem. However, we stress that this is a blind-spot in modern NMT, demanding immediate attention.


title: Differential rotation of the solar transition region from STEREO/EUVI 30.4 nm images

abstract: The solar photosphere, chromosphere and corona are known to rotate differentially as a function of latitude. To date, it is unclear if the solar transition region also rotates differentially. In this paper, we investigate differential rotational profile of solar transition region as a function of latitude, using solar full disk (SFD) images at 30.4 nm wavelength recorded by Extreme Ultraviolet Imager (EUVI) onboard Solar Terrestrial Relations Observatory (STEREO) space mission for the period from 2008 to 2018 (Solar Cycle 24). Our investigations show that solar transition region rotates differentially. The sidereal rotation rate obtained at +/- 5 degree equatorial band is quite high (~ 14.7 degree/day), which drops to ~ 13.6 degree/day towards both polar regions. We also obtain that the rotational differentiality is low during the period of high solar activity (rotation rate varies from 14.86 to 14.27 degree/day) while it increases during the ascending and the descending phases of the 24th solar cycle (rotation rate varies from 14.56 to 13.56 degree/day in 2008 and 14.6 to 13.1 degree/day in 2018). Average sidereal rotation rate (over SFD) follows the trend of solar activity (maximum ~ 14.97 degree/day during the peak phase of the solar activity, which slowly decreases to minimum ~ 13.9 degree/day during ascending and the descending phases of the 24th solar cycle). We also observe that solar transition region rotates less differentially than the corona.


title: Power spectral properties of the soft spectral states in four black hole transients

abstract: The X-ray variability in the soft X-ray spectral state of black hole binaries is primarily characterized by a power-law noise (PLN), which is thought to originate from the propagation of the modulation in the mass accretion rate of a standard accretion disk flow. Such a PLN has also been revealed in the disk spectral component in the hard and the intermediate states in several black hole binaries. Here we present an investigation of the {\it Rossi} X-ray Timing Explorer (RXTE) observations of four black hole transients in which soft spectral states were observed twenty times or more. We show that in the soft spectral state, the PLN index varied in a large range between -1.64 and -0.62, and the fractional rms variability calculated in the 0.01 -- 20 Hz frequency range reached as large as 7.67\% and as low as 0.83\%. Remarkably, we have found the evidence of an inclination dependence of the maximal fractional rms variability, the averaged fractional rms variability and the fractional rms variability of the median in the sample based on current knowledge of inclination of black hole binaries. An inclination dependence has only been predicted in early magnetohydrodynamic simulations of isothermal disks limited to a high-frequency regime. In theory, the noise index is related to the physics of inward propagation of disk fluctuations, while the fractional rms amplitude reflects the intrinsic properties of the magnetohydrodynamic nature of the accretion flow. Our results therefore suggest that X-ray variability in the soft state can be used to put constraints on the properties of the accretion flow as well as the inclination of the accretion disk.


title: Joint Activity Detection, Channel Estimation, and Data Decoding for Grant-free Massive Random Access

abstract: In the massive machine-type communication (mMTC) scenario, a large number of devices with sporadic traffic need to access the network on limited radio resources. While grant-free random access has emerged as a promising mechanism for massive access, its potential has not been fully unleashed. In particular, the common sparsity pattern in the received pilot and data signal has been ignored in most existing studies, and auxiliary information of channel decoding has not been utilized for user activity detection. This paper endeavors to develop advanced receivers in a holistic manner for joint activity detection, channel estimation, and data decoding. In particular, a turbo receiver based on the bilinear generalized approximate message passing (BiG-AMP) algorithm is developed. In this receiver, all the received symbols will be utilized to jointly estimate the channel state, user activity, and soft data symbols, which effectively exploits the common sparsity pattern. Meanwhile, the extrinsic information from the channel decoder will assist the joint channel estimation and data detection. To reduce the complexity, a low-cost side information-aided receiver is also proposed, where the channel decoder provides side information to update the estimates on whether a user is active or not. Simulation results show that the turbo receiver is able to reduce the activity detection, channel estimation, and data decoding errors effectively, while the side information-aided receiver notably outperforms the conventional method with a relatively low complexity.


title: INMO: A Model-Agnostic and Scalable Module for Inductive Collaborative Filtering

abstract: Collaborative filtering is one of the most common scenarios and popular research topics in recommender systems. Among existing methods, latent factor models, i.e., learning a specific embedding for each user/item by reconstructing the observed interaction matrix, have shown excellent performances. However, such user-specific and item-specific embeddings are intrinsically transductive, making it difficult to deal with new users and new items unseen during training. Besides, the number of model parameters heavily depends on the number of all users and items, restricting its scalability to real-world applications. To solve the above challenges, in this paper, we propose a novel model-agnostic and scalable Inductive Embedding Module for collaborative filtering, namely INMO. INMO generates the inductive embeddings for users (items) by characterizing their interactions with some template items (template users), instead of employing an embedding lookup table. Under the theoretical analysis, we further propose an effective indicator for the selection of template users/items. Our proposed INMO can be attached to existing latent factor models as a pre-module, inheriting the expressiveness of backbone models, while bringing the inductive ability and reducing model parameters. We validate the generality of INMO by attaching it to both Matrix Factorization (MF) and LightGCN, which are two representative latent factor models for collaborative filtering. Extensive experiments on three public benchmarks demonstrate the effectiveness and efficiency of INMO in both transductive and inductive recommendation scenarios.


title: Optimal state for a Tavis-Cummings quantum battery via the Bethe ansatz method

abstract: In this paper, we investigate the effect of different optical field initial states on the performance of the Tavis-Cummings (T-C) quantum battery. In solving the dynamical evolution of the system, we found a fast way to solve the Bethe ansatz equation. We find that the stored energy and the average charging power of the T-C quantum battery are closely related to the probability distribution of the optical field initial state in the number states. We define a quantity called the number-state stored energy. With this prescribed quantity, we only need to know the probability distribution of the optical field initial state in the number states to obtain the stored energy and the average charging power of the T-C quantum battery at any time. We propose an equal probability and equal expected value splitting method by which we can obtain two inequalities, and the two inequalities can be reduced to Jensen's inequalities. By this method, we found the optimal initial state of the optical field. We found that the maximum stored energy and the maximum average charging power of the T-C quantum battery are proportional to the initial average photon number, and the quantum battery can be fully charged when the initial average photon number is large enough. We found two phenomena, which can be described by two empirical inequalities. These two phenomena imply the hypersensitivity of the stored energy of the T-C quantum battery to the number-state cavity field. Finally, we discussed the impact of decoherence on battery performance.


title: Impact of Energy Efficiency on the Morphology and Behaviour of Evolved Robots

abstract: Most evolutionary robotics studies focus on evolving some targeted behavior without taking the energy usage into account. This limits the practical value of such systems because energy efficiency is an important property for real-world autonomous robots. In this paper, we mitigate this problem by extending our simulator with a battery model and taking energy consumption into account during fitness evaluations. Using this system we investigate how energy awareness affects the evolution of robots. Since our system is to evolve morphologies as well as controllers, the main research question is twofold: (i) what is the impact on the morphologies of the evolved robots, and (ii) what is the impact on the behavior of the evolved robots if energy consumption is included in the fitness evaluation? The results show that including the energy consumption in the fitness in a multi-objective fashion (by NSGA-II) reduces the average size of robot bodies while at the same time reducing their speed. However, robots generated without size reduction can achieve speeds comparable to robots from the baseline set.


title: Modeling Explicit Concerning States for Reinforcement Learning in Visual Dialogue

abstract: To encourage AI agents to conduct meaningful Visual Dialogue (VD), the use of Reinforcement Learning has been proven potential. In Reinforcement Learning, it is crucial to represent states and assign rewards based on the action-caused transitions of states. However, the state representation in previous Visual Dialogue works uses the textual information only and its transitions are implicit. In this paper, we propose Explicit Concerning States (ECS) to represent what visual contents are concerned at each round and what have been concerned throughout the Visual Dialogue. ECS is modeled from multimodal information and is represented explicitly. Based on ECS, we formulate two intuitive and interpretable rewards to encourage the Visual Dialogue agents to converse on diverse and informative visual information. Experimental results on the VisDial v1.0 dataset show our method enables the Visual Dialogue agents to generate more visual coherent, less repetitive and more visual informative dialogues compared with previous methods, according to multiple automatic metrics, human study and qualitative analysis.


title: Can we improve the environmental benefits of biobased PET production through local 1 biomass value chains? A life cycle assessment perspective

abstract: The transition to a low-carbon economy is one of the ambitions of the European Union for 2030. Biobased industries play an essential role in this transition. However, there has been an on-going discussion about the actual benefit of using biomass to produce biobased products, specifically the use of agricultural materials (e.g., corn and sugarcane). This paper presents the environmental impact assessment of 30% and 100% biobased PET (polyethylene terephthalate) production using EU biomass supply chains (e.g., sugar beet, wheat, and Miscanthus). An integral assessment between the life cycle assessment methodology and the global sensitivity assessment is presented as an early-stage support tool to propose and select supply chains that improve the environmental performance of biobased PET production. From the results, Miscanthus is the best option for the production of biobased PET: promoting EU local supply chains, reducing greenhouse gas (GHG) emissions (process and land-use change), and generating lower impacts in midpoint categories related to resource depletion, ecosystem quality, and human health. This tool can help improving the environmental performance of processes that could boost the shift to a low-carbon economy.


title: OmniLytics: A Blockchain-based Secure Data Market for Decentralized Machine Learning

abstract: We propose OmniLytics, a blockchain-based secure data trading marketplace for machine learning applications. Utilizing OmniLytics, many distributed data owners can contribute their private data to collectively train an ML model requested by some model owners, and receive compensation for data contribution. OmniLytics enables such model training while simultaneously providing 1) model security against curious data owners; 2) data security against the curious model and data owners; 3) resilience to malicious data owners who provide faulty results to poison model training; and 4) resilience to malicious model owners who intend to evade payment. OmniLytics is implemented as a blockchain smart contract to guarantee the atomicity of payment. In OmniLytics, a model owner splits its model into the private and public parts and publishes the public part on the contract. Through the execution of the contract, the participating data owners securely aggregate their locally trained models to update the model owner's public model and receive reimbursement through the contract. We implement a working prototype of OmniLytics on Ethereum blockchain and perform extensive experiments to measure its gas cost, execution time, and model quality under various parameter combinations. For training a CNN on the MNIST dataset, the MO is able to boost its model accuracy from 62% to 83% within 500ms in blockchain processing time.This demonstrates the effectiveness of OmniLytics for practical deployment.


title: Reasoning about Reconfigurations of Distributed Systems

abstract: This paper presents a Hoare-style calculus for formal reasoning about reconfiguration programs of distributed systems. Such programs create and delete components and/or interactions (connectors) while the system components change state according to their internal behaviour. Our proof calculus uses a resource logic, in the spirit of Separation Logic, to give local specifications of reconfiguration actions. Moreover, distributed systems with an unbounded number of components are described using inductively defined predicates. The correctness of reconfiguration programs relies on havoc invariants, that are assertions about the ongoing interactions in a part of the system that is not affected by the structural change caused by the reconfiguration. We present a proof system for such invariants in an assume/rely-guarantee style. We illustrate the feasibility of our approach by proving the correctness of real-life distributed systems with reconfigurable (self-adjustable) tree architectures.


title: Asymptotic analysis of V-BLAST MIMO for coherent optical wireless communications in Gamma-Gamma turbulence

abstract: This paper investigates the asymptotic BER performance of coherent optical wireless communication systems in Gamma-Gamma turbulence when applying the V-BLAST MIMO scheme. A new method is proposed to quantify the performance of the system and mathematical solutions for asymptotic BER performance are derived. Counterintuitive results are shown since the diversity gain of the V-BLAST MIMO system is equal to the number of the receivers. As a consequence, it is shown that when applying the V-BLAST MIMO scheme, the symbol rate per transmission can be equal to the number of transmitters with some cost to diversity gain. This means that we can simultaneously exploit the spatial multiplexing and diversity properties of the MIMO system to achieve a higher data rate than existing schemes in a channel that displays severe turbulence and moderate attenuation.


title: AutoFB: Automating Fetal Biometry Estimation from Standard Ultrasound Planes

abstract: During pregnancy, ultrasound examination in the second trimester can assess fetal size according to standardized charts. To achieve a reproducible and accurate measurement, a sonographer needs to identify three standard 2D planes of the fetal anatomy (head, abdomen, femur) and manually mark the key anatomical landmarks on the image for accurate biometry and fetal weight estimation. This can be a time-consuming operator-dependent task, especially for a trainee sonographer. Computer-assisted techniques can help in automating the fetal biometry computation process. In this paper, we present a unified automated framework for estimating all measurements needed for the fetal weight assessment. The proposed framework semantically segments the key fetal anatomies using state-of-the-art segmentation models, followed by region fitting and scale recovery for the biometry estimation. We present an ablation study of segmentation algorithms to show their robustness through 4-fold cross-validation on a dataset of 349 ultrasound standard plane images from 42 pregnancies. Moreover, we show that the network with the best segmentation performance tends to be more accurate for biometry estimation. Furthermore, we demonstrate that the error between clinically measured and predicted fetal biometry is lower than the permissible error during routine clinical measurements.


title: Rate-Splitting Multiple Access for Communications and Jamming in Multi-Antenna Multi-Carrier Cognitive Radio Systems

abstract: With the increasing number of wireless communication systems and the demand for bandwidth, the wireless medium has become a congested and contested environment. Operating under such an environment brings several challenges, especially for military communication systems, which need to guarantee reliable communication while avoiding interfering with other friendly or neutral systems and denying the enemy systems of service. In this work, we investigate a novel application of Rate-Splitting Multiple Access(RSMA) for joint communications and jamming with a Multi-Carrier(MC) waveform in a multiantenna Cognitive Radio(CR) system. RSMA is a robust multiple access scheme for downlink multi-antenna wireless networks. RSMA relies on multi-antenna Rate-Splitting (RS) at the transmitter and Successive Interference Cancellation (SIC) at the receivers. Our aim is to simultaneously communicate with Secondary Users(SUs) and jam Adversarial Users(AUs) to disrupt their communications while limiting the interference to Primary Users(PUs) in a setting where all users perform broadband communications by MC waveforms in their respective networks. We consider the practical setting of imperfect CSI at transmitter(CSIT) for the SUs and PUs, and statistical CSIT for AUs. We formulate a problem to obtain optimal precoders which maximize the mutual information under interference and jamming power constraints. We propose an Alternating Optimization-Alternating Direction Method of Multipliers(AOADMM) based algorithm for solving the resulting non-convex problem. We perform an analysis based on Karush-Kuhn-Tucker conditions to determine the optimal jamming and interference power thresholds that guarantee the feasibility of problem and propose a practical algorithm to calculate the interference power threshold. By simulations, we show that RSMA achieves a higher sum-rate than Space Division Multiple Access(SDMA).


title: Can strangelets be detected in a large LAr neutrino detector?

abstract: Predicted as possible bound states of up, down and strange quarks, strangelets could be more energetically favourable and more stable than nuclear matter. In this paper we explore the possibility of detecting such particles with the future large liquid argon detectors developed for neutrino physics. Using signals from ionization and scintillations we suggest that a calorimetric TCP detector is able to put in evidence and to discriminate between light strangelets at intermediate energy.


title: 3d mirror for Argyres-Douglas theories

abstract: 3d mirrors for all 4d $\mathcal{N}=2$ Argyres-Douglas (AD) theories engineered using 6d $(2,0)$ theory are found. The basic steps are: 1): Find a punctured sphere representation for the AD theories (this is achieved in our previous studies of S duality); 2): Attach a 3d theory for each puncture; 3): Glue together the 3d theory for each puncture. We found the 3d mirror quiver gauge theory for the AD theories engineered using 6d $A$ and $D$ type theories. These 3d mirrors are useful for studying the properties of original 4d theory such as Higgs branch, S-duality, etc; We also construct many new 3d $\mathcal{N}=4$ SCFTs.


title: Enumerating Magic Distinct Labellings of the Cube

abstract: We find by applying MacMahon's partition analysis that all magic labellings of the cube are of eight types, each generated by six basis elements. A combinatorial proof of this fact is given. The number of magic labellings of the cube is thus reobtained as a polynomial in the magic sum of degree $5$. Then we enumerate magic distinct labellings, the number of which turns out to be a quasi-polynomial of period 720720. We also find the group of symmetry can be used to significantly simplify the computation.


title: Robustness of particle creation in the formation of a compact object

abstract: Hawking has predicted that the formation of a black hole by gravitational collapse causes quantum particle creation and the spectrum of the particles is almost thermal. This phenomenon is called the Hawking radiation. Recently, it has been predicted that the particle creation may drastically change from the Hawking radiation to a strong double burst if the gravitational collapse suddenly stops just before the formation of the event horizon. By contrast with the Hawking radiation, the burst may be so strong that it can be of observational interest even for collapsing objects with astrophysical mass scales. However, the burst phenomenon has been predicted through the studies of idealized models in which a spherical hollow shell begins to collapse, but stops shrinking and eventually settles down to a static "star". Therefore, one might guess that it could be particular to the hollow shell model. In this paper, we study the particle creation due to the gravitational collapse of a spherical object whose interior is filled with matter. In this model, we obtain similar results to those in the case of the hollow shell model. This implies that the double burst is a robust property of particle creation by the sudden braking of gravitational collapse.


title: Coherent differentiation

abstract: The categorical models of the differential lambda-calculus are additive categories because of the Leibniz rule which requires the summation of two expressions. This means that, as far as the differential lambda-calculus and differential linear logic are concerned, these models feature finite nondeterminism and indeed these languages are essentially non-deterministic. We introduce a categorical framework for differentiation which does not require additivity and is compatible with deterministic models such as coherence spaces and probabilistic models such as probabilistic coherence spaces. Based on this semantics we sketch the syntax of a deterministic version of the differential lambdacalculus.


title: Dihedral multi-reference alignment

abstract: We study the dihedral multi-reference alignment problem of estimating the orbit of a signal from multiple noisy observations of the signal, acted on by random elements of the dihedral group. We show that if the group elements are drawn from a generic distribution, the orbit of a generic signal is uniquely determined from the second moment of the observations. This implies that the optimal estimation rate in the high noise regime is proportional to the square of the variance of the noise. This is the first result of this type for multi-reference alignment over a non-abelian group with a non-uniform distribution of group elements. Based on tools from invariant theory and algebraic geometry, we also delineate conditions for unique orbit recovery for multi-reference alignment models over finite groups (namely, when the dihedral group is replaced by a general finite group) when the group elements are drawn from a generic distribution. Finally, we design and study numerically three computational frameworks for estimating the signal based on group synchronization, expectation-maximization, and the method of moments.


title: A Lucas Critique Compliant SVAR model with Observation-driven Time-varying Parameters

abstract: We propose an observation-driven time-varying SVAR model where, in agreement with the Lucas Critique, structural shocks drive both the evolution of the macro variables and the dynamics of the VAR parameters. Contrary to existing approaches where parameters follow a stochastic process with random and exogenous shocks, our observation-driven specification allows the evolution of the parameters to be driven by realized past structural shocks, thus opening the possibility to gauge the impact of observed shocks and hypothetical policy interventions on the future evolution of the economic system.


title: The Brownian motion in the transformer model

abstract: Transformer is the state of the art model for many language and visual tasks. In this paper, we give a deep analysis of its multi-head self-attention (MHSA) module and find that: 1) Each token is a random variable in high dimensional feature space. 2) After layer normalization, these variables are mapped to points on the hyper-sphere. 3) The update of these tokens is a Brownian motion. The Brownian motion has special properties, its second order item should not be ignored. So we present a new second-order optimizer(an iterative K-FAC algorithm) for the MHSA module. In some short words: All tokens are mapped to high dimension hyper-sphere. The Scaled Dot-Product Attention $softmax(\frac{\mathbf{Q}\mathbf{K}^T}{\sqrt{d}})$ is just the Markov transition matrix for the random walking on the sphere. And the deep learning process would learn proper kernel function to get proper positions of these tokens. The training process in the MHSA module corresponds to a Brownian motion worthy of further study.


title: Variational methods for characterizing matrix product operator symmetries

abstract: We present a method of extracting information about topological order from the ground state of a strongly correlated two-dimensional system represented by an infinite projected entangled pair state (iPEPS). As in Phys. Rev. B 101, 041108 (2020) and 102, 235112 (2020) we begin by determining symmetries of the iPEPS represented by infinite matrix product operators (iMPO) that map between the different iPEPS transfer matrix fixed points, to which we apply the fundamental theorem of MPS to find zipper tensors between products of iMPO's that encode fusion properties of the anyons. The zippers can be combined to extract topological $F$-symbols of the underlying fusion category, which unequivocally identify the topological order of the ground state. We bring the $F$-symbols to the canonical gauge, as well as compute the Drinfeld center of this unitary fusion category to extract the topological $S$ and $T$ matrices encoding mutual- and self-statistics of the emergent anyons. The algorithm is applied to Abelian toric code, double semion and twisted quantum double of $Z_3$, as well as to non-Abelian double Fibonacci, double Ising, and quantum double of $S_3$ and ${\rm Rep}(S_3)$ string net models.


title: Evaluations of multilinear polynomials on low rank Jordan algebras

abstract: In this paper we prove the generalized Kaplansky conjecture for the Jordan algebras of the type $J_n$ in particular for self adjoint $2\times 2$ matrices over $\R$, over $\C$, $\HH$ and $\Oct$. In fact, we prove that the image of multilinear polynomial must be either $\{0\}$, $\mathbb{R}$, the space of pure elements $V$, or $J_n$.


title: Multiplicative deconvolution in survival analysis under dependency

abstract: We study the non-parametric estimation of an unknown survival function S with support on R+ based on a sample with multiplicative measurement errors. The proposed fully-data driven procedure is based on the estimation of the Mellin transform of the survival function S and a regularisation of the inverse of the Mellin transform by a spectral cut-off. The upcoming bias-variance trade-off is dealt with by a data-driven choice of the cut-off parameter. In order to discuss the bias term, we consider the Mellin-Sobolev spaces which characterize the regularity of the unknown survival function S through the decay of its Mellin transform. For the analysis of the variance term, we consider the i.i.d. case and incorporate dependent observations in form of Bernoulli shift processes and beta mixing sequences. Additionally, we show minimax-optimality over Mellin-Sobolev spaces of the spectral cut-off estimator.


title: On dust evolution in planet-forming discs in binary systems. II -- Comparison with Taurus and $\rho$ Ophiuchus (sub-)millimetre observations: discs in binaries have small dust sizes

abstract: The recently discovered exoplanets in binary or higher-order multiple stellar systems sparked a new interest in the study of proto-planetary discs in stellar aggregations. Here we focus on disc solids, as they make up the reservoir out of which exoplanets are assembled and dominate (sub-)millimetre disc observations. These observations suggest that discs in binary systems are fainter and smaller than in isolated systems. In addition, disc dust sizes are consistent with tidal truncation only if they orbit very eccentric binaries. In a previous study we showed that the presence of a stellar companion hastens the radial migration of solids, shortening disc lifetime and challenging planet formation. In this paper we confront our theoretical and numerical results with observations: disc dust fluxes and sizes from our models are computed at ALMA wavelengths and compared with Taurus and $\rho$ Ophiuchus data. A general agreement between theory and observations is found. In particular, we show that the dust disc sizes are generally smaller than the binary truncation radius due to the combined effect of grain growth and radial drift: therefore, small disc sizes do not require implausibly high eccentricities to be explained. Furthermore, the observed binary discs are compatible within $1\sigma$ with a quadratic flux-radius correlation similar to that found for single-star discs and show a close match with the models. However, the observational sample of resolved binary discs is still small and additional data are required to draw more robust conclusions on the flux-radius correlation and how it depends on the binary properties.


title: Particle Production in Accelerated Thin Bubbles

abstract: We investigate the creation of scalar particles inside a region delimited by a bubble which is expanding with non-zero acceleration. The bubble is modelled as a thin shell and plays the role of a moving boundary, thus influencing the fluctuations of the test scalar field inside it. Bubbles expanding in Minkowski spacetime as well as those dividing two de Sitter spacetimes are explored in a unified way. Our results for the Bogoliubov coefficient $\beta_k$ in the adiabatic approximation show that in all cases the creation of scalar particles decreases with the mass, and is much more significant in the case of nonzero curvature. They also show that the dynamics of the bubble and its size are relevant for particle creation, but in the dS-dS case the combination of both effects leads to a behaviour different from that of Minkowski space-time, due to the presence of a length scale (the Hubble radius of the internal geometry).


title: Learned super resolution ultrasound for improved breast lesion characterization

abstract: Breast cancer is the most common malignancy in women. Mammographic findings such as microcalcifications and masses, as well as morphologic features of masses in sonographic scans, are the main diagnostic targets for tumor detection. However, improved specificity of these imaging modalities is required. A leading alternative target is neoangiogenesis. When pathological, it contributes to the development of numerous types of tumors, and the formation of metastases. Hence, demonstrating neoangiogenesis by visualization of the microvasculature may be of great importance. Super resolution ultrasound localization microscopy enables imaging of the microvasculature at the capillary level. Yet, challenges such as long reconstruction time, dependency on prior knowledge of the system Point Spread Function (PSF), and separability of the Ultrasound Contrast Agents (UCAs), need to be addressed for translation of super-resolution US into the clinic. In this work we use a deep neural network architecture that makes effective use of signal structure to address these challenges. We present in vivo human results of three different breast lesions acquired with a clinical US scanner. By leveraging our trained network, the microvasculature structure is recovered in a short time, without prior PSF knowledge, and without requiring separability of the UCAs. Each of the recoveries exhibits a different structure that corresponds with the known histological structure. This study demonstrates the feasibility of in vivo human super resolution, based on a clinical scanner, to increase US specificity for different breast lesions and promotes the use of US in the diagnosis of breast pathologies.


title: Two- and three-gluon glueballs of $C=+$

abstract: We study two- and three-gluon glueballs of $C=+$ using the method of QCD sum rules. We systematically construct their interpolating currents, and find that all the spin-1 currents of $C=+$ vanish. This suggests that the ``ground-state'' spin-1 glueballs of $C=+$ do not exist within the relativistic framework. We calculate masses of the two-gluon glueballs with $J^{PC} = 0^{\pm+}/2^{\pm+}$ and the three-gluon glueballs with $J^{PC} = 0^{\pm+}/2^{\pm+}$. We propose to search for the $J^{PC} = 0^{-+}/2^{-\pm}/3^{\pm-}$ three-gluon glueballs in their three-meson decay channels in future BESIII, GlueX, LHC, and PANDA experiments.


title: Convexification with bounded gap for randomly projected quadratic optimization

abstract: Random projection techniques based on Johnson-Lindenstrauss lemma are used for randomly aggregating the constraints or variables of optimization problems while approximately preserving their optimal values, that leads to smaller-scale optimization problems. D'Ambrosio et al. have applied random projection to a quadratic optimization problem so as to decrease the number of decision variables. Although the problem size becomes smaller, the projected problem will also almost surely be non-convex if the original problem is non-convex, and hence will be hard to solve. In this paper, by focusing on the fact that the level of the non-convexity of a non-convex quadratic optimization problem can be alleviated by random projection, we find an approximate global optimal value of the problem by attributing it to a convex problem with smaller size. To the best of our knowledge, our paper is the first to use random projection for convexification of non-convex optimization problems. We evaluate the approximation error between optimum values of a non-convex optimization problem and its convexified randomly projected problem.


title: Elementary amenability and almost finiteness

abstract: We show that every free continuous action of a countably infinite elementary amenable group on a finite-dimensional compact metrizable space is almost finite. As a consequence, the crossed products of minimal such actions are $\mathcal{Z}$-stable and classified by their Elliott invariant.


title: TransAttUnet: Multi-level Attention-guided U-Net with Transformer for Medical Image Segmentation

abstract: Accurate segmentation of organs or lesions from medical images is crucial for reliable diagnosis of diseases and organ morphometry. In recent years, convolutional encoder-decoder solutions have achieved substantial progress in the field of automatic medical image segmentation. Due to the inherent bias in the convolution operations, prior models mainly focus on local visual cues formed by the neighboring pixels, but fail to fully model the long-range contextual dependencies. In this paper, we propose a novel Transformer-based Attention Guided Network called TransAttUnet, in which the multi-level guided attention and multi-scale skip connection are designed to jointly enhance the performance of the semantical segmentation architecture. Inspired by Transformer, the self-aware attention (SAA) module with Transformer Self Attention (TSA) and Global Spatial Attention (GSA) is incorporated into TransAttUnet to effectively learn the non-local interactions among encoder features. Moreover, we also use additional multi-scale skip connections between decoder blocks to aggregate the upsampled features with different semantic scales. In this way, the representation ability of multi-scale context information is strengthened to generate discriminative features. Benefitting from these complementary components, the proposed TransAttUnet can effectively alleviate the loss of fine details caused by the stacking of convolution layers and the consecutive sampling operations, finally improving the segmentation quality of medical images. Extensive experiments on multiple medical image segmentation datasets from different imaging modalities demonstrate that the proposed method consistently outperforms the state-of-the-art baselines. Our code and pre-trained models are available at: https://github.com/YishuLiu/TransAttUnet.


title: Constrained Optimal Smoothing and Bayesian Estimation

abstract: In this paper, we extend the correspondence between Bayesian estimation and optimal smoothing in a Reproducing Kernel Hilbert Space (RKHS) adding a convexe constraints on the solution. Through a sequence of approximating Hilbertian spaces and a discretized model, we prove that the Maximum A Posteriori (MAP) of the posterior distribution is exactly the optimal constrained smoothing function in the RKHS. This paper can be read as a generalization of the paper [7] of Kimeldorf-Wahba where it is proved that the optimal smoothing solution is the mean of the posterior distribution.


title: Geographical Knowledge-driven Representation Learning for Remote Sensing Images

abstract: The proliferation of remote sensing satellites has resulted in a massive amount of remote sensing images. However, due to human and material resource constraints, the vast majority of remote sensing images remain unlabeled. As a result, it cannot be applied to currently available deep learning methods. To fully utilize the remaining unlabeled images, we propose a Geographical Knowledge-driven Representation learning method for remote sensing images (GeoKR), improving network performance and reduce the demand for annotated data. The global land cover products and geographical location associated with each remote sensing image are regarded as geographical knowledge to provide supervision for representation learning and network pre-training. An efficient pre-training framework is proposed to eliminate the supervision noises caused by imaging times and resolutions difference between remote sensing images and geographical knowledge. A large scale pre-training dataset Levir-KR is proposed to support network pre-training. It contains 1,431,950 remote sensing images from Gaofen series satellites with various resolutions. Experimental results demonstrate that our proposed method outperforms ImageNet pre-training and self-supervised representation learning methods and significantly reduces the burden of data annotation on downstream tasks such as scene classification, semantic segmentation, object detection, and cloud / snow detection. It demonstrates that our proposed method can be used as a novel paradigm for pre-training neural networks. Codes will be available on https://github.com/flyakon/Geographical-Knowledge-driven-Representaion-Learning.


title: A projection operator approach for computing the dynamics of AS2S3 chalcogenide birefringent photonic crystal fiber coupler

abstract: A variety of AS2S3 chalcogenide photonic crystal fiber coupler of special properties are proposed to study the role of birefringence in all optical coupling characteristics based on the projection operator method (POM). The equations of motion describing the dynamics of the individual pulse parameters through x- and y-polarized modes are arrived at by employing POM from the coupled nonlinear Schr\"odinger equations. From the pulse parameter dynamics, it is observed that the amplitudes of the polarization components are significantly influenced by the pulse being introduced with different polarizing angle even at low input power level. Such a selective polarizing angles of the input pulse will provide efficient control over the desired splitting ratio as well as the ability to decide the desired polarization component.