title: De-bordering and Geometric Complexity Theory for Waring rank and related models

abstract: De-bordering is the task of proving that a border complexity measure is bounded from below, by a non-border complexity measure. This task is at the heart of understanding the difference between Valiant's determinant vs permanent conjecture, and Mulmuley and Sohoni's Geometric Complexity Theory (GCT) approach to settle the P \neq NP conjecture. Currently, very few de-bordering results are known. In this work, we study the question of de-bordering the border Waring rank of polynomials. Waring and border Waring rank are very well studied measures, in the context of invariant theory, algebraic geometry and matrix multiplication algorithms. For the first time, we obtain a Waring rank upper bound that is exponential in the border Waring rank and only *linear* in the degree. All previous results were known to be exponential in the degree. According to Kumar's recent surprising result (ToCT'20), a small border Waring rank implies that the polynomial can be approximated as a sum of a constant and a small product of linear polynomials. We prove the converse of Kumar's result, and in this way we de-border Kumar's complexity, and obtain a new formulation of border Waring rank, up to a factor of the degree. We phrase this new formulation as the orbit closure problem of the product-plus-power polynomial, and we successfully de-border this orbit closure. We fully implement the GCT approach against the power sum, and we generalize the ideas of Ikenmeyer-Kandasamy (STOC'20) to this new orbit closure. In this way, we obtain new multiplicity obstructions that are constructed from just the symmetries of the points and representation theoretic branching rules, rather than explicit multilinear computations. Furthermore, we realize that the generalization of our converse of Kumar's theorem to square matrices gives a homogeneous formulation of Ben-Or and Cleve (SICOMP'92). This results ...


title: An Invitation to Distributed Quantum Neural Networks

abstract: Deep neural networks have established themselves as one of the most promising machine learning techniques. Training such models at large scales is often parallelized, giving rise to the concept of distributed deep learning. Distributed techniques are often employed in training large models or large datasets either out of necessity or simply for speed. Quantum machine learning, on the other hand, is the interplay between machine learning and quantum computing. It seeks to understand the advantages of employing quantum devices in developing new learning algorithms as well as improving the existing ones. A set of architectures that are heavily explored in quantum machine learning are quantum neural networks. In this review, we consider ideas from distributed deep learning as they apply to quantum neural networks. We find that the distribution of quantum datasets shares more similarities with its classical counterpart than does the distribution of quantum models, though the unique aspects of quantum data introduces new vulnerabilities to both approaches. We review the current state of the art in distributed quantum neural networks, including recent numerical experiments and the concept of circuit cutting.


title: Is the Statistical Interpretation of Quantum Mechanics $\psi$-Ontic or $\psi$-Epistemic?

abstract: The ontological models framework distinguishes $\psi$-ontic from $\psi$-epistemic wavefunctions. It is, in general, quite straightforward to categorize the wave-function of a certain quantum theory. Nevertheless, there has been a debate about the ontological status of the wave-function in the statistical interpretation of quantum mechanics: is it $\psi$-epistemic and incomplete or $\psi$-ontic and complete? I will argue that the wavefunction in this interpretation is best regarded as $\psi$-ontic and incomplete.


title: Stronger 3-SUM Lower Bounds for Approximate Distance Oracles via Additive Combinatorics

abstract: The "short cycle removal" technique was recently introduced by Abboud, Bringmann, Khoury and Zamir (STOC '22) to prove fine-grained hardness of approximation. Its main technical result is that listing all triangles in an $n^{1/2}$-regular graph is $n^{2-o(1)}$-hard under the 3-SUM conjecture even when the number of short cycles is small; namely, when the number of $k$-cycles is $O(n^{k/2+\gamma})$ for $\gamma<1/2$. Abboud et al. achieve $\gamma\geq 1/4$ by applying structure vs. randomness arguments on graphs. In this paper, we take a step back and apply conceptually similar arguments on the numbers of the 3-SUM problem. Consequently, we achieve the best possible $\gamma=0$ and the following lower bounds under the 3-SUM conjecture: * Approximate distance oracles: The seminal Thorup-Zwick distance oracles achieve stretch $2k\pm O(1)$ after preprocessing a graph in $O(m n^{1/k})$ time. For the same stretch, and assuming the query time is $n^{o(1)}$ Abboud et al. proved an $\Omega(m^{1+\frac{1}{12.7552 \cdot k}})$ lower bound on the preprocessing time; we improve it to $\Omega(m^{1+\frac1{2k}})$ which is only a factor 2 away from the upper bound. We also obtain tight bounds for stretch $2+o(1)$ and $3-\epsilon$ and higher lower bounds for dynamic shortest paths. * Listing 4-cycles: Abboud et al. proved the first super-linear lower bound for listing all 4-cycles in a graph, ruling out $(m^{1.1927}+t)^{1+o(1)}$ time algorithms where $t$ is the number of 4-cycles. We settle the complexity of this basic problem by showing that the $\widetilde{O}(\min(m^{4/3},n^2) +t)$ upper bound is tight up to $n^{o(1)}$ factors. Our results exploit a rich tool set from additive combinatorics, most notably the Balog-Szemer\'edi-Gowers theorem and Rusza's covering lemma. A key ingredient that may be of independent interest is a subquadratic algorithm for 3-SUM if one of the sets has small doubling.


title: Dealing with missing data using attention and latent space regularization

abstract: Most practical data science problems encounter missing data. A wide variety of solutions exist, each with strengths and weaknesses that depend upon the missingness-generating process. Here we develop a theoretical framework for training and inference using only observed variables enabling modeling of incomplete datasets without imputation. Using an information and measure-theoretic argument we construct models with latent space representations that regularize against the potential bias introduced by missing data. The theoretical properties of this approach are demonstrated empirically using a synthetic dataset. The performance of this approach is tested on 11 benchmarking datasets with missingness and 18 datasets corrupted across three missingness patterns with comparison against a state-of-the-art model and industry-standard imputation. We show that our proposed method overcomes the weaknesses of imputation methods and outperforms the current state-of-the-art.


title: Spin-down and reduced mass loss in early-type stars with large-scale magnetic fields

abstract: Magnetism can greatly impact the evolution of stars. In some stars with OBA spectral types there is direct evidence via the Zeeman effect for stable, large-scale magnetospheres, which lead to the spin-down of the stellar surface and reduced mass loss. So far, a comprehensive grid of stellar structure and evolution models accounting for these effects was lacking. For this reason, we computed and studied models with two magnetic braking and two chemical mixing schemes in three metallicity environments with the MESA software instrument. We find notable differences between the subgrids, which affects the model predictions and thus the detailed characterisation of stars. We are able to quantify the impact of magnetic fields in terms of preventing quasi-chemically homogeneous evolution and producing slowly-rotating, nitrogen-enriched ("Group 2") stars. Our model grid is fully open access and open source.


title: A counterexample of Morrison's cone conjecture for a strict Calabi-Yau threefold

abstract: We give a counterexample of Morrison's cone conjecture for a strict Calabi-Yau threefold.


title: Resonance effects in Brunel harmonic generation in thin film organic semiconductors

abstract: Organic semiconductors have attracted extensive attention due to their excellent optical and electronic properties. Here, we present an experimental and theoretical study of Brunel harmonic generation in two types of porphyrin thin films: tetraphenylporphyrin (TPP) and its organometallic complex derivative Zinc tetraphenylporphyrin (ZnTPP). Our results show that the $\pi$-$\pi^\ast$ excitation of the porphyrin ringsystem plays a major role in the harmonic generation process. We uncovered the contribution of an interband process to Brunel harmonic generation. In particular, the resonant ($S_0 \rightarrow S_2$ transition) enhanced multiphoton excitation is found to lead to an early onset of non-perturbative behavior for the 5th harmonic. Similar resonance effects are expected in Brunel harmonic generation with other organic materials.


title: Answer to the comment on "On the characteristic polynomial of an effective Hamiltonian''

abstract: In a recent comment by Fern\'{a}ndez, it has been argued that our solution method of an effective Hamiltonian based on the characteristic polynomial [Phys. Lett. A 443 (2022) 128215] had been developed several years earlier by Fried and Ezra [J. Chem. Phys. 90 (1989) 6378]. We show here several important differences between our treatment and the resummation method proposed previously by Fried and Ezra.


title: Wilson Area Law formula on $\mathbb{R}^4$

abstract: Let $\mathfrak{g}$ be the Lie Algebra of a compact semi-simple gauge group. For a $\mathfrak{g}$-valued 1-form $A$, consider the Yang-Mills action \begin{equation} S_{{\rm YM}}(A) = \int_{\mathbb{R}^4} \left|dA + A \wedge A \right|^2\ d\omega \nonumber \end{equation} using the standard metric on $T\mathbb{R}^4$. We want to make sense of the following path integral, \begin{equation} {\rm Tr}\ \int_{A \in \mathcal{A}_{\mathbb{R}^4, \mathfrak{g}} /\mathcal{G}} \exp \left[ c\int_{S} dA\right] e^{-\frac{1}{2}S_{{\rm YM}}(A)}\ DA, \nonumber \end{equation} whereby $DA$ is some Lebesgue type of measure on the space of $\mathfrak{g}$-valued 1-forms, modulo gauge transformations $\mathcal{A}_{\mathbb{R}^4, \mathfrak{g}} /\mathcal{G}$. Here, $S$ is some compact flat rectangular surface. Using an Abstract Wiener space, we can define a Yang-Mills path integral rigorously, for a compact semi-simple gauge group. Subsequently, we will then derive the Wilson area law formula from the definition, using renormalization techniques and asymptotic freedom. One of the most important applications of the Area Law formula will be to explain why the potential measured between a quark and antiquark is a linear potential.


title: ALBERT with Knowledge Graph Encoder Utilizing Semantic Similarity for Commonsense Question Answering

abstract: Recently, pre-trained language representation models such as bidirectional encoder representations from transformers (BERT) have been performing well in commonsense question answering (CSQA). However, there is a problem that the models do not directly use explicit information of knowledge sources existing outside. To augment this, additional methods such as knowledge-aware graph network (KagNet) and multi-hop graph relation network (MHGRN) have been proposed. In this study, we propose to use the latest pre-trained language model a lite bidirectional encoder representations from transformers (ALBERT) with knowledge graph information extraction technique. We also propose to applying the novel method, schema graph expansion to recent language models. Then, we analyze the effect of applying knowledge graph-based knowledge extraction techniques to recent pre-trained language models and confirm that schema graph expansion is effective in some extent. Furthermore, we show that our proposed model can achieve better performance than existing KagNet and MHGRN models in CommonsenseQA dataset.


title: Controllable Citation Sentence Generation with Language Models

abstract: Citation generation aims to generate a citation sentence that refers to a chosen paper in the context of a manuscript. However, a rigid citation generation process is at odds with an author's desire to control specific attributes, such as 1) the citation intent, e.g., either introducing background information or comparing results, and 2) keywords that should appear in the citation text. To provide these degrees of controllability during citation generation, we propose to integrate the manuscript context, the context of the referenced paper, and the desired control attributes into a structured template and use it to fine-tune a language model (LM) via next-token prediction. We then utilize Proximal Policy Optimization to directly optimize the LM in favor of a high score of our proposed controllability metric. The proposed workflow harmoniously combines citation attribute suggestion and conditional citation generation into one LM, allowing for better user control.


title: Retrieval-Augmented Generative Question Answering for Event Argument Extraction

abstract: Event argument extraction has long been studied as a sequential prediction problem with extractive-based methods, tackling each argument in isolation. Although recent work proposes generation-based methods to capture cross-argument dependency, they require generating and post-processing a complicated target sequence (template). Motivated by these observations and recent pretrained language models' capabilities of learning from demonstrations. We propose a retrieval-augmented generative QA model (R-GQA) for event argument extraction. It retrieves the most similar QA pair and augments it as prompt to the current example's context, then decodes the arguments as answers. Our approach outperforms substantially prior methods across various settings (i.e. fully supervised, domain transfer, and fewshot learning). Finally, we propose a clustering-based sampling strategy (JointEnc) and conduct a thorough analysis of how different strategies influence the few-shot learning performance. The implementations are available at https:// github.com/xinyadu/RGQA


title: On the Uniqueness of Balanced Complex Orthogonal Design

abstract: Complex orthogonal designs (CODs) play a crucial role in the construction of space-time block codes. Their real analog, real orthogonal designs (or equivalently, sum of squares composition formula) have a long history. Adams et al. (2011) introduced the concept of balanced complex orthogonal designs (BCODs) to address practical considerations. BCODs have a constant code rate of $1/2$ and a minimum decoding delay of $2^m$, where $2m$ is the number of columns. Understanding the structure of BCODs helps design space-time block codes, and it is also fascinating in its own right. We prove, when the number of columns is fixed, all (indecomposable) balanced complex orthogonal designs (BCODs) have the same parameters $[2^m, 2m, 2^{m-1}]$, and moreover, they are all equivalent.


title: Proof of the Center Conjectures for the cyclotomic Hecke and KLR algebras of type $A$

abstract: There are two longstanding conjectures on the centers of the cyclotomic Hecke algebra $\mathscr{H}_{n,K}^\Lambda$ of type $G(r,1,n)$ which assert that: 1) the dimension of the center $Z(\mathscr{H}_{n,K}^\Lambda)$ is independent of the characteristic of the ground field, its Hecke parameter and cyclotomic parameters; 2) the center $Z(\mathscr{H}_{n,K}^\Lambda)$ of $\mathscr{H}_{n,K}^\Lambda$ is the set of symmetric polynomial in its Jucys-Murphy operators. In this paper we prove these two conjectures affirmatively. At the same time we show that the center conjecture holds for the cyclotomic KLR algebras $\mathscr{R}_{\alpha,K}^\Lambda$ associated to the cyclic quiver $A_{e-1}^{(1)}$ (for $e>1$) and the linear quiver $A_{\infty}$ (for $e=0$) when the ground field $K$ has characteristic $p$ which satisfies either $p=0$, or $p>0=e$, or $p=e>1$, or $p>0$, $e>1$ and $p$ is coprime to $e$. As applications, we show that the cohomology of the Nakajima quiver variety $\mathfrak{M}(\Lambda,\alpha)$ with coefficient in $K$ is isomorphic to the center of $\mathscr{R}_{\alpha,K}^\Lambda$ in the affine type $A$ case when ${\rm{char}} K=0$; we also verify Chavli-Pfeiffer's conjecture on the polynomial coefficient $g_{w,C}$ for the complex reflection group of type $G(r,1,n)$.


title: On the Hadronic Origin of High Energy Emission of $\gamma$-ray Loud Narrow-Line Seyfert 1 PKS 1502+036

abstract: The radiation mechanism of Radio-Loud Narrow-Line Seyfert 1 (RL-NLS1) from X-ray to $\gamma$-ray bands remains an open question. While the leptonic model has been employed to explain the spectral energy distribution (SED), the hadronic process may potentially account for the high energy radiation of some $\gamma$-ray loud Narrow-Line Seyfert 1 (NLS1) as well. We study one of such RL-NLS1, PKS 1502+036, comparing the theoretical SEDs predicted by the leptonic model and the lepto-hadronic model to the observed one. For the hadronic processes, we take into account the proton synchrotron radiation and proton-photon interactions (including the Bethe-Heitler process and the photopion process) including the emission of pairs generated in the electromagnetic cascade initiated by these processes. Our results show that the leptonic model can reproduce the SED of this source, in which the X-ray to $\gamma$-ray radiation can be interpreted as the inverse Compton (IC) scattering. On the other hand, the proton synchrotron radiation can also explain the high energy component of SED although extreme parameters are needed. We also demonstrate that the $p\gamma$ interactions as well as the cascade process cannot explain SED. Our results imply that a leptonic origin is favored for the multi-wavelength emission of PKS 1502+036.


title: Azimuthal decorrelation for photon induced dijet production in ultra-peripheral collisions of heavy ions

abstract: We study the azimuthal angular decorrelation of the dijet production via photon fusion in ultra-peripheral heavy ion collisions. The impact parameter dependent cross section of quark-antiquark pairs production is derived using the equivalent photon approximation, and the contribution from final-state QCD radiations to the azimuthal angular distribution are calculated within Soft-Collinear Effective Theory. We carry out the QCD resummation of large logarithms of the azimuthal angle as well as the jet radius at next-to-leading logarithmic accuracy. In the end we present the normalized differential cross section for azimuthal decorrelation of the dijet pair and find that our results are consistent with the measurements reported by the ATLAS collaboration.


title: Improving procedure for the reconstruction of an effective secular equation

abstract: The usual implement procedure for the reconstruction of secular equation for an effective Hamiltonian has been discussed and improved. A relative characteristic polynomial has been introduced for the effective Hamiltonian, to obtain a simplified effective-secular-equation which is equivalent to the one obtained in the usual reconstruction procedure but shows great convenience and effectiveness, especially when the $P$-space dimension is large.


title: Slow relaxation of out-of-time-ordered correlators in interacting integrable and nonintegrable spin-1/2 XYZ chains

abstract: Out-of-time ordered correlators (OTOCs) help characterize the scrambling of quantum information and are usually studied in the context of nonintegrable systems. In this work, we compare the relaxation dynamics of OTOCs in interacting integrable and nonintegrable spin-1/2 XYZ chains in regimes without a classical counterpart. In both kinds of chains, using the presence of symmetries such as $U(1)$ and supersymmetry, we consider regimes in which the OTOC operators overlap or not with the Hamiltonian. We show that the relaxation of the OTOCs is slow (fast) when there is (there is not) an overlap, independently of whether the chain is integrable or nonintegrable. When slow, we show that the OTOC dynamics follows closely that of the two-point correlators. We study the dynamics of OTOCs using numerical calculations, and gain analytical insights from the properties of the diagonal and of the off-diagonal matrix elements of the corresponding local operators in the energy eigenbasis.


title: Transport properties in the Horndeski holographic two-currents model

abstract: The transport features of the holographic two-currents model are investigated in the Horndeski gravity framework. This system displays metallic or insulating characteristics depending on whether the Horndeski coupling parameter $\gamma$ is negative or positive, but is unaffected by other system parameters such as the strength of the momentum dissipation $\hat{k}$, the doping $\chi$ and the coupling between two gauge fields $\theta$. Secondly, we demonstrate that the thermal conductivities are affected not only by the inherent properties of the black hole, but also by the model parameters. Furthermore, we are particularly interested in the Lorentz ratios' properties. As expected, the Wiedemann-Franz (WF) law is violated, as it is in the majority of holographic systems. Particularly intriguing is the fact that several Lorentz ratio bounds reported in the typical axions model still remain true in our current theories. We would like to highlight out, however, that the lower bound for $\hat{\bar{L}}_A$ is affected by the system parameters $\chi$, $\theta$ and $\gamma$, which differs from the case of the typical axions model.


title: Expressive Quantum Perceptrons for Quantum Neuromorphic Computing

abstract: Quantum neuromorphic computing (QNC) is a sub-field of quantum machine learning (QML) that capitalizes on inherent system dynamics. As a result, QNC can run on contemporary, noisy quantum hardware and is poised to realize challenging algorithms in the near term. One key issue in QNC is the characterization of the requisite dynamics for ensuring expressive quantum neuromorphic computation. We address this issue by proposing a building block for QNC architectures, what we call quantum perceptrons (QPs). Our proposed QPs compute based on the analog dynamics of interacting qubits with tunable coupling constants. We show that QPs are, with restricted resources, a quantum equivalent to the classical perceptron, a simple mathematical model for a neuron that is the building block of various machine learning architectures. Moreover, we show that QPs are theoretically capable of producing any unitary operation. Thus, QPs are computationally more expressive than their classical counterparts. As a result, QNC architectures built our of QPs are, theoretically, universal. We introduce a technique for mitigating barren plateaus in QPs called entanglement thinning. We demonstrate QPs' effectiveness by applying them to numerous QML problems, including calculating the inner products between quantum states, energy measurements, and time-reversal. Finally, we discuss potential implementations of QPs and how they can be used to build more complex QNC architectures.


title: Learning predictive checklists from continuous medical data

abstract: Checklists, while being only recently introduced in the medical domain, have become highly popular in daily clinical practice due to their combined effectiveness and great interpretability. Checklists are usually designed by expert clinicians that manually collect and analyze available evidence. However, the increasing quantity of available medical data is calling for a partially automated checklist design. Recent works have taken a step in that direction by learning predictive checklists from categorical data. In this work, we propose to extend this approach to accomodate learning checklists from continuous medical data using mixed-integer programming approach. We show that this extension outperforms a range of explainable machine learning baselines on the prediction of sepsis from intensive care clinical trajectories.


title: IFQA: Interpretable Face Quality Assessment

abstract: Existing face restoration models have relied on general assessment metrics that do not consider the characteristics of facial regions. Recent works have therefore assessed their methods using human studies, which is not scalable and involves significant effort. This paper proposes a novel face-centric metric based on an adversarial framework where a generator simulates face restoration and a discriminator assesses image quality. Specifically, our per-pixel discriminator enables interpretable evaluation that cannot be provided by traditional metrics. Moreover, our metric emphasizes facial primary regions considering that even minor changes to the eyes, nose, and mouth significantly affect human cognition. Our face-oriented metric consistently surpasses existing general or facial image quality assessment metrics by impressive margins. We demonstrate the generalizability of the proposed strategy in various architectural designs and challenging scenarios. Interestingly, we find that our IFQA can lead to performance improvement as an objective function.


title: SPE: Symmetrical Prompt Enhancement for Fact Probing

abstract: Pretrained language models (PLMs) have been shown to accumulate factual knowledge during pretrainingng (Petroni et al., 2019). Recent works probe PLMs for the extent of this knowledge through prompts either in discrete or continuous forms. However, these methods do not consider symmetry of the task: object prediction and subject prediction. In this work, we propose Symmetrical Prompt Enhancement (SPE), a continuous prompt-based method for factual probing in PLMs that leverages the symmetry of the task by constructing symmetrical prompts for subject and object prediction. Our results on a popular factual probing dataset, LAMA, show significant improvement of SPE over previous probing methods.


title: Robustness of optimal probabilistic storage and retrieval of unitary channels to noise

abstract: We investigate robustness of probabilistic storage and retrieval device optimized for phase gates to noise. We use noisy input composed of convex combination of unitary channel with either depolarizing or dephasing channel. We find out that the resistance to dephasing noise is higher than to depolarization. Interestingly, for the depolarisation the retrieval reduces the degree of noise. We also examine the possible realizations showing that their performance is different when the noise is present.


title: Designing Efficient Pair-Trading Strategies Using Cointegration for the Indian Stock Market

abstract: A pair-trading strategy is an approach that utilizes the fluctuations between prices of a pair of stocks in a short-term time frame, while in the long-term the pair may exhibit a strong association and co-movement pattern. When the prices of the stocks exhibit significant divergence, the shares of the stock that gains in price are sold (a short strategy) while the shares of the other stock whose price falls are bought (a long strategy). This paper presents a cointegration-based approach that identifies stocks listed in the five sectors of the National Stock Exchange (NSE) of India for designing efficient pair-trading portfolios. Based on the stock prices from Jan 1, 2018, to Dec 31, 2020, the cointegrated stocks are identified and the pairs are formed. The pair-trading portfolios are evaluated on their annual returns for the year 2021. The results show that the pairs of stocks from the auto and the realty sectors, in general, yielded the highest returns among the five sectors studied in the work. However, two among the five pairs from the information technology (IT) sector are found to have yielded negative returns.


title: Nonexistence of anti-symmetric solutions for fractional Hardy-H\'{e}non System

abstract: We study anti-symmetric solutions about the hyperplane $\{x_n=0\}$ to the following fractional Hardy-H\'{e}non system $$ \left\{\begin{aligned} &(-\Delta)^{s_1}u(x)=|x|^\alpha v^p(x),\ \ x\in\mathbb{R}_+^n, \\&(-\Delta)^{s_2}v(x)=|x|^\beta u^q(x),\ \ x\in\mathbb{R}_+^n, \\&u(x)\geq 0,\ \ v(x)\geq 0,\ \ x\in\mathbb{R}_+^n, \end{aligned}\right. $$ where $0<s_1,s_2<1$, $n>2\max\{s_1,s_2\}$. Nonexistence of anti-symmetric solutions are obtained in some appropriate domains of $(p,q)$ under some corresponding assumptions of $\alpha,\beta$ via the methods of moving spheres and moving planes. Particularly, for the case $s_1=s_2$, one of our results shows that one domain of $(p,q)$, where nonexistence of anti-symmetric solutions with appropriate decay conditions holds true, locates at above the fractional Sobolev's hyperbola under appropriate condition of $\alpha, \beta$.


title: Learning Latent Part-Whole Hierarchies for Point Clouds

abstract: Strong evidence suggests that humans perceive the 3D world by parsing visual scenes and objects into part-whole hierarchies. Although deep neural networks have the capability of learning powerful multi-level representations, they can not explicitly model part-whole hierarchies, which limits their expressiveness and interpretability in processing 3D vision data such as point clouds. To this end, we propose an encoder-decoder style latent variable model that explicitly learns the part-whole hierarchies for the multi-level point cloud segmentation. Specifically, the encoder takes a point cloud as input and predicts the per-point latent subpart distribution at the middle level. The decoder takes the latent variable and the feature from the encoder as an input and predicts the per-point part distribution at the top level. During training, only annotated part labels at the top level are provided, thus making the whole framework weakly supervised. We explore two kinds of approximated inference algorithms, i.e., most-probable-latent and Monte Carlo methods, and three stochastic gradient estimations for learning discrete latent variables, i.e., straight-through, REINFORCE, and pathwise estimators. Experimental results on the PartNet dataset show that the proposed method achieves state-of-the-art performance in not only top-level part segmentation but also middle-level latent subpart segmentation.


title: Revisiting the assignment of $1^{3}D_{1}$ meson nonet

abstract: Based on the mass relations from the Regge phenomenology, we revisit the mass spectrum of $1^{3}D_{1}$ meson nonet. The masses of kaon and $s\bar{s}$ member of $1^{3}D_{1}$ ($1^{3}D_{1}(s\bar{s})$) meson nonet are obtained and the results are compared with the values from different theoretical models. Moreover, the strong decay properties of the kaon and $1^{3}D_{1}(s\bar{s})$ are presented in the $^{3}P_{0}$ model. On the basis of results, we suggest the assignment of $1^{3}D_{1}$ meson nonet need further tested in the new experiment in the future. Our results also provide mass constraints for the study of these states.


title: Boosting Semi-Supervised 3D Object Detection with Semi-Sampling

abstract: Current 3D object detection methods heavily rely on an enormous amount of annotations. Semi-supervised learning can be used to alleviate this issue. Previous semi-supervised 3D object detection methods directly follow the practice of fully-supervised methods to augment labeled and unlabeled data, which is sub-optimal. In this paper, we design a data augmentation method for semi-supervised learning, which we call Semi-Sampling. Specifically, we use ground truth labels and pseudo labels to crop gt samples and pseudo samples on labeled frames and unlabeled frames, respectively. Then we can generate a gt sample database and a pseudo sample database. When training a teacher-student semi-supervised framework, we randomly select gt samples and pseudo samples to both labeled frames and unlabeled frames, making a strong data augmentation for them. Our semi-sampling can be regarded as an extension of gt-sampling to semi-supervised learning. Our method is simple but effective. We consistently improve state-of-the-art methods on ScanNet, SUN-RGBD, and KITTI benchmarks by large margins. For example, when training using only 10% labeled data on ScanNet, we achieve 3.1 mAP and 6.4 mAP improvement upon 3DIoUMatch in terms of mAP@0.25 and mAP@0.5. When training using only 1% labeled data on KITTI, we boost 3DIoUMatch by 3.5 mAP, 6.7 mAP and 14.1 mAP on car, pedestrian and cyclist classes. Codes will be made publicly available at https://github.com/LittlePey/Semi-Sampling.


title: Degree-degree Correlated Low-density Parity-check Codes Over a Binary Erasure Channel

abstract: Most existing works on analyzing the performance of a random ensemble of low-density parity-check (LDPC) codes assume that the degree distributions of the two ends of a randomly selected edge are independent. In the paper, we take one step further and consider ensembles of LDPC codes with degree-degree correlations. For this, we propose two methods to construct an ensemble of degree-degree correlated LDPC codes. We then derive a system of density evolution equations for such degree-degree correlated LDPC codes over a binary erasure channel (BEC). By conducting extensive numerical experiments, we show how the degree-degree correlation affects the performance of LDPC codes. Our numerical results show that LDPC codes with negative degree-degree correlation could improve the maximum tolerable erasure probability. Moreover, increasing the negative degree-degree correlation could lead to better unequal error protection (UEP) design.


title: Totally real algebraic integers in short intervals, Jacobi polynomials, and unicritical families in arithmetic dynamics

abstract: We classify all post-critically finite unicritical polynomials defined over the maximal totally real algebraic extension of ${\mathbb Q}$. Two auxiliary results used in the proof of this result may be of some independent interest. The first is a recursion formula for the $n$-diameter of an interval, which uses properties of Jacobi polynomials. The second is a numerical criterion which allows one to the give a bound on the degree of any algebraic integer having all of its complex embeddings in a real interval of length less than $4$.


title: $\mathrm{RCD}^{*}(K,N)$ spaces are semi-locally simply connected

abstract: It was shown by Mondino-Wei that any $\mathrm{RCD}^{*}(K,N)$ space $(X,d,\mathfrak{m})$ has a universal cover. We prove that for any point $x \in X$ and $R>0$, there exists $r<R$ such that any loop in $B_r(x)$ is contractible in $B_R(x)$; in particular, $X$ is semi-locally simply connected and the universal cover of $X$ is simply connected. This generalizes the author's earlier work that any Ricci limit space is semi-locally simply connected.


title: Recognition of Cardiac MRI Orientation via Deep Neural Networks and a Method to Improve Prediction Accuracy

abstract: In most medical image processing tasks, the orientation of an image would affect computing result. However, manually reorienting images wastes time and effort. In this paper, we study the problem of recognizing orientation in cardiac MRI and using deep neural network to solve this problem. For multiple sequences and modalities of MRI, we propose a transfer learning strategy, which adapts our proposed model from a single modality to multiple modalities. We also propose a prediction method that uses voting. The results shows that deep neural network is an effective way in recognition of cardiac MRI orientation and the voting prediction method could improve accuracy.


title: PMR: Prototypical Modal Rebalance for Multimodal Learning

abstract: Multimodal learning (MML) aims to jointly exploit the common priors of different modalities to compensate for their inherent limitations. However, existing MML methods often optimize a uniform objective for different modalities, leading to the notorious "modality imbalance" problem and counterproductive MML performance. To address the problem, some existing methods modulate the learning pace based on the fused modality, which is dominated by the better modality and eventually results in a limited improvement on the worse modal. To better exploit the features of multimodal, we propose Prototypical Modality Rebalance (PMR) to perform stimulation on the particular slow-learning modality without interference from other modalities. Specifically, we introduce the prototypes that represent general features for each class, to build the non-parametric classifiers for uni-modal performance evaluation. Then, we try to accelerate the slow-learning modality by enhancing its clustering toward prototypes. Furthermore, to alleviate the suppression from the dominant modality, we introduce a prototype-based entropy regularization term during the early training stage to prevent premature convergence. Besides, our method only relies on the representations of each modality and without restrictions from model structures and fusion methods, making it with great application potential for various scenarios.


title: Hand gesture recognition using 802.11ad mmWave sensor in the mobile device

abstract: We explore the feasibility of AI assisted hand-gesture recognition using 802.11ad 60GHz (mmWave) technology in smartphones. Range-Doppler information (RDI) is obtained by using pulse Doppler radar for gesture recognition. We built a prototype system, where radar sensing and WLAN communication waveform can coexist by time-division duplex (TDD), to demonstrate the real-time hand-gesture inference. It can gather sensing data and predict gestures within 100 milliseconds. First, we build the pipeline for the real-time feature processing, which is robust to occasional frame drops in the data stream. RDI sequence restoration is implemented to handle the frame dropping in the continuous data stream, and also applied to data augmentation. Second, different gestures RDI are analyzed, where finger and hand motions can clearly show distinctive features. Third, five typical gestures (swipe, palm-holding, pull-push, finger-sliding and noise) are experimented with, and a classification framework is explored to segment the different gestures in the continuous gesture sequence with arbitrary inputs. We evaluate our architecture on a large multi-person dataset and report > 95% accuracy with one CNN + LSTM model. Further, a pure CNN model is developed to fit to on-device implementation, which minimizes the inference latency, power consumption and computation cost. And the accuracy of this CNN model is more than 93% with only 2.29K parameters.


title: BiViT: Extremely Compressed Binary Vision Transformer

abstract: Model binarization can significantly compress model size, reduce energy consumption, and accelerate inference through efficient bit-wise operations. Although binarizing convolutional neural networks have been extensively studied, there is little work on exploring binarization of vision Transformers which underpin most recent breakthroughs in visual recognition. To this end, we propose to solve two fundamental challenges to push the horizon of Binary Vision Transformers (BiViT). First, the traditional binary method does not take the long-tailed distribution of softmax attention into consideration, bringing large binarization errors in the attention module. To solve this, we propose Softmax-aware Binarization, which dynamically adapts to the data distribution and reduces the error caused by binarization. Second, to better preserve the information of the pretrained model and restore accuracy, we propose a Cross-layer Binarization scheme that decouples the binarization of self-attention and multi-layer perceptrons (MLPs), and Parameterized Weight Scales which introduce learnable scaling factors for weight binarization. Overall, our method performs favorably against state-of-the-arts by 19.8% on the TinyImageNet dataset. On ImageNet, our BiViT achieves a competitive 75.6% Top-1 accuracy over Swin-S model. Additionally, on COCO object detection, our method achieves an mAP of 40.8 with a Swin-T backbone over Cascade Mask R-CNN framework.


title: Offline Estimation of Controlled Markov Chains: Minimaxity and Sample Complexity

abstract: In this work, we study a natural nonparametric estimator of the transition probability matrices of a finite controlled Markov chain. We consider an offline setting with a fixed dataset, collected using a so-called logging policy. We develop sample complexity bounds for the estimator and establish conditions for minimaxity. Our statistical bounds depend on the logging policy through its mixing properties. We show that achieving a particular statistical risk bound involves a subtle and interesting trade-off between the strength of the mixing properties and the number of samples. We demonstrate the validity of our results under various examples, such as ergodic Markov chains, weakly ergodic inhomogeneous Markov chains, and controlled Markov chains with non-stationary Markov, episodic, and greedy controls. Lastly, we use these sample complexity bounds to establish concomitant ones for offline evaluation of stationary Markov control policies.


title: Easy Guided Decoding in Providing Suggestions for Interactive Machine Translation

abstract: Machine translation technology has made great progress in recent years, but it cannot guarantee error free results. Human translators perform post editing on machine translations to correct errors in the scene of computer aided translation. In favor of expediting the post editing process, many works have investigated machine translation in interactive modes, in which machines can automatically refine the rest of translations constrained by human's edits. Translation Suggestion (TS), as an interactive mode to assist human translators, requires machines to generate alternatives for specific incorrect words or phrases selected by human translators. In this paper, we utilize the parameterized objective function of neural machine translation (NMT) and propose a novel constrained decoding algorithm, namely Prefix Suffix Guided Decoding (PSGD), to deal with the TS problem without additional training. Compared to the state of the art lexically constrained decoding method, PSGD improves translation quality by an average of $10.87$ BLEU and $8.62$ BLEU on the WeTS and the WMT 2022 Translation Suggestion datasets, respectively, and reduces decoding time overhead by an average of 63.4% tested on the WMT translation datasets. Furthermore, on both of the TS benchmark datasets, it is superior to other supervised learning systems trained with TS annotated data.


title: WALLABY Pilot Survey: Public release of HI data for almost 600 galaxies from phase 1 of ASKAP pilot observations

abstract: We present WALLABY pilot data release 1, the first public release of HI pilot survey data from the Wide-field ASKAP L-band Legacy All-sky Blind Survey (WALLABY) on the Australian Square Kilometre Array Pathfinder. Phase 1 of the WALLABY pilot survey targeted three $60~{\rm deg}^2$ regions on the sky in the direction of the Hydra and Norma galaxy clusters and the NGC 4636 galaxy group, covering the redshift range of z < 0.08. The source catalogue, images and spectra of nearly 600 extragalactic HI detections and kinematic models for 109 spatially resolved galaxies are available. As the pilot survey targeted regions containing nearby group and cluster environments, the median redshift of the sample of z ~ 0.014 is relatively low compared to the full WALLABY survey. The median galaxy HI mass is $2.3 \times 10^{9}~M_{\odot}$. The target noise level of 1.6 mJy per $30''$ beam and 18.5 kHz channel translates into a $5\sigma$ HI mass sensitivity for point sources of about $5.2 \times 10^{8} \, (D_{\rm L} / \mathrm{100~Mpc})^{2} \, M_{\odot}$ across 50 spectral channels (~200 km/s) and a $5\sigma$ HI column density sensitivity of about $8.6 \times 10^{19} \, (1 + z)^{4}~\mathrm{cm}^{-2}$ across 5 channels (~20 km/s) for emission filling the $30''$ beam. As expected for a pilot survey, several technical issues and artefacts are still affecting the data quality. Most notably, there are systematic flux errors of up to several 10% caused by uncertainties about the exact size and shape of each of the primary beams as well as the presence of sidelobes due to the finite deconvolution threshold. In addition, artefacts such as residual continuum emission and bandpass ripples have affected some of the data. The pilot survey has been highly successful in uncovering such technical problems, most of which are expected to be addressed and rectified before the start of the full WALLABY survey.


title: Compressive Spectrum Sensing Using Sampling-Controlled Block Orthogonal Matching Pursuit

abstract: This paper proposes two novel schemes of wideband compressive spectrum sensing (CSS) via block orthogonal matching pursuit (BOMP) algorithm, for achieving high sensing accuracy in real time. These schemes aim to reliably recover the spectrum by adaptively adjusting the number of required measurements without inducing unnecessary sampling redundancy. To this end, the minimum number of required measurements for successful recovery is first derived in terms of its probabilistic lower bound. Then, a CSS scheme is proposed by tightening the derived lower bound, where the key is the design of a nonlinear exponential indicator through a general-purpose sampling-controlled algorithm (SCA). In particular, a sampling-controlled BOMP (SC-BOMP) is developed through a holistic integration of the existing BOMP and the proposed SCA. For fast implementation, a modified version of SC-BOMP is further developed by exploring the block orthogonality in the form of sub-coherence of measurement matrices, which allows more compressive sampling in terms of smaller lower bound of the number of measurements. Such a fast SC-BOMP scheme achieves a desired tradeoff between the complexity and the performance. Simulations demonstrate that the two SC-BOMP schemes outperform the other benchmark algorithms.


title: Alternating Implicit Projected SGD and Its Efficient Variants for Equality-constrained Bilevel Optimization

abstract: Stochastic bilevel optimization, which captures the inherent nested structure of machine learning problems, is gaining popularity in many recent applications. Existing works on bilevel optimization mostly consider either unconstrained problems or constrained upper-level problems. This paper considers the stochastic bilevel optimization problems with equality constraints both in the upper and lower levels. By leveraging the special structure of the equality constraints problem, the paper first presents an alternating implicit projected SGD approach and establishes the $\tilde{\cal O}(\epsilon^{-2})$ sample complexity that matches the state-of-the-art complexity of ALSET \citep{chen2021closing} for unconstrained bilevel problems. To further save the cost of projection, the paper presents two alternating implicit projection-efficient SGD approaches, where one algorithm enjoys the $\tilde{\cal O}(\epsilon^{-2}/T)$ upper-level and $\tilde{\cal O}(\epsilon^{-1.5}/T^{\frac{3}{4}})$ lower-level projection complexity with ${\cal O}(T)$ lower-level batch size, and the other one enjoys $\tilde{\cal O}(\epsilon^{-1.5})$ upper-level and lower-level projection complexity with ${\cal O}(1)$ batch size. Application to federated bilevel optimization has been presented to showcase the empirical performance of our algorithms. Our results demonstrate that equality-constrained bilevel optimization with strongly-convex lower-level problems can be solved as efficiently as stochastic single-level optimization problems.


title: Coherent quantum LQG controllers with Luenberger dynamics

abstract: This paper is concerned with the coherent quantum linear-quadratic-Gaussian control problem of minimising an infinite-horizon mean square cost for a measurement-free field-mediated interconnection of a quantum plant with a stabilising quantum controller. The plant and the controller are multimode open quantum harmonic oscillators, governed by linear quantum stochastic differential equations and coupled to each other and the external multichannel bosonic fields in the vacuum state. We discuss an interplay between the quantum physical realizability conditions and the Luenberger structure associated with the classical separation principle. This leads to a quadratic constraint on the controller gain matrices, which is formulated in the framework of a swapping transformation for the conjugate positions and momenta in the canonical representation of the controller variables. For the class of coherent quantum controllers with the Luenberger dynamics, we obtain first-order necessary conditions of optimality in the form of algebraic equations, involving a matrix-valued Lagrange multiplier.


title: Knowledge Base Completion using Web-Based Question Answering and Multimodal Fusion

abstract: Over the past few years, large knowledge bases have been constructed to store massive amounts of knowledge. However, these knowledge bases are highly incomplete. To solve this problem, we propose a web-based question answering system system with multimodal fusion of unstructured and structured information, to fill in missing information for knowledge bases. To utilize unstructured information from the Web for knowledge base completion, we design a web-based question answering system using multimodal features and question templates to extract missing facts, which can achieve good performance with very few questions. To help improve extraction quality, the question answering system employs structured information from knowledge bases, such as entity types and entity-to-entity relatedness.


title: Adaptive High-Order A-WENO Schemes Based on a New Local Smoothness Indicator

abstract: We develop new adaptive alternative weighted essentially non-oscillatory (A-WENO) schemes for hyperbolic systems of conservation laws. The new schemes employ the recently proposed local characteristic decomposition based central-upwind numerical fluxes, the three-stage third-order strong stability preserving Runge-Kutta time integrator, and the fifth-order WENO-Z interpolation. The adaptive strategy is implemented by applying the limited interpolation only in the parts of the computational domain where the solution is identified as ``rough'' with the help of a smoothness indicator. We develop and use a new simple and robust local smoothness indicator (LSI), which is applied to the solutions computed at each of the three stages of the ODE solver. The new LSI and adaptive A-WENO schemes are tested on the Euler equations of gas dynamics. We implement the proposed LSI using the pressure, which remains smooth at contact discontinuities, while our goal is to detect other ``rough'' areas and apply the limited interpolation mostly in the neighborhoods of the shock waves. We demonstrate that the new adaptive schemes are highly accurate, non-oscillatory, and robust. They outperform their fully limited counterparts (the A-WENO schemes with the same numerical fluxes and ODE solver but with the WENO-Z interpolation employed everywhere) while being less computationally expensive.


title: Observations of pores and surrounding regions with CO 4.66 {\mu}m lines by BBSO/CYRA

abstract: Solar observations of carbon monoxide (CO) indicate the existence of lower-temperature gas in the lower solar chromosphere. We present an observation of pores, and quiet-Sun, and network magnetic field regions with CO 4.66 {\mu}m lines by the Cryogenic Infrared Spectrograph (CYRA) at Big Bear Solar Observatory. We used the strong CO lines at around 4.66 {\mu}m to understand the properties of the thermal structures of lower solar atmosphere in different solar features with various magnetic field strengths. AIA 1700 {\AA} images, HMI continuum images and magnetograms are also included in the observation. The data from 3D radiation magnetohydrodynamic (MHD) simulation with the Bifrost code are also employed for the first time to be compared with the observation. We used the RH code to synthesize the CO line profiles in the network regions. The CO 3-2 R14 line center intensity changes to be either enhanced or diminished with increasing magnetic field strength, which should be caused by different heating effects in magnetic flux tubes with different sizes. We find several "cold bubbles" in the CO 3-2 R14 line center intensity images, which can be classified into two types. One type is located in the quiet-Sun regions without magnetic fields. The other type, which has rarely been reported in the past, is near or surrounded by magnetic fields. Notably, some are located at the edge of the magnetic network. The two kinds of cold bubbles and the relationship between cold bubble intensities and network magnetic field strength are both reproduced by the 3D MHD simulation with the Bifrost and RH codes. The simulation also shows that there is a cold plasma blob near the network magnetic fields, causing the observed cold bubbles seen in the CO 3-2 R14 line center image. Our observation and simulation illustrate that the magnetic field plays a vital role in the generation of some CO cold bubbles.


title: Testing modified gravity scenarios with direct peculiar velocities

abstract: The theoretical basis of dark energy remains unknown and could signify a need to modify the laws of gravity on cosmological scales. In this study we investigate how the clustering and motions of galaxies can be used as probes of modified gravity theories, using galaxy and direct peculiar velocity auto- and cross-correlation functions. We measure and fit these correlation functions in simulations of $\Lambda$CDM, DGP, and $f(R)$ cosmologies and, by extracting the characteristic parameters of each model, we show that these theories can be distinguished from General Relativity using these measurements. We present forecasts showing that with sufficiently large data samples, this analysis technique is a competitive probe that can help place limits on allowed deviations from GR. For example, a peculiar velocity survey reaching to $z=0.5$ with $20\%$ distance accuracy would constrain model parameters to 3-$\sigma$ confidence limits $\log_{10}|f_{R0}| < -6.45$ for $f(R)$ gravity and $r_c > 2.88 \, c/H_0$ for nDGP, assuming a fiducial GR model.


title: Multi-User Delay Alignment Modulation for Millimeter Wave Massive MIMO

abstract: Delay alignment modulation (DAM) is a novel wideband communication technique, which exploits the high spatial resolution and multi-path sparsity of millimeter wave (mmWave) massive multiple-input multiple-output (MIMO) systems to mitigate inter-symbol interference (ISI), without relying on conventional techniques like channel equalization or multi-carrier transmission. In this paper, we extend the DAM technique to multi-user mmWave massive MIMO communication systems. We first provide asymptotic analysis by showing that when the number of base station (BS) antennas is much larger than the total number of channel paths, DAM is able to eliminate both ISI and inter-user interference (IUI) with the simple delay pre-compensation and per-path-based maximal ratio transmission (MRT) beamforming. We then study the general multi-user DAM design by considering the three classical transmit beamforming strategies in a per-path basis, namely MRT, zero-forcing (ZF) and regularized zero-forcing (RZF). Simulation results demonstrate that multi-user DAM can significantly outperform the benchmarking single-carrier ISI mitigation technique that only uses the strongest channel path of each user.


title: Machine Learning Diffusion Monte Carlo Forces

abstract: Diffusion Monte Carlo (DMC) is one of the most accurate techniques available for calculating the electronic properties of molecules and materials, yet it often remains a challenge to economically compute forces using this technique. As a result, ab initio molecular dynamics simulations and geometry optimizations that employ Diffusion Monte Carlo forces are often out of reach. One potential approach for accelerating the computation of "DMC forces" is to machine learn these forces from DMC energy calculations. In this work, we employ Behler-Parrinello Neural Networks to learn DMC forces from DMC energy calculations for geometry optimization and molecular dynamics simulations of small molecules. We illustrate the unique challenges that stem from learning forces without explicit force data and from noisy energy data by making rigorous comparisons of potential energy surface, dynamics, and optimization predictions among ab initio Density Functional Theory (DFT) simulations and machine learning models trained on DFT energies with forces, DFT energies without forces, and DMC energies without forces. We show for three small molecules - C2, H2O, and CH3Cl - that machine learned DMC dynamics can reproduce average bond lengths and angles within a few percent of known experimental results at a 100th of the typical cost. Our work describes a much-needed means of performing dynamics simulations on high-accuracy, DMC PESs and for generating DMC-quality molecular geometries given current algorithmic constraints.


title: MetaKRec: Collaborative Meta-Knowledge Enhanced Recommender System

abstract: Knowledge graph (KG) enhanced recommendation has demonstrated improved performance in the recommendation system (RecSys) and attracted considerable research interest. Recently the literature has adopted neural graph networks (GNNs) on the collaborative knowledge graph and built an end-to-end KG-enhanced RecSys. However, the majority of these approaches have three limitations: (1) treat the collaborative knowledge graph as a homogeneous graph and overlook the highly heterogeneous relationships among items, (2) lack of design to explicitly leverage the rich side information, and (3) overlook the rich knowledge in user preference. To fill this gap, in this paper, we explore the rich, heterogeneous relationship among items and propose a new KG-enhanced recommendation model called Collaborative Meta-Knowledge Enhanced Recommender System (MetaKRec). In particular, we focus on modeling the rich, heterogeneous semantic relationships among items and construct several collaborative Meta-KGs to explicitly depict the relatedness of the items under the guidance of meta-knowledge. In addition to the knowledge obtained from KG, we leverage user knowledge that extracts from user preference to construct the Meta-KGs. The constructed Meta-KGs can capture the knowledge from both the knowledge graph and user preference. Furthermore. we utilize a light convolution encoder to recursively integrate the item relationship in each collaborative Meta-KGs. This scheme allows us to explicitly gather the heterogeneous semantic relationships among items and encode them into the representations of items. In addition, we propose channel attention to fuse the item and user representations from different Meta-KGs. Extensive experiments are conducted on four real-world benchmark datasets, demonstrating significant gains over the state-of-the-art baselines on both regular and cold-start recommendation settings.


title: Bayesian Reconstruction and Differential Testing of Excised mRNA

abstract: Characterizing the differential excision of mRNA is critical for understanding the functional complexity of a cell or tissue, from normal developmental processes to disease pathogenesis. Most transcript reconstruction methods infer full-length transcripts from high-throughput sequencing data. However, this is a challenging task due to incomplete annotations and the differential expression of transcripts across cell-types, tissues, and experimental conditions. Several recent methods circumvent these difficulties by considering local splicing events, but these methods lose transcript-level splicing information and may conflate transcripts. We develop the first probabilistic model that reconciles the transcript and local splicing perspectives. First, we formalize the sequence of mRNA excisions (SME) reconstruction problem, which aims to assemble variable-length sequences of mRNA excisions from RNA-sequencing data. We then present a novel hierarchical Bayesian admixture model for the Reconstruction of Excised mRNA (BREM). BREM interpolates between local splicing events and full-length transcripts and thus focuses only on SMEs that have high posterior probability. We develop posterior inference algorithms based on Gibbs sampling and local search of independent sets and characterize differential SME usage using generalized linear models based on converged BREM model parameters. We show that BREM achieves higher F1 score for reconstruction tasks and improved accuracy and sensitivity in differential splicing when compared with four state-of-the-art transcript and local splicing methods on simulated data. Lastly, we evaluate BREM on both bulk and scRNA sequencing data based on transcript reconstruction, novelty of transcripts produced, model sensitivity to hyperparameters, and a functional analysis of differentially expressed SMEs, demonstrating that BREM captures relevant biological signal.


title: Young wall construction of level-1 highest weight crystals over $U_q(D_4^{(3)})$ and $U_q(G_2^{(1)})$

abstract: With the help of path realization and affine energy function, we give a Young wall construction of level-1 highest weight crystals $B(\lambda)$ over $U_{q}(G_{2}^{(1)})$ and $U_{q}(D_{4}^{(3)})$. Our construction is based on four different shapes of colored blocks, $\mathbf O$-block, $\mathbf I$-block, $\mathbf L$-block and $\mathbf{LL}$-block, obtained by cutting the unit cube in three different ways.


title: Nitrogen-tailored quasiparticle energy gaps of polyynes

abstract: Polyyne, a sp1-hybridized linear allotrope of carbon, has a tunable quasiparticle energy gap, which depends on the terminated chemical ending groups as well as the chain length. Previously, nitrogen doping was utilized to tailor the properties of different kinds of allotrope of carbon. However, how the nitrogen doping tailors the properties of the polyyne remains unexplored. Here, we applied the GW method to study the quasiparticle energy gaps of the N-doped polyynes with different lengths. When a C atom is substituted by a N atom in a polyyne, the quasiparticle energy gap varies with the substituted position in the polyyne. The modification is particularly pronounced when the second-nearest-neighboring carbon atom of a hydrogen atom is substituted. In addition, the nitrogen doping makes the Fermi level closer to the lowest unoccupied molecular orbital, resulting in a n-type semiconductor. Our results suggest another route to tailor the electronic properties of polyyne in addition to the length of polyyne and the terminated chemical ending groups.


title: Recursive Cross-View: Use Only 2D Detectors to Achieve 3D Object Detection without 3D Annotations

abstract: Heavily relying on 3D annotations limits the real-world application of 3D object detection. In this paper, we propose a method that does not demand any 3D annotation, while being able to predict fully oriented 3D bounding boxes. Our method, called Recursive Cross-View (RCV), utilizes the three-view principle to convert 3D detection into multiple 2D detection tasks, requiring only a subset of 2D labels. We propose a recursive paradigm, in which instance segmentation and 3D bounding box generation by Cross-View are implemented recursively until convergence. Specifically, our proposed method involves the use of a frustum for each 2D bounding box, which is then followed by the recursive paradigm that ultimately generates a fully oriented 3D box, along with its corresponding class and score. Note that, class and score are given by the 2D detector. Estimated on the SUN RGB-D and KITTI datasets, our method outperforms existing image-based approaches. To justify that our method can be quickly used to new tasks, we implement it on two real-world scenarios, namely 3D human detection and 3D hand detection. As a result, two new 3D annotated datasets are obtained, which means that RCV can be viewed as a (semi-) automatic 3D annotator. Furthermore, we deploy RCV on a depth sensor, which achieves detection at 7 fps on a live RGB-D stream. RCV is the first 3D detection method that yields fully oriented 3D boxes without consuming 3D labels.


title: High-Dimensional Quantum Key Distribution in Quantum Access Networks

abstract: We investigate the use of high-dimensional quantum key distribution (HD-QKD) in wireless access to hybrid quantum classical networks. We study the distribution of d-dimensional time-phase encoded states between an indoor wireless user and the central office on the other end of the access network. We evaluate the performance in the case of transmitting quantum and classical signals over the same channel by accounting for the impact of background noise induced by the Raman-scattered light on the QKD receiver. We also take into account the loss and background noise that occur in indoor environments as well as finite key effects in our analysis. We show that an HD-QKD system with d = 4 can outperform its qubit-based counterpart.


title: A Reorder Trick for Decision Diagram Based Quantum Circuit Simulation

abstract: Quantum computing is a hotspot technology for its potential to accelerate specific applications by exploiting quantum parallelism. However, current physical quantum computers are limited to a relatively small scale, simulators based on conventional machines are significantly relied on to perform quantum computing research. The straightforward array-based simulators require a tremendous amount of memory that increases exponentially with respect to the number of qubits. To mitigate such computing resource concerns, decision diagram based simulators were proposed that can efficiently exploit data redundancies in quantum states and operations. In this paper, we study two classes of quantum circuits on which the state-of-the-art decision diagram based simulators failed to perform well in terms of simulation time. We also propose a simple and powerful reorder trick to boost the simulation of such quantum circuits. Preliminary evaluation results demonstrate the usefulness of the proposed trick. Especially, for the Quantum Phase Estimation circuits, the proposed trick achieved speedups up to 313.6x compared to a state-of-the-art approach that relies on an auxiliary tool to optimize simulation order.


title: Production of a highly degenerate Fermi gas of metastable helium-3 atoms

abstract: We report on the achievement of quantum degeneracy in both components of a Bose-Fermi mixture of metastable helium atoms, $^4$He* and $^3$He*. Degeneracy is achieved via Doppler cooling and forced evaporation for $^4$He*, and sympathetically cooling $^3$He* with $^4$He*. We discuss our simplified implementation, along with the high versatility of our system. This technique is able to produce a degenerate Fermi gas with a minimum reduced temperature of $T/T_F=0.14(1)$, consisting of $2.5 \times 10^4$ $^3$He* atoms. Due to the high internal energy of both isotopes single atom detection is possible, opening the possibility of a large number of experiments into Bose-Fermi mixtures.


title: Koopman Bilinearization of Nonlinear Control Systems

abstract: Koopman operators, since introduced by the French-born American mathematician Bernard Koopman in 1931, have been employed as a powerful tool for research in various scientific domains, such as ergodic theory, probability theory, geometry, and topology. The current use of Koopman operators mainly focuses on the characterization of spectral properties of ergodic dynamical systems. In this paper, we step forward from unforced dynamical systems to control systems and establish a systematic Koopman control framework. Specifically, we rigorously derive a differential equation system governing the dynamics of the Koopman operator associated with a control system, and show that the resulting system is a bilinear system evolving on an infinite-dimensional Lie group, which directly leads to a global bilinearization of control-affine systems. Then, by integrating techniques in geometric control theory with infinite-dimensional differential geometry, this further offers a two-fold benefit to controllability analysis: the characterization of controllability for control-affine systems in terms of de Rham differential operators and the extension of the Lie algebra rank condition to infinite-dimensional systems. To demonstrate the applicability, we further adopt the established framework to develop the Koopman feedback linearization technique, which, as one of the advantages, waives the controllability requirement for the systems to be linearized by using the classical feedback linearization technique. In addition, it is worth mentioning that a distinctive feature of this work is the maximum utilization of the intrinsic algebraic and geometric properties of Koopman operators, instead of spectral methods and the ergodicity assumption of systems, which further demonstrate a significant advantage of our work and a substantial difference between the presented and existing research into Koopman operators.


title: Path-following methods for Maximum a Posteriori estimators in Bayesian hierarchical models: How estimates depend on hyperparameters

abstract: Maximum a posteriori (MAP) estimation, like all Bayesian methods, depends on prior assumptions. These assumptions are often chosen to promote specific features in the recovered estimate. The form of the chosen prior determines the shape of the posterior distribution, thus the behavior of the estimator and complexity of the associated optimization problem. Here, we consider a family of Gaussian hierarchical models with generalized gamma hyperpriors designed to promote sparsity in linear inverse problems. By varying the hyperparameters, we move continuously between priors that act as smoothed $\ell_p$ penalties with flexible $p$, smoothing, and scale. We then introduce a predictor-corrector method that tracks MAP solution paths as the hyperparameters vary. Path following allows a user to explore the space of possible MAP solutions and to test the sensitivity of solutions to changes in the prior assumptions. By tracing paths from a convex region to a non-convex region, the user can find local minimizers in strongly sparsity promoting regimes that are consistent with a convex relaxation derived using related prior assumptions. We show experimentally that these solutions. are less error prone than direct optimization of the non-convex problem.


title: Polymer translocation in an environment of active rods

abstract: We consider the dynamics of a translocation process of a flexible linear polymer through a nanopore into an environment of active rods in the {\it trans} side. Using Langevin dynamics simulations we find that the rods facilitate translocation to the {\it trans} side even when there are initially more monomers on the {\it cis} than on the {\it trans} side. Structural analysis of the translocating polymer reveals that active rods induce a folded structure to the {\it trans}-side subchain in the case of successful translocation events. By keeping the initial number of monomers on the {\it cis}-side subchain fixed, we map out a state diagram for successful events as a function of the rod number density for a variety of system parameters. This reveals competition between facilitation by the rods at low densities and crowding that hinders translocation at higher densities.


title: Translocation of an Active Polymer into a Circular Cavity

abstract: Translocation dynamics of an active semi-flexible polymer through a nano-pore into a rigid two dimensional circular cavity, and the polymer packing dynamics have been studied by using Langevin dynamics (LD) simulations. The results show that the force exponent $\beta$, for regime of small cavity radius, i.e. $R \ll R_{\textrm{g}}$, where $R_{\textrm{g}}$ is the gyration radius of the passive semi-flexible polymer in two dimensional free space, is $\beta=-1$, while for large values of $R \gg R_{\textrm{g}}$ the asymptotic value of the force exponent is $\beta \approx -0.92$. The force exponent is defined by the scaling form of the average translocation time $\langle \tau \rangle \propto F_{\textrm{sp}}^{\beta}$, where $F_{\textrm{sp}}$ is the self-propelling force. Moreover, using the definition of the turning number for the polymer inside the cavity, it has been found that at the end of translocation process for small value of $R$ and in the strong force limit the polymer configuration is more regular than the case in which the value of $R$ is large or the force is weak.


title: Few-shot Metric Learning: Online Adaptation of Embedding for Retrieval

abstract: Metric learning aims to build a distance metric typically by learning an effective embedding function that maps similar objects into nearby points in its embedding space. Despite recent advances in deep metric learning, it remains challenging for the learned metric to generalize to unseen classes with a substantial domain gap. To tackle the issue, we explore a new problem of few-shot metric learning that aims to adapt the embedding function to the target domain with only a few annotated data. We introduce three few-shot metric learning baselines and propose the Channel-Rectifier Meta-Learning (CRML), which effectively adapts the metric space online by adjusting channels of intermediate layers. Experimental analyses on miniImageNet, CUB-200-2011, MPII, as well as a new dataset, miniDeepFashion, demonstrate that our method consistently improves the learned metric by adapting it to target classes and achieves a greater gain in image retrieval when the domain gap from the source classes is larger.


title: Unrealizability Logic

abstract: We consider the problem of establishing that a program-synthesis problem is unrealizable (i.e., has no solution in a given search space of programs). Prior work on unrealizability has developed some automatic techniques to establish that a problem is unrealizable; however, these techniques are all black-box, meaning that they conceal the reasoning behind why a synthesis problem is unrealizable. In this paper, we present a Hoare-style reasoning system, called unrealizability logic for establishing that a program-synthesis problem is unrealizable. To the best of our knowledge, unrealizability logic is the first proof system for overapproximating the execution of an infinite set of imperative programs. The logic provides a general, logical system for building checkable proofs about unrealizability. Similar to how Hoare logic distills the fundamental concepts behind algorithms and tools to prove the correctness of programs, unrealizability logic distills into a single logical system the fundamental concepts that were hidden within prior tools capable of establishing that a program-synthesis problem is unrealizable.


title: Information-guided pixel augmentation for pixel-wise contrastive learning

abstract: Contrastive learning (CL) is a form of self-supervised learning and has been widely used for various tasks. Different from widely studied instance-level contrastive learning, pixel-wise contrastive learning mainly helps with pixel-wise tasks such as medical landmark detection. The counterpart to an instance in instance-level CL is a pixel, along with its neighboring context, in pixel-wise CL. Aiming to build better feature representation, there is a vast literature about designing instance augmentation strategies for instance-level CL; but there is little similar work on pixel augmentation for pixel-wise CL with a pixel granularity. In this paper, we attempt to bridge this gap. We first classify a pixel into three categories, namely low-, medium-, and high-informative, based on the information quantity the pixel contains. Inspired by the ``InfoMin" principle, we then design separate augmentation strategies for each category in terms of augmentation intensity and sampling ratio. Extensive experiments validate that our information-guided pixel augmentation strategy succeeds in encoding more discriminative representations and surpassing other competitive approaches in unsupervised local feature matching. Furthermore, our pretrained model improves the performance of both one-shot and fully supervised models. To the best of our knowledge, we are the first to propose a pixel augmentation method with a pixel granularity for enhancing unsupervised pixel-wise contrastive learning.


title: Large Second-Order Josephson Effect in Planar Superconductor-Semiconductor Junctions

abstract: We investigate the current-phase relations of Al/InAs-quantum well planar Josephson junctions fabricated using nanowire shadowing technique. Based on several experiments, we conclude that the junctions exhibit an unusually large second-order Josephson harmonic, the $\sin(2\varphi)$ term. First, superconducting quantum interference devices (dc-SQUIDs) show half-periodic oscillations, tunable by gate voltages as well as magnetic flux. Second, Josephson junction devices exhibit kinks near half-flux quantum in supercurrent diffraction patterns. Third, half-integer Shapiro steps are present in the junctions. Similar phenomena are observed in Sn/InAs quantum well devices. We perform data fitting to a numerical model with a two-component current phase relation. Analysis including a loop inductance suggests that the sign of the second harmonic term is negative. The microscopic origins of the observed effect remain to be understood. We consider alternative explanations which can account for some but not all of the evidence.


title: Data-Driven Inverse of Linear Systems and Application to Disturbance Observers

abstract: This work develops a data-based construction of inverse dynamics for LTI systems. Specifically, the problem addressed here is to find an input sequence from the corresponding output sequence based on pre-collected input and output data. The problem can be considered as a reverse of the recent use of behavioral approach, in which the output sequence is obtained for a given input sequence by solving an equation formed by pre-collected data. The condition under which the problem gives a solution is investigated and turns out to be L-delay invertibility of the plant and a certain degree of persistent excitation of the data input. The result is applied to form a data-driven disturbance observer. The plant dynamics augmented by the data-driven disturbance observer exhibits disturbance rejection without the model knowledge of the plant.


title: Surface trap with adjustable ion couplings for scalable and parallel gates

abstract: We describe the design and operation of a surface-electrode Paul trap for parallel entangling gate implementation. In particular, we demonstrate the possibility of separating or coupling ion motion by adjusting the DC-voltages on a set of electrodes and show the possibility of parallel MS-gate operations for specific voltage configurations. We verify the scalability of this approach and characterize the performance of these gates in the presence of the finite phonon mode occupation and of the finite drift of the phonon frequencies. Additionally, we investigate how the number of ions per individual trapping site and anharmonic potential terms affect the coupling between the wells.


title: ContextCLIP: Contextual Alignment of Image-Text pairs on CLIP visual representations

abstract: State-of-the-art empirical work has shown that visual representations learned by deep neural networks are robust in nature and capable of performing classification tasks on diverse datasets. For example, CLIP demonstrated zero-shot transfer performance on multiple datasets for classification tasks in a joint embedding space of image and text pairs. However, it showed negative transfer performance on standard datasets, e.g., BirdsNAP, RESISC45, and MNIST. In this paper, we propose ContextCLIP, a contextual and contrastive learning framework for the contextual alignment of image-text pairs by learning robust visual representations on Conceptual Captions dataset. Our framework was observed to improve the image-text alignment by aligning text and image representations contextually in the joint embedding space. ContextCLIP showed good qualitative performance for text-to-image retrieval tasks and enhanced classification accuracy. We evaluated our model quantitatively with zero-shot transfer and fine-tuning experiments on CIFAR-10, CIFAR-100, Birdsnap, RESISC45, and MNIST datasets for classification task.


title: Lecture notes on the design of low-pass digital filters with wireless-communication applications

abstract: The low-pass filter is a fundamental building block from which digital signal-processing systems (e.g. radio and radar) are built. Signals in the electromagnetic spectrum extend over all timescales/frequencies and are used to transmit and receive very long or very short pulses of very narrow or very wide bandwidth. Time/Frequency agility is the key for optimal spectrum utilization (i.e. to suppress interference and enhance propagation) and low-pass filtering is the low-level digital mechanism for manoeuvre in this domain. By increasing and decreasing the bandwidth of a low-pass filter, thus decreasing and increasing its pulse duration, the engineer may shift energy concentration between frequency and time. Simple processes for engineering such components are described and explained below. These lecture notes are part of a short course that is intended to help recent engineering graduates design low-pass digital filters for this purpose, who have had some exposure to the topic during their studies, and who are now interested in the sending and receiving signals over the electromagnetic spectrum, in wireless communication (i.e. radio) and remote sensing (e.g. radar) applications, for instance. The best way to understand the material is to interact with the spectrum using receivers and or transmitters and software-defined radio development-kits provide a convenient platform for experimentation. Fortunately, wireless communication in the radio-frequency spectrum is an ideal application for the illustration of waveform agility in the electromagnetic spectrum. In Parts I and II, the theoretical foundations of digital low-pass filters are presented, i.e. signals-and-systems theory, then in Part III they are applied to the problem of radio communication and used to concentrate energy in time or frequency.


title: Entanglement dynamics of coupled quantum oscillators in independent nonMarkovian baths

abstract: This work strives to better understand how the entanglement in an open quantum system, here represented by two coupled Brownian oscillators, is affected by a nonMarkovian environment (with memories), here represented by two independent baths each oscillator separately interacts with. We consider two settings, a `symmetric' configuration wherein the parameters of both oscillators and their baths are identical, and an `asymmetric' configuration wherein they are different, in particular, a `hybrid' configuration, where one of the two coupled oscillators interacts with a nonMarkovian bath and the other with a Markovian bath. We ask two groups of questions: Q1) Which time regime does the bath's nonMarkovianity benefit the system's entanglement most? The answers we get from detailed numerical studies suggest that A1) For an initially entangled pair of oscillators, we see that in the intermediate time range, the duration of entanglement is proportional to the memory time, and it lasts a fraction of the relaxation time, but at late times when the dynamics reaches a steady state, the value of the symplectic eigenvalue of the partially transposed covariance matrix barely benefit from the bath nonMarkovianity. For the second group of questions: Q2)Can the memory of one nonMarkovian bath be passed on to another Markovian bath? And if so, does this memory transfer help to sustain the system's entanglement dynamics? Our results from numerical studies of the asymmetric hybrid configuration indicate that A2) A system with a short memory time can acquire improvement when it is coupled to another system with a long memory time, but, at a cost of the latter. The sustainability of the bipartite entanglement is determined by the party which breaks off entanglement most easily.


title: Global Performance Guarantees for Neural Network Models of AC Power Flow

abstract: Machine learning, which can generate extremely fast and highly accurate black-box surrogate models, is increasingly being applied to a variety of AC power flow problems. Rigorously verifying the accuracy of the resulting black-box models, however, is computationally challenging. This paper develops a tractable neural network verification procedure which incorporates the ground truth of the non-linear AC power flow equations to determine worst-case neural network prediction error. Our approach, termed Sequential Targeted Tightening (STT), leverages a loosely convexified reformulation of the original verification problem, which is an intractable mixed integer quadratic program (MIQP). Using the sequential addition of targeted cuts, we iteratively tighten our formulation until either the solution is sufficiently tight or a satisfactory performance guarantee has been generated. After learning neural network models of the 14, 57, 118, and 200-bus PGLib test cases, we compare the performance guarantees generated by our STT procedure with ones generated by a state-of-the-art MIQP solver, Gurobi 11.0. We show that STT often generates performance guarantees which are far tighter than the MIQP upper bound.


title: Discharge Summary Hospital Course Summarisation of In Patient Electronic Health Record Text with Clinical Concept Guided Deep Pre-Trained Transformer Models

abstract: Brief Hospital Course (BHC) summaries are succinct summaries of an entire hospital encounter, embedded within discharge summaries, written by senior clinicians responsible for the overall care of a patient. Methods to automatically produce summaries from inpatient documentation would be invaluable in reducing clinician manual burden of summarising documents under high time-pressure to admit and discharge patients. Automatically producing these summaries from the inpatient course, is a complex, multi-document summarisation task, as source notes are written from various perspectives (e.g. nursing, doctor, radiology), during the course of the hospitalisation. We demonstrate a range of methods for BHC summarisation demonstrating the performance of deep learning summarisation models across extractive and abstractive summarisation scenarios. We also test a novel ensemble extractive and abstractive summarisation model that incorporates a medical concept ontology (SNOMED) as a clinical guidance signal and shows superior performance in 2 real-world clinical data sets.


title: Simultaneous MMC readout using a tailored {\mu}MUX based readout system

abstract: Magnetic microcalorimeters (MMCs) are cryogenic, energy-dispersive single-particle detectors providing excellent energy resolution, intrinsically fast signal rise time, quantum efficiency close to 100\%, large dynamic range as well as almost ideal linear response. One of the remaining challenges to be overcome to ultimately allow for the utilization of large-scale MMC based detector arrays with thousands to millions of individual pixels is the realization of a SQUID based multiplexing technique particularly tailored for MMC readout. Within this context, we report on the first truly multiplexed readout of an MMC based detector array using a frequency-division multiplexing approach realized by a custom microwave SQUID multiplexer based readout system.


title: The Young Supernova Experiment Data Release 1 (YSE DR1): Light Curves and Photometric Classification of 1975 Supernovae

abstract: We present the Young Supernova Experiment Data Release 1 (YSE DR1), comprised of processed multi-color Pan-STARRS1 (PS1) griz and Zwicky Transient Facility (ZTF) gr photometry of 1975 transients with host-galaxy associations, redshifts, spectroscopic/photometric classifications, and additional data products from 2019 November 24 to 2021 December 20. YSE DR1 spans discoveries and observations from young and fast-rising supernovae (SNe) to transients that persist for over a year, with a redshift distribution reaching z~0.5. We present relative SN rates from YSE's magnitude- and volume-limited surveys, which are consistent with previously published values within estimated uncertainties for untargeted surveys. We combine YSE and ZTF data, and create multi-survey SN simulations to train the ParSNIP and SuperRAENN photometric classification algorithms; when validating our ParSNIP classifier on 472 spectroscopically classified YSE DR1 SNe, we achieve 82% accuracy across three SN classes (SNe Ia, II, Ib/Ic) and 90% accuracy across two SN classes (SNe Ia, core-collapse SNe). Our classifier performs particularly well on SNe Ia, with high (>90%) individual completeness and purity, which will help build an anchor photometric SNe Ia sample for cosmology. We then use our photometric classifier to characterize our photometric sample of 1483 SNe, labeling 1048 (~71%) SNe Ia, 339 (~23%) SNe II, and 96 (~6%) SNe Ib/Ic. YSE DR1 provides a training ground for building discovery, anomaly detection, and classification algorithms, performing cosmological analyses, understanding the nature of red and rare transients, exploring tidal disruption events and nuclear variability, and preparing for the forthcoming Vera C. Rubin Observatory Legacy Survey of Space and Time.


title: Counting Functions for Random Objects in a Category

abstract: In arithmetic statistics and analytic number theory, the asymptotic growth rate of counting functions giving the number of objects with order below $X$ is studied as $X\to \infty$. We define general counting functions which count epimorphisms out of an object on a category under some ordering. Given a probability measure $\mu$ on the isomorphism classes of the category with sufficient respect for a product structure, we prove a version of the Law of Large Numbers to give the asymptotic growth rate as $X$ tends towards $\infty$ of such functions with probability $1$ in terms of the finite moments of $\mu$ and the ordering. Such counting functions are motivated by work in arithmetic statistics, including number field counting as in Malle's conjecture and point counting as in the Batyrev-Manin conjecture. Recent work of Sawin--Wood gives sufficient conditions to construct such a measure $\mu$ from a well-behaved sequence of finite moments in very broad contexts, and we prove our results in this broad context with the added assumption that a product structure in the category is respected. These results allow us to formalize vast heuristic predictions about counting functions in general settings.


title: Edge-MultiAI: Multi-Tenancy of Latency-Sensitive Deep Learning Applications on Edge

abstract: Smart IoT-based systems often desire continuous execution of multiple latency-sensitive Deep Learning (DL) applications. The edge servers serve as the cornerstone of such IoT-based systems, however, their resource limitations hamper the continuous execution of multiple (multi-tenant) DL applications. The challenge is that, DL applications function based on bulky "neural network (NN) models" that cannot be simultaneously maintained in the limited memory space of the edge. Accordingly, the main contribution of this research is to overcome the memory contention challenge, thereby, meeting the latency constraints of the DL applications without compromising their inference accuracy. We propose an efficient NN model management framework, called Edge-MultiAI, that ushers the NN models of the DL applications into the edge memory such that the degree of multi-tenancy and the number of warm-starts are maximized. Edge-MultiAI leverages NN model compression techniques, such as model quantization, and dynamically loads NN models for DL applications to stimulate multi-tenancy on the edge server. We also devise a model management heuristic for Edge-MultiAI, called iWS-BFE, that functions based on the Bayesian theory to predict the inference requests for multi-tenant applications, and uses it to choose the appropriate NN models for loading, hence, increasing the number of warm-start inferences. We evaluate the efficacy and robustness of Edge-MultiAI under various configurations. The results reveal that Edge-MultiAI can stimulate the degree of multi-tenancy on the edge by at least 2X and increase the number of warm-starts by around 60% without any major loss on the inference accuracy of the applications.


title: YM2413-MDB: A Multi-Instrumental FM Video Game Music Dataset with Emotion Annotations

abstract: Existing multi-instrumental datasets tend to be biased toward pop and classical music. In addition, they generally lack high-level annotations such as emotion tags. In this paper, we propose YM2413-MDB, an 80s FM video game music dataset with multi-label emotion annotations. It includes 669 audio and MIDI files of music from Sega and MSX PC games in the 80s using YM2413, a programmable sound generator based on FM. The collected game music is arranged with a subset of 15 monophonic instruments and one drum instrument. They were converted from binary commands of the YM2413 sound chip. Each song was labeled with 19 emotion tags by two annotators and validated by three verifiers to obtain refined tags. We provide the baseline models and results for emotion recognition and emotion-conditioned symbolic music generation using YM2413-MDB.


title: The $\ell_p$-Subspace Sketch Problem in Small Dimensions with Applications to Support Vector Machines

abstract: In the $\ell_p$-subspace sketch problem, we are given an $n\times d$ matrix $A$ with $n>d$, and asked to build a small memory data structure $Q(A,\epsilon)$ so that, for any query vector $x\in\mathbb{R}^d$, we can output a number in $(1\pm\epsilon)\|Ax\|_p^p$ given only $Q(A,\epsilon)$. This problem is known to require $\tilde{\Omega}(d\epsilon^{-2})$ bits of memory for $d=\Omega(\log(1/\epsilon))$. However, for $d=o(\log(1/\epsilon))$, no data structure lower bounds were known. We resolve the memory required to solve the $\ell_p$-subspace sketch problem for any constant $d$ and integer $p$, showing that it is $\Omega(\epsilon^{-2(d-1)/(d+2p)})$ bits and $\tilde{O} (\epsilon^{-2(d-1)/(d+2p)})$ words. This shows that one can beat the $\Omega(\epsilon^{-2})$ lower bound, which holds for $d = \Omega(\log(1/\epsilon))$, for any constant $d$. We also show how to implement the upper bound in a single pass stream, with an additional multiplicative $\operatorname{poly}(\log \log n)$ factor and an additive $\operatorname{poly}(\log n)$ cost in the memory. Our bounds can be applied to point queries for SVMs with additive error, yielding an optimal bound of $\tilde{\Theta}(\epsilon^{-2d/(d+3)})$ for every constant $d$. This is a near-quadratic improvement over the $\Omega(\epsilon^{-(d+1)/(d+3)})$ lower bound of (Andoni et al. 2020). Our techniques rely on a novel connection to low dimensional techniques from geometric functional analysis.


title: On the characterisation of fragmented Bose-Einstein condensation and its emergent effective evolution

abstract: Fragmented Bose-Einstein condensates are large systems of identical bosons displaying \emph{multiple} macroscopic occupations of one-body states, in a suitable sense. The quest for an effective dynamics of the fragmented condensate at the leading order in the number of particles, in analogy to the much more controlled scenario for complete condensation in one single state, is deceptive both because characterising fragmentation solely in terms of reduced density matrices is unsatisfactory and ambiguous, and because as soon as the time evolution starts the rank of the reduced marginals generically passes from finite to infinite, which is a signature of a transfer of occupations on infinitely many more one-body states. In this work we review these difficulties, we refine previous characterisations of fragmented condensates in terms of marginals, and we provide a quantitative rate of convergence to the leading effective dynamics in the double limit of infinitely many particles and infinite energy gap.


title: A constitutive model for viscosity of dense fiber suspension

abstract: We propose a constitutive model to predict the viscosity of fiber suspensions, which undergoes shear thinning, at various volume fractions, aspect ratios, and shear stresses/rates. We calibrate the model using the data from direct numerical simulation and prove the accuracy by predicting experimental measurements from the literature. We use a friction coefficient decreasing with the normal load between the fibers to quantitatively reproduce the experimentally observed shear thinning in fiber suspensions. In this model, the effective normal contact force, which is directly proportional to the bulk shear stress, determines the effective friction coefficient. A rise in the shear stress reduces the effective friction coefficient in the suspension. As a result, the jamming volume fraction increases with the shear stress, resulting in a shear thinning in the suspension viscosity. Moreover, we extend the model to quantify the effects of fiber volume fraction and aspect ratio in the suspension. We calibrate this model using the data from numerical simulations for the rate-controlled shear flow. Once calibrated, we show that the model can be used to predict the relative viscosity for different volume fractions, shear stresses, and aspect ratios. The model predictions are in excellent agreement with the available experimental measurements from the literature. The findings of this study can potentially be used to tune the fiber size and volume fraction for designing the suspension rheology in various applications.


title: Rheology of dense fiber suspensions: Origin of yield stress, shear thinning and normal stress differences

abstract: We explain the origins of yield stress, shear-thinning, and normal stress differences in rigid fiber suspensions. We investigate the interplay between the hydrodynamic, colloidal attractive and repulsive, and inter-fiber contact interactions. The shear-thinning viscosity and finite yield stress obtained from the computational model are in quantitative agreement with experiential results from the literature. In this study, we show that attractive interactions result in yield stress and shear-thinning rheology in the suspensions of rigid fibers. This is an important finding, given the ongoing discussion regarding the origin of the yield stress for suspensions of fibers. The ability of the proposed model to quantitatively predict the rheology is not limited to only shear thinning and yield stress but also extends to normal stresses.