title: Topological Interfaces of Luttinger Liquids

abstract: Topological interfaces of two-dimensional conformal field theories contain information about symmetries of the theory and exhibit striking spectral and entanglement characteristics. While lattice realizations of these interfaces have been proposed for unitary minimal models, the same has remained elusive for the paradigmatic Luttinger liquid {\it i.e.,} the free, compact boson model. Here, we show that a topological interface of two Luttinger liquids can be realized by coupling special one-dimensional superconductors. The gapless excitations in the latter carry charges that are specific integer multiples of the charge of Cooper-pairs. The aforementioned integers are determined by the windings in the target space of the bosonic fields -- a crucial element required to give rise to nontrivial topological interfaces. The latter occur due to the perfect transmission of certain number of Cooper-pairs across the interface. The topological interfaces arise naturally in Josephson junction arrays with the simplest case being realized by an array of experimentally-demonstrated~$0-\pi$ qubits, capacitors and ordinary Josephson junctions. Signatures of the topological interface are obtained through entanglement entropy computations. In particular, the subleading contribution to the so-called interface entropy is shown to differ from existing field theory predictions. The proposed lattice model provides an experimentally-realizable alternative to spin and anyon chains for the analysis of several conjectured conformal fixed points which have so far eluded ab-initio investigation.

categories: cond-mat.str-el hep-lat hep-th math-ph math.MP quant-ph


title: Towards a fiber barrel detector for next-generation high-pressure gaseous xenon TPCs

abstract: The NEXT (Neutrino Experiment with a Xenon TPC) project is an international collaboration aimed at finding evidence of neutrinoless double beta decay using gaseous xenon. The current phase of the project involves the construction and operation of NEXT-100, which is designed to hold 100 kg of xenon at 15 bar and is expected to start commissioning in the first quarter of 2024. NEXT-HD will be a tonne scale experiment following NEXT-100 and will incorporate a symmetric design, with one cathode and two anodes. For this detector, the collaboration is considering to implement a barrel of wavelength-shifting fibers read-out by silicon photomultipliers to measure the energy of the particles interacting in the gaseous xenon. In this document, we will discuss the characteristics of this approach and provide an update on the related R&D efforts.


title: Sparse Variational Student-t Processes

abstract: The theory of Bayesian learning incorporates the use of Student-t Processes to model heavy-tailed distributions and datasets with outliers. However, despite Student-t Processes having a similar computational complexity as Gaussian Processes, there has been limited emphasis on the sparse representation of this model. This is mainly due to the increased difficulty in modeling and computation compared to previous sparse Gaussian Processes. Our motivation is to address the need for a sparse representation framework that reduces computational complexity, allowing Student-t Processes to be more flexible for real-world datasets. To achieve this, we leverage the conditional distribution of Student-t Processes to introduce sparse inducing points. Bayesian methods and variational inference are then utilized to derive a well-defined lower bound, facilitating more efficient optimization of our model through stochastic gradient descent. We propose two methods for computing the variational lower bound, one utilizing Monte Carlo sampling and the other employing Jensen's inequality to compute the KL regularization term in the loss function. We propose adopting these approaches as viable alternatives to Gaussian processes when the data might contain outliers or exhibit heavy-tailed behavior, and we provide specific recommendations for their applicability. We evaluate the two proposed approaches on various synthetic and real-world datasets from UCI and Kaggle, demonstrating their effectiveness compared to baseline methods in terms of computational complexity and accuracy, as well as their robustness to outliers.


title: Symmetry and functional inequalities for stable L\'evy-type operators

abstract: In this paper, we provide the sufficient and necessary conditions for the symmetry of the following stable L\'evy-type operator $\mathcal{L}$ on $\mathbb{R}$: $$\mathcal{L}=a(x){\Delta^{\alpha/2}}+b(x)\frac{\d}{\d x},$$ where $a,b$ are the continuous positive and differentiable functions, respectively. Under the assumption of symmetry, we further study the criteria for functional inequalities, including Poincar\'e inequalities, logarithmic Sobolev inequalities and Nash inequalities. Our proofs rely on the Orlicz space theory and the estimates of the Green functions.


title: Local times of deterministic paths and self-similar processes with stationary increments as normalized numbers of interval crossings

abstract: We prove a general result on a relationship between a limit of normalized numbers of interval crossings by a c\`adl\`ag path and an occupation measure associated with this path. Using this result we define local times of fractional Brownian motions (classically defined as densities of relevant occupation measure) as weak limits of properly normalized numbers of interval crossings. We also discuss a similar result for c\`adl\`ag semimartingales, in particular for alpha-stable processes, and for Rosenblatt processes, and provide natural examples of deterministic paths which possess quadratic or higher order variation but no local times.


title: Frugal LMs Trained to Invoke Symbolic Solvers Achieve Parameter-Efficient Arithmetic Reasoning

abstract: Large Language Models (LLM) exhibit zero-shot mathematical reasoning capacity as a behavior emergent with scale, commonly manifesting as chain-of-thoughts (CoT) reasoning. However, multiple empirical findings suggest that this prowess is exclusive to LLMs with exorbitant sizes (beyond 50 billion parameters). Meanwhile, educational neuroscientists suggest that symbolic algebraic manipulation be introduced around the same time as arithmetic word problems to modularize language-to-formulation, symbolic manipulation of the formulation, and endgame arithmetic. In this paper, we start with the hypothesis that much smaller LMs, which are weak at multi-step reasoning, can achieve reasonable arithmetic reasoning if arithmetic word problems are posed as a formalize-then-solve task. In our architecture, which we call SYRELM, the LM serves the role of a translator to map natural language arithmetic questions into a formal language (FL) description. A symbolic solver then evaluates the FL expression to obtain the answer. A small frozen LM, equipped with an efficient low-rank adapter, is capable of generating FL expressions that incorporate natural language descriptions of the arithmetic problem (e.g., variable names and their purposes, formal expressions combining variables, etc.). We adopt policy-gradient reinforcement learning to train the adapted LM, informed by the non-differentiable symbolic solver. This marks a sharp departure from the recent development in tool-augmented LLMs, in which the external tools (e.g., calculator, Web search, etc.) are essentially detached from the learning phase of the LM. SYRELM shows massive improvements (e.g., +30.65 absolute point improvement in accuracy on the SVAMP dataset using GPT-J 6B model) over base LMs, while keeping our testbed easy to diagnose, interpret and within reach of most researchers.


title: R2-Talker: Realistic Real-Time Talking Head Synthesis with Hash Grid Landmarks Encoding and Progressive Multilayer Conditioning

abstract: Dynamic NeRFs have recently garnered growing attention for 3D talking portrait synthesis. Despite advances in rendering speed and visual quality, challenges persist in enhancing efficiency and effectiveness. We present R2-Talker, an efficient and effective framework enabling realistic real-time talking head synthesis. Specifically, using multi-resolution hash grids, we introduce a novel approach for encoding facial landmarks as conditional features. This approach losslessly encodes landmark structures as conditional features, decoupling input diversity, and conditional spaces by mapping arbitrary landmarks to a unified feature space. We further propose a scheme of progressive multilayer conditioning in the NeRF rendering pipeline for effective conditional feature fusion. Our new approach has the following advantages as demonstrated by extensive experiments compared with the state-of-the-art works: 1) The lossless input encoding enables acquiring more precise features, yielding superior visual quality. The decoupling of inputs and conditional spaces improves generalizability. 2) The fusing of conditional features and MLP outputs at each MLP layer enhances conditional impact, resulting in more accurate lip synthesis and better visual quality. 3) It compactly structures the fusion of conditional features, significantly enhancing computational efficiency.


title: Revisiting RIP guarantees for sketching operators on mixture models

abstract: In the context of sketching for compressive mixture modeling, we revisit existing proofs of the Restricted Isometry Property of sketching operators with respect to certain mixtures models. After examining the shortcomings of existing guarantees, we propose an alternative analysis that circumvents the need to assume importance sampling when drawing random Fourier features to build random sketching operators. Our analysis is based on new deterministic bounds on the restricted isometry constant that depend solely on the set of frequencies used to define the sketching operator; then we leverage these bounds to establish concentration inequalities for random sketching operators that lead to the desired RIP guarantees. Our analysis also opens the door to theoretical guarantees for structured sketching with frequencies associated to fast random linear operators.


title: A simple model for the charm structure function of nuclei

abstract: In this paper, we have investigated the importance of quark charm in nuclear structure functions in the color dipole model at small $x$. The charm structure function per nucleon $F_{2}^{cA}/A$ for light and heavy nuclei in a wide range of transverse separations $\mathrm{r}$ with renormalization and factorization scales are considered. Bounds on the ratio $F^{cA}_{2}/AF^{A}_{2}$ for nuclei are well described with respect to the electron-ion future colliders kinematic range, i.e, EIC and EIcC colliders.


title: Synchronization of Differential Equations Driven by Linear Multiplicative Fractional Brownian Motion

abstract: This paper is devoted to the synchronization of stochastic differential equations driven by the linear multiplicative fractional Brownian motion with Hurst parameter $H\in(\frac{1}{2},1)$. We firstly prove that the equation has a unique stationary solution which generates a random dynamical system. Moreover the system has the pathwise singleton sets random attractor. Next we show up the synchronization of solutions of two coupled differential equations. At the end, we discuss two specific situations and provide the corresponding synchronization results.


title: Dynamic Adjustment of Matching Radii under the Broadcasting Mode: A Novel Multitask Learning Strategy and Temporal Modeling Approach

abstract: As ride-hailing services have experienced significant growth, the majority of research has concentrated on the dispatching mode, where drivers must adhere to the platform's assigned routes. However, the broadcasting mode, in which drivers can freely choose their preferred orders from those broadcast by the platform, has received less attention. One important but challenging task in such a system is the determination of the optimal matching radius, which usually varies across space, time, and real-time supply/demand characteristics. This study develops a Transformer-Encoder-Based (TEB) model that predicts key system performance metrics for a range of matching radii, which enables the ride-hailing platform to select an optimal matching radius that maximizes overall system performance according to real-time supply and demand information. To simultaneously maximize multiple system performance metrics for matching radius determination, we devise a novel multi-task learning algorithm that enhances convergence speed of each task (corresponding to the optimization of one metric) and delivers more accurate overall predictions. We evaluate our methods in a simulation environment specifically designed for broadcasting-mode-based ride-hailing service. Our findings reveal that dynamically adjusting matching radii based on our proposed predict-then-optimize approach significantly improves system performance, e.g., increasing platform revenue by 7.55% and enhancing order fulfillment rate by 13% compared to benchmark algorithms.


title: Spin noise spectroscopy of an alignment-based atomic magnetometer

abstract: Optically pumped magnetometers (OPMs) are revolutionising the task of magnetic-field sensing due to their extremely high sensitivity combined with technological improvements in miniaturisation which have led to compact and portable devices. OPMs can be based on spin-oriented or spin-aligned atomic ensembles which are spin-polarized through optical pumping with circular or linear polarized light, respectively. Characterisation of OPMs and the dynamical properties of their noise is important for applications in real-time sensing tasks. In our work, we experimentally perform spin noise spectroscopy of an alignment-based magnetometer. Moreover, we propose a stochastic model that predicts the noise power spectra exhibited by the device when, apart from the strong magnetic field responsible for the Larmor precession of the spin, white noise is applied in the perpendicular direction aligned with the pumping-probing beam. By varying the strength of the noise applied as well as the linear-polarisation angle of incoming light, we verify the model to accurately predict the heights of the Larmor-induced spectral peaks and their corresponding line-widths. Our work paves the way for alignment-based magnetometers to become operational in real-time sensing tasks.


title: Large nonlinear Hall effect and Berry curvature in KTaO3 based two-dimensional electron gas

abstract: The two-dimensional electron gas (2DEG) at oxide interfaces exhibits various exotic properties stemming from interfacial inversion symmetry breaking. In this work, we report the emergence of large nonlinear Hall effects (NHE) in the LaAlO3/KTaO3(111) interface 2DEG under zero magnetic field. Skew scattering was identified as the dominant origin based on the cubic scaling of nonlinear Hall conductivity with longitudinal conductivity and the threefold symmetry. Moreover, a gate-tunable NHE with pronounced peak and dip was observed and reproduced by our theoretical calculation. These results indicate the presence of Berry curvature hotspots and thus a large Berry curvature triple at the oxide interface. Our theoretical calculations confirm the existence of large Berry curvatures from the avoided crossing of multiple 5d-orbit bands, orders of magnitude larger than that in transition-metal dichalcogenides. NHE offers a new pathway to probe the Berry curvature at oxide interfaces, and facilitates new applications in oxide nonlinear electronics.


title: Conditional Stochastic Interpolation for Generative Learning

abstract: We propose a conditional stochastic interpolation (CSI) approach to learning conditional distributions. CSI learns probability flow equations or stochastic differential equations that transport a reference distribution to the target conditional distribution. This is achieved by first learning the drift function and the conditional score function based on conditional stochastic interpolation, which are then used to construct a deterministic process governed by an ordinary differential equation or a diffusion process for conditional sampling. In our proposed CSI model, we incorporate an adaptive diffusion term to address the instability issues arising during the training process. We provide explicit forms of the conditional score function and the drift function in terms of conditional expectations under mild conditions, which naturally lead to an nonparametric regression approach to estimating these functions. Furthermore, we establish non-asymptotic error bounds for learning the target conditional distribution via conditional stochastic interpolation in terms of KL divergence, taking into account the neural network approximation error. We illustrate the application of CSI on image generation using a benchmark image dataset.


title: Radiation-reaction effects on the production of twisted photon in the nonlinear inverse Thomson scattering

abstract: Twisted photons can be emitted by free electrons in circular or spiral motion, which carry orbital angular momentum (OAM) and possess a helical phase structure. However, classical radiation reaction (RR) effects has not been investigated as an accelerated electron emits vortex radiation during the interaction with a electromagnetic field. This work focuses on investigating the effects of radiation reaction on the production of twisted photons in the Nonlinear Inverse Thomson Scattering (NITS) process. Using the precise electron trajectory obtained by Landau-Lifshitz (LL) equation with a circularly polarized (CP) plane-wave field, we find that the radiation reaction effects can be significant for a sufficiently long pulse of a plane wave. They observe modifications in the frequency, phase structure, rotational asymmetry of OAM density, and energy distribution of the vortex field due to radiation reaction. This finding could provide an unique signature for the detection of radiation reaction.


title: Mechanical Analogue for Schrodinger's Matter-Wave Equation

abstract: In this paper we first show that, there exists a precise mechanical analogue for the one-dimensional version of Schrodinger's original 4th-order, real-valued matter-wave equation. It is a composite, flexural-shear beam supported on distributed elastic springs. Nevertheless, in spite of this finding, this paper shows that it is not possible to construct a physically realizable mechanical analogue for Schrodinger's 2nd-order, complex valued matter-wave equation which yields lower eigenvalues; therefore, lower energy levels than these predicted with his original 4th-order, real-valued matter-wave equation.


title: Robotics as a Simulation Educational Tool

abstract: In the evolving landscape of education, robotics has emerged as a powerful tool for fostering creativity, critical thinking, and problem-solving skills among students of all ages. This innovative approach to learning seamlessly integrates STEM (Science, Technology, Engineering, and Mathematics) concepts, creating an engaging and immersive learning experience. Educational robotics transcends traditional classroom settings, transforming learning into a hands-on, experiential endeavor. Students are actively involved in the design, construction, and programming of robots, allowing them to apply theoretical concepts to practical applications. This hands-on approach fosters deeper understanding and retention of knowledge, making learning more meaningful and enjoyable. In this paper, the potential of simulation robotics is evaluated as a hands on interactive learning experience that goes beyond traditional robotic classroom methods.


title: Better Neural PDE Solvers Through Data-Free Mesh Movers

abstract: Recently, neural networks have been extensively employed to solve partial differential equations (PDEs) in physical system modeling. While major studies focus on learning system evolution on predefined static mesh discretizations, some methods utilize reinforcement learning or supervised learning techniques to create adaptive and dynamic meshes, due to the dynamic nature of these systems. However, these approaches face two primary challenges: (1) the need for expensive optimal mesh data, and (2) the change of the solution space's degree of freedom and topology during mesh refinement. To address these challenges, this paper proposes a neural PDE solver with a neural mesh adapter. To begin with, we introduce a novel data-free neural mesh adaptor, called Data-free Mesh Mover (DMM), with two main innovations. Firstly, it is an operator that maps the solution to adaptive meshes and is trained using the Monge-Amp\`ere equation without optimal mesh data. Secondly, it dynamically changes the mesh by moving existing nodes rather than adding or deleting nodes and edges. Theoretical analysis shows that meshes generated by DMM have the lowest interpolation error bound. Based on DMM, to efficiently and accurately model dynamic systems, we develop a moving mesh based neural PDE solver (MM-PDE) that embeds the moving mesh with a two-branch architecture and a learnable interpolation framework to preserve information within the data. Empirical experiments demonstrate that our method generates suitable meshes and considerably enhances accuracy when modeling widely considered PDE systems. The code can be found at: https://github.com/Peiyannn/MM-PDE.git.


title: A Hybrid Method of Sentiment Analysis and Machine Learning Algorithm for the U.S. Presidential Election Forecasting

abstract: U.S. Presidential Election forecasting has been a research interest for several decades. Currently, election prediction consists of two main approaches: traditional models that incorporate economic data and poll surveys, and models that leverage Twitter (or X) and other social media platforms due to their increasing popularity in the past decade. However, traditional approaches have predominantly focused on national-level predictions, while social media-based approaches often oversimplify the nuanced differences between online discourse and the broader voting population's political landscape. In this work, we perform a hybrid method of both the machine learning algorithm and the sentiment analysis on the state level with various independent variables including census data, economic indicators, polling averages, and the newly defined average sentiment scores from Twitter. Our prediction for the 2020 U.S. Presidential Election yielded promising results. Most of our models successfully predicted a victory for the Democratic candidate with 96% accuracy using Gradient Boosting Trees and Multi-Layer Perceptron algorithms. This novel prediction framework addresses the limitations of existing U.S. Presidential Election forecasting approaches, particularly in terms of state-level predictions. It provides a valuable foundation for future research in this field and contributes to advancing our understanding of election dynamics.


title: Enhancing Medical Specialty Assignment to Patients using NLP Techniques

abstract: The introduction of Large Language Models (LLMs), and the vast volume of publicly available medical data, amplified the application of NLP to the medical domain. However, LLMs are pretrained on data that are not explicitly relevant to the domain that are applied to and are often biased towards the original data they were pretrained upon. Even when pretrained on domainspecific data, these models typically require time-consuming fine-tuning to achieve good performance for a specific task. To address these limitations, we propose an alternative approach that achieves superior performance while being computationally efficient. Specifically, we utilize keywords to train a deep learning architecture that outperforms a language model pretrained on a large corpus of text. Our proposal does not require pretraining nor fine-tuning and can be applied directly to a specific setting for performing multi-label classification. Our objective is to automatically assign a new patient to the specialty of the medical professional they require, using a dataset that contains medical transcriptions and relevant keywords. To this end, we fine-tune the PubMedBERT model on this dataset, which serves as the baseline for our experiments. We then twice train/fine-tune a DNN and the RoBERTa language model, using both the keywords and the full transcriptions as input. We compare the performance of these approaches using relevant metrics. Our results demonstrate that utilizing keywords for text classification significantly improves classification performance, for both a basic DL architecture and a large language model. Our approach represents a promising and efficient alternative to traditional methods for finetuning language models on domain-specific data and has potential applications in various medical domains


title: Deeper Understanding of Black-box Predictions via Generalized Influence Functions

abstract: Influence functions (IFs) elucidate how training data changes model behavior. However, the increasing size and non-convexity in large-scale models make IFs inaccurate. We suspect that the fragility comes from the first-order approximation which may cause nuisance changes in parameters irrelevant to the examined data. However, simply computing influence from the chosen parameters can be misleading, as it fails to nullify the hidden effects of unselected parameters on the analyzed data. Thus, our approach introduces generalized IFs, precisely estimating target parameters' influence while nullifying nuisance gradient changes on fixed parameters. We identify target update parameters closely associated with the input data by the output- and gradient-based parameter selection methods. We verify the generalized IFs with various alternatives of IFs on the class removal and label change tasks. The experiments align with the "less is more" philosophy, demonstrating that updating only 5\% of the model produces more accurate results than other influence functions across all tasks. We believe our proposal works as a foundational tool for optimizing models, conducting data analysis, and enhancing AI interpretability beyond the limitation of IFs. Codes are available at https://github.com/hslyu/GIF.


title: BF path integrals for elliptic curves and $p$-adic $L$-functions

abstract: We prove an arithmetic path integral formula for the inverse $p$-adic absolute values of the $p$-adic $L$-functions of elliptic curves over the rational numbers with good ordinary reduction at an odd prime $p$ based on the Iwasawa main conjecture and Mazur's control theorem. This is an elliptic curve analogue of \cite{CCKKPY}.


title: Language-assisted Vision Model Debugger: A Sample-Free Approach to Finding and Fixing Bugs

abstract: Vision models with high overall accuracy often exhibit systematic errors in specific scenarios, posing potential serious safety concerns. Diagnosing bugs of vision models is gaining increased attention, however traditional diagnostic approaches require annotation efforts (eg rich metadata accompanying each samples of CelebA). To address this issue,We propose a language-assisted diagnostic method that uses texts instead of images to diagnose bugs in vision models based on multi-modal models (eg CLIP). Our approach connects the embedding space of CLIP with the buggy vision model to be diagnosed; meanwhile, utilizing a shared classifier and the cross-modal transferability of embedding space from CLIP, the text-branch of CLIP become a proxy model to find bugs in the buggy model. The proxy model can classify texts paired with images. During the diagnosis, a Large Language Model (LLM) is employed to obtain task-relevant corpora, and this corpora is used to extract keywords. Descriptions constructed with templates containing these keywords serve as input text to probe errors in the proxy model. Finally, we validate the ability to diagnose existing visual models using language on the Waterbirds and CelebA datasets, we can identify bugs comprehensible to human experts, uncovering not only known bugs but also previously unknown ones.


title: A Review of Hybrid and Ensemble in Deep Learning for Natural Language Processing

abstract: This review presents a comprehensive exploration of hybrid and ensemble deep learning models within Natural Language Processing (NLP), shedding light on their transformative potential across diverse tasks such as Sentiment Analysis, Named Entity Recognition, Machine Translation, Question Answering, Text Classification, Generation, Speech Recognition, Summarization, and Language Modeling. The paper systematically introduces each task, delineates key architectures from Recurrent Neural Networks (RNNs) to Transformer-based models like BERT, and evaluates their performance, challenges, and computational demands. The adaptability of ensemble techniques is emphasized, highlighting their capacity to enhance various NLP applications. Challenges in implementation, including computational overhead, overfitting, and model interpretation complexities, are addressed alongside the trade-off between interpretability and performance. Serving as a concise yet invaluable guide, this review synthesizes insights into tasks, architectures, and challenges, offering a holistic perspective for researchers and practitioners aiming to advance language-driven applications through ensemble deep learning in NLP.


title: Gradient Tracking for High Dimensional Federated Optimization

abstract: In this paper, we study the (decentralized) distributed optimization problem with high-dimensional sparse structure. Building upon the FedDA algorithm, we propose a (Decentralized) FedDA-GT algorithm, which combines the \textbf{gradient tracking} technique. It is able to eliminate the heterogeneity among different clients' objective functions while ensuring a dimension-free convergence rate. Compared to the vanilla FedDA approach, (D)FedDA-GT can significantly reduce the communication complexity, from ${O}(s^2\log d/\varepsilon^{3/2})$ to a more efficient ${O}(s^2\log d/\varepsilon)$. In cases where strong convexity is applicable, we introduce a multistep mechanism resulting in the Multistep ReFedDA-GT algorithm, a minor modified version of FedDA-GT. This approach achieves an impressive communication complexity of ${O}\left(s\log d \log \frac{1}{\varepsilon}\right)$ through repeated calls to the ReFedDA-GT algorithm. Finally, we conduct numerical experiments, illustrating that our proposed algorithms enjoy the dual advantage of being dimension-free and heterogeneity-free.


title: Can FSRQ 3C 345 be a Very High Energy Blazar Candidate?

abstract: The recent detection of very high energy (VHE) emissions from flat spectrum radio quasars (FSRQs) at high redshifts has revealed that the universe is more transparent to VHE $\gamma$-rays than it was expected. It has also questioned the plausible VHE emission mechanism responsible for these objects. Particularly for FSRQs, the $\gamma$-ray emission is attributed to the external Compton process (EC). We perform a detailed spectral study of \emph{Fermi}-detected FSRQ 3C 345 using synchrotron, synchrotron self Compton (SSC) and EC emission mechanisms. The simultaneous data available in optical, UV, X-ray, and $\gamma$-ray energy bands is statistically fitted under these emission mechanisms using the $\chi^2$-minimization technique. Three high flux states and one low flux state are chosen for spectral fitting. The broadband spectral energy distribution (SED) during these flux states is fitted under different target photon temperatures, and the model VHE flux is compared with the 50\hspace{0.05cm}hr CTA sensitivity. Our results indicate a significant VHE emission could be attained during the high flux state from MJD 59635-59715 when the target photon temperature is within 900K to 1200K. Furthermore, our study shows a clear trend of variation in the bulk Lorentz factor of the emission region as the source transits through different flux states. We also note that during high $\gamma$-ray flux states, an increase in external photon temperature demands high bulk Lorentz factors, while this behaviour reverses in case of low $\gamma$-ray flux state.


title: Improving reconstructions in nanotomography for homogeneous materials via mathematical optimization

abstract: Compressed sensing is an image reconstruction technique to achieve high-quality results from limited amount of data. In order to achieve this, it utilizes prior knowledge about the samples that shall be reconstructed. Focusing on image reconstruction in nanotomography, this work proposes enhancements by including additional problem-specific knowledge. In more detail, we propose further classes of algebraic inequalities that are added to the compressed sensing model. The first consists in a valid upper bound on the pixel brightness. It only exploits general information about the projections and is thus applicable to a broad range of reconstruction problems. The second class is applicable whenever the sample material is of roughly homogeneous composition. The model favors a constant density and penalizes deviations from it. The resulting mathematical optimization models are algorithmically tractable and can be solved to global optimality by state-of-the-art available implementations of interior point methods. In order to evaluate the novel models, obtained results are compared to existing image reconstruction methods, tested on simulated and experimental data sets. The experimental data comprise one 360{\deg} electron tomography tilt series of a macroporous zeolite particle and one absorption contrast nano X-ray computed tomography (nano-CT) data set of a copper microlattice structure. The enriched models are optimized quickly and show improved reconstruction quality, outperforming the existing models. Promisingly, our approach yields superior reconstruction results, particularly when information about the samples is available for a small number of tilt angles only


title: Economic Forecasts Using Many Noises

abstract: This paper addresses a key question in economic forecasting: does pure noise truly lack predictive power? Economists typically conduct variable selection to eliminate noises from predictors. Yet, we prove a compelling result that in most economic forecasts, the inclusion of noises in predictions yields greater benefits than its exclusion. Furthermore, if the total number of predictors is not sufficiently large, intentionally adding more noises yields superior forecast performance, outperforming benchmark predictors relying on dimension reduction. The intuition lies in economic predictive signals being densely distributed among regression coefficients, maintaining modest forecast bias while diversifying away overall variance, even when a significant proportion of predictors constitute pure noises. One of our empirical demonstrations shows that intentionally adding 300~6,000 pure noises to the Welch and Goyal (2008) dataset achieves a noteworthy 10% out-of-sample R square accuracy in forecasting the annual U.S. equity premium. The performance surpasses the majority of sophisticated machine learning models.


title: Generative AI for Physical Layer Communications: A Survey

abstract: The recent evolution of generative artificial intelligence (GAI) leads to the emergence of groundbreaking applications such as ChatGPT, which not only enhances the efficiency of digital content production, such as text, audio, video, or even network traffic data, but also enriches its diversity. Beyond digital content creation, GAI's capability in analyzing complex data distributions offers great potential for wireless communications, particularly amidst a rapid expansion of new physical layer communication technologies. For example, the diffusion model can learn input signal distributions and use them to improve the channel estimation accuracy, while the variational autoencoder can model channel distribution and infer latent variables for blind channel equalization. Therefore, this paper presents a comprehensive investigation of GAI's applications for communications at the physical layer, ranging from traditional issues, including signal classification, channel estimation, and equalization, to emerging topics, such as intelligent reflecting surfaces and joint source channel coding. We also compare GAI-enabled physical layer communications with those supported by traditional AI, highlighting GAI's inherent capabilities and unique contributions in these areas. Finally, the paper discusses open issues and proposes several future research directions, laying a foundation for further exploration and advancement of GAI in physical layer communications.


title: On the (non-)existence of tight distance-regular graphs: a local approach

abstract: Let $\Gamma$ denote a distance-regular graph with diameter $D\geq 3$. Juri\v{s}i\'c and Vidali conjectured that if $\Gamma$ is tight with classical parameters $(D,b,\alpha,\beta)$, $b\geq 2$, then $\Gamma$ is not locally the block graph of an orthogonal array nor the block graph of a Steiner system. In the present paper, we prove this conjecture and, furthermore, extend it from the following aspect. Assume that for every triple of vertices $x, y, z$ of $\Gamma$, where $x$ and $y$ are adjacent, and $z$ is at distance $2$ from both $x$ and $y$, the number of common neighbors of $x$, $y$, $z$ is constant. We then show that if $\Gamma$ is locally the block graph of an orthogonal array (resp. a Steiner system) with smallest eigenvalue $-m$, $m\geq 3$, then the intersection number $c_2$ is not equal to $m^2$ (resp. $m(m+1)$). Using this result, we prove that if a tight distance-regular graph $\Gamma$ is not locally the block graph of an orthogonal array or a Steiner system, then the valency (and hence diameter) of $\Gamma$ is bounded by a function in the parameter $b=b_1/(1+\theta_1)$, where $b_1$ is the intersection number of $\Gamma$ and $\theta_1$ is the second largest eigenvalue of $\Gamma$.


title: Factorized Explainer for Graph Neural Networks

abstract: Graph Neural Networks (GNNs) have received increasing attention due to their ability to learn from graph-structured data. To open the black-box of these deep learning models, post-hoc instance-level explanation methods have been proposed to understand GNN predictions. These methods seek to discover substructures that explain the prediction behavior of a trained GNN. In this paper, we show analytically that for a large class of explanation tasks, conventional approaches, which are based on the principle of graph information bottleneck (GIB), admit trivial solutions that do not align with the notion of explainability. Instead, we argue that a modified GIB principle may be used to avoid the aforementioned trivial solutions. We further introduce a novel factorized explanation model with theoretical performance guarantees. The modified GIB is used to analyze the structural properties of the proposed factorized explainer. We conduct extensive experiments on both synthetic and real-world datasets to validate the effectiveness of our proposed factorized explainer.


title: Artificial Intelligence in the automatic coding of interviews on Landscape Quality Objectives. Comparison and case study

abstract: In this study, we conducted a comparative analysis of the automated coding provided by three Artificial Intelligence functionalities (At-las.ti, ChatGPT and Google Bard) in relation to the manual coding of 12 research interviews focused on Landscape Quality Objectives for a small island in the north of Cuba (Cayo Santa Mar\'ia). For this purpose, the following comparison criteria were established: Accuracy, Comprehensiveness, Thematic Coherence, Redundancy, Clarity, Detail and Regularity. The analysis showed the usefulness of AI for the intended purpose, albeit with numerous flaws and shortcomings. In summary, today the automatic coding of AIs can be considered useful as a guide towards a subsequent in-depth and meticulous analysis of the information by the researcher. However, as this is such a recently developed field, rapid evolution is expected to bring the necessary improvements to these tools.


title: Boosting the Cross-Architecture Generalization of Dataset Distillation through an Empirical Study

abstract: The poor cross-architecture generalization of dataset distillation greatly weakens its practical significance. This paper attempts to mitigate this issue through an empirical study, which suggests that the synthetic datasets undergo an inductive bias towards the distillation model. Therefore, the evaluation model is strictly confined to having similar architectures of the distillation model. We propose a novel method of EvaLuation with distillation Feature (ELF), which utilizes features from intermediate layers of the distillation model for the cross-architecture evaluation. In this manner, the evaluation model learns from bias-free knowledge therefore its architecture becomes unfettered while retaining performance. By performing extensive experiments, we successfully prove that ELF can well enhance the cross-architecture generalization of current DD methods. Code of this project is at \url{https://github.com/Lirui-Zhao/ELF}.


title: Not All Data Matters: An End-to-End Adaptive Dataset Pruning Framework for Enhancing Model Performance and Efficiency

abstract: While deep neural networks have demonstrated remarkable performance across various tasks, they typically require massive training data. Due to the presence of redundancies and biases in real-world datasets, not all data in the training dataset contributes to the model performance. To address this issue, dataset pruning techniques have been introduced to enhance model performance and efficiency by eliminating redundant training samples and reducing computational and memory overhead. However, previous works most rely on manually crafted scalar scores, limiting their practical performance and scalability across diverse deep networks and datasets. In this paper, we propose AdaPruner, an end-to-end Adaptive DAtaset PRUNing framEwoRk. AdaPruner can perform effective dataset pruning without the need for explicitly defined metrics. Our framework jointly prunes training data and fine-tunes models with task-specific optimization objectives. AdaPruner leverages (1) An adaptive dataset pruning (ADP) module, which iteratively prunes redundant samples to an expected pruning ratio; and (2) A pruning performance controller (PPC) module, which optimizes the model performance for accurate pruning. Therefore, AdaPruner exhibits high scalability and compatibility across various datasets and deep networks, yielding improved dataset distribution and enhanced model performance. AdaPruner can still significantly enhance model performance even after pruning up to 10-30\% of the training data. Notably, these improvements are accompanied by substantial savings in memory and computation costs. Qualitative and quantitative experiments suggest that AdaPruner outperforms other state-of-the-art dataset pruning methods by a large margin.


title: Continuous spectral and coupling-strength encoding with dual-gradient metasurfaces

abstract: Enhancing and controlling light-matter interactions is crucial in nanotechnology and material science, propelling research on green energy, laser technology, and quantum cryptography. Central to enhanced light-matter coupling are two parameters: the spectral overlap between an optical cavity mode and the material's spectral features (e.g., excitonic or molecular absorption lines), and the quality factor of the cavity. Controlling both parameters simultaneously is vital, especially in complex systems requiring extensive data to uncover the numerous effects at play. However, so far, photonic approaches have focused solely on sampling a limited set of data points within this 2D parameter space. Here we introduce a nanophotonic approach that can simultaneously and continuously encode the spectral and quality factor parameter space of light-matter interactions within a compact spatial area. Our novel dual-gradient metasurface design is composed of a 2D array of smoothly varying subwavelength nanoresonators, each supporting a unique mode. This results in 27,500 distinct modes within one array and a resonance density approaching the theoretical upper limit for metasurfaces. By applying our dual-gradient to surface-enhanced molecular sensing, we demonstrate the importance of coupling tailoring and unveil an additional coupling-based dimension of spectroscopic data. Our metasurface design paves the way for generalized light-matter coupling metasurfaces, leading to advancements in the field of photocatalysis, chemical sensing, and entangled photon generation.


title: A Meshless Solver for Blood Flow Simulations in Elastic Vessels Using Physics-Informed Neural Network

abstract: Investigating blood flow in the cardiovascular system is crucial for assessing cardiovascular health. Computational approaches offer some non-invasive alternatives to measure blood flow dynamics. Numerical simulations based on traditional methods such as finite-element and other numerical discretizations have been extensively studied and have yielded excellent results. However, adapting these methods to real-life simulations remains a complex task. In this paper, we propose a method that offers flexibility and can efficiently handle real-life simulations. We suggest utilizing the physics-informed neural network (PINN) to solve the Navier-Stokes equation in a deformable domain, specifically addressing the simulation of blood flow in elastic vessels. Our approach models blood flow using an incompressible, viscous Navier-Stokes equation in an Arbitrary Lagrangian-Eulerian form. The mechanical model for the vessel wall structure is formulated by an equation of Newton's second law of momentum and linear elasticity to the force exerted by the fluid flow. Our method is a mesh-free approach that eliminates the need for discretization and meshing of the computational domain. This makes it highly efficient in solving simulations involving complex geometries. Additionally, with the availability of well-developed open-source machine learning framework packages and parallel modules, our method can easily be accelerated through GPU computing and parallel computing. To evaluate our approach, we conducted experiments on regular cylinder vessels as well as vessels with plaque on their walls. We compared our results to a solution calculated by Finite Element Methods using a dense grid and small time steps, which we considered as the ground truth solution. We report the relative error and the time consumed to solve the problem, highlighting the advantages of our method.


title: EipFormer: Emphasizing Instance Positions in 3D Instance Segmentation

abstract: 3D instance segmentation plays a crucial role in comprehending 3D scenes. Despite recent advancements in this field, existing approaches exhibit certain limitations. These methods often rely on fixed instance positions obtained from sampled representative points in vast 3D point clouds, using center prediction or farthest point sampling. However, these selected positions may deviate from actual instance centers, posing challenges in precisely grouping instances. Moreover, the common practice of grouping candidate instances from a single type of coordinates introduces difficulties in identifying neighboring instances or incorporating edge points. To tackle these issues, we present a novel Transformer-based architecture, EipFormer, which comprises progressive aggregation and dual position embedding. The progressive aggregation mechanism leverages instance positions to refine instance proposals. It enhances the initial instance positions through weighted farthest point sampling and further refines the instance positions and proposals using aggregation averaging and center matching. Additionally, dual position embedding superposes the original and centralized position embeddings, thereby enhancing the model performance in distinguishing adjacent instances. Extensive experiments on popular datasets demonstrate that EipFormer achieves superior or comparable performance compared to state-of-the-art approaches.


title: Sim-GPT: Text Similarity via GPT Annotated Data

abstract: Due to the lack of a large collection of high-quality labeled sentence pairs with textual similarity scores, existing approaches for Semantic Textual Similarity (STS) mostly rely on unsupervised techniques or training signals that are only partially correlated with textual similarity, e.g., NLI-based datasets. To tackle this issue, in this paper, we propose the strategy of measuring text similarity via GPT annotated data (Sim-GPT for short). The core idea of Sim-GPT is to generate data with STS labels using GPT-4, based on which an STS model is trained. Sim-GPT framework utilizes LLMs to provide a substantial amount of reliable annotated data filling the gap of the lack of training signals for STS. Sim-GPT is trained on a one-time generated dataset using BERT or RoBERTa as the backbone, which offers long-term savings in cost and speed compared to repeatedly invoking LLMs for each sentence pair. Trained on the examples from GPT-4 (371K), Sim-GPT yields SOTA performances on the widely-used seven STS benchmarks: +0.99 over supervised-SimCSE, and +0.42 over the current SOTA PromCSE model. To encourage further advancements of the field, we release both models and the 371K annotated examples from GPT-4. Code, models and annotated data are available at: https://github.com/ShuheWang1998/Sim-GPT.


title: Nonlocal and mixed models with Lavrentiev Gap

abstract: We present a general framework for constructing examples on Lavrentiev energy gap for nonlocal problems and apply it to several nonlocal and mixed models of double-phase type.


title: TCNCA: Temporal Convolution Network with Chunked Attention for Scalable Sequence Processing

abstract: MEGA is a recent transformer-based architecture, which utilizes a linear recurrent operator whose parallel computation, based on the FFT, scales as $O(LlogL)$, with $L$ being the sequence length. We build upon their approach by replacing the linear recurrence with a special temporal convolutional network which permits larger receptive field size with shallower networks, and reduces the computational complexity to $O(L)$. The resulting model is called TCNCA, a Temporal Convolutional Network with Chunked Attention. We evaluate TCNCA on EnWik8 language modeling, long-range-arena (LRA) sequence classification, as well as a synthetic reasoning benchmark associative recall. On EnWik8, TCNCA outperforms MEGA, reaching a lower loss with $1.37\times$/$1.24\times$ faster forward/backward pass during training. The dilated convolutions used in TCNCA are consistently and significantly faster operations than the FFT-based parallelized recurrence in GPUs, making them a scalable candidate for handling very large sequence lengths: they are up to $7.07\times$/$2.86\times$ faster in the forward/backward pass for sequences up to 131k. Further on LRA, TCNCA achieves, on average, $1.28\times$ speed-up during inference with similar accuracy to what MEGA achieves. On associative recall, we find that even a simplified version of TCNCA, without excessive multiplicative and additive interactions, remains superior or competitive to MEGA on a range of sequence lengths and vocabulary sizes.


title: Fractional Dissipative PDEs

abstract: In this chapter we provide an introduction to fractional dissipative partial differential equations (PDEs) with a focus on trying to understand their dynamics. The class of PDEs we focus on are reaction-diffusion equations but we also provide an outlook on closely related classes of PDEs. To simplify the exposition, we only discuss the cases of fractional time derivatives and fractional space derivatives in the PDE separately. As our main tools, we describe analytical as well as numerical methods, which are generically necessary to study nonlinear dynamics. We start with the analytical study of steady states and local linear stability for fractional time derivatives. Then we extend this view to a global perspective and consider time-fractional PDEs and gradient flows. Next, we continue to steady states, linear stability analysis and bifurcations for space-fractional PDEs. As a final analytical consideration we discuss existence and stability of traveling waves for space-fractional PDEs. In the last parts, we provide numerical discretization schemes for fractional (dissipative) PDEs and we utilize these techniques within numerical continuation in applied examples of fractional reaction-diffusion PDEs. We conclude with a brief summary and outlook on open questions in the field.


title: Closed-Loop Finite-Time Analysis of Suboptimal Online Control

abstract: Suboptimal methods in optimal control arise due to a limited computational budget, unknown system dynamics, or a short prediction window among other reasons. Although these methods are ubiquitous, their transient performance remains relatively unstudied. We consider the control of discrete-time, nonlinear time-varying dynamical systems and establish sufficient conditions to analyze the finite-time closed-loop performance of such methods in terms of the additional cost incurred due to suboptimality. Finite-time guarantees allow the control design to distribute a limited computational budget over a time horizon and estimate the on-the-go loss in performance due to sub-optimality. We study exponential incremental input-to-state stabilizing policies, and show that for nonlinear systems, under some mild conditions, this property is directly implied by exponential stability without further assumptions on global smoothness. The analysis is showcased on a suboptimal model predictive control use case.


title: On the periodic and antiperiodic aspects of the Floquet normal form

abstract: Floquet's Theorem is a celebrated result in the theory of ordinary differential equations. Essentially, the theorem states that, when studying a linear differential system with $T$-periodic coefficients, we can apply a, possibly complex, $T$-periodic change of variables that transforms it into a linear system with constant coefficients. In this paper, we explore further the question of the nature of this change of variables. We state necessary and sufficient conditions for it to be real and $T$-periodic. Failing those conditions, we prove that we can still find a real change of variables that is ``partially" $T$-periodic and ``partially" $T$-antiperiodic. We also present applications of this new form of Floquet's Theorem to the study of the behavior of solutions of nonlinear differential systems near periodic orbits.


title: Comprehensive Analysis of BB84, A Quantum Key Distribution Protocol

abstract: Quantum Key Distribution (QKD) is a technique that enables secure communication between two parties by sharing a secret key. One of the most well-known QKD protocols is the BB84 protocol, proposed by Charles Bennett and Gilles Brassard in 1984. In this protocol, Alice and Bob use a quantum channel to exchange qubits, allowing them to generate a shared key that is resistant to eavesdropping. This paper presents a comparative study of existing QKD schemes, including the BB84 protocol, and highlights the advancements made in the BB84 protocol over the years. The study aims to provide a comprehensive overview of the different QKD schemes and their strengths and weaknesses and demonstrate QKDs working principles through existing simulations and implementations. Through this study, we show that the BB84 protocol is a highly secure QKD scheme that has been extensively studied and implemented in various settings. Furthermore, we discuss the improvements made to the BB84 protocol to enhance its security and practicality, including the use of decoy states and advanced error correction techniques. Overall, this paper provides a comprehensive analysis of QKD schemes, focusing on the BB84 protocol in secure communication technologies.


title: Vectorial adaptive optics for advanced imaging systems

abstract: Vectorial adaptive optics (V-AO) is a cutting-edge technique extending conventional AO into the vectorial domain encompassing both polarization and phase feedback correction for optical systems. However, previous V-AO approaches focus on point correction. In this letter, we extend this AO approach into the imaging domain. We show how V-AO can benefit an aberrated imaging system to enhance not only scalar imaging but also the quality of vectorial information. Two important criteria, vectorial precision and uniformity are put forward and used in practice to evaluate the performance of the correction. These experimental validations pave the way for real-world imaging for V-AO technology and its applications.


title: Triplet Edge Attention for Algorithmic Reasoning

abstract: This work investigates neural algorithmic reasoning to develop neural networks capable of learning from classical algorithms. The main challenge is to develop graph neural networks that are expressive enough to predict the given algorithm outputs while generalizing well to out-of-distribution data. In this work, we introduce a new graph neural network layer called Triplet Edge Attention (TEA), an edge-aware graph attention layer. Our algorithm works by precisely computing edge latent, aggregating multiple triplet messages using edge-based attention. We empirically validate our TEA layer in the CLRS benchmark and demonstrate a $5%$ improvement on average. In particular, we achieve a $30%$ improvement for the string algorithms compared to the state-of-the-art model.


title: Infrared photodetection in graphene-based heterostructures: bolometric and thermoelectric effects at the tunneling barrier

abstract: Graphene/hBN/graphene tunnel devices offer promise as sensitive mid-infrared photodetectors but the microscopic origin underlying the photoresponse in them remains elusive. In this work, we investigated the photocurrent generation in graphene/hBN/graphene tunnel structures with localized defect states under mid-IR illumination. We demonstrate that the photocurrent in these devices is proportional to the second derivative of the tunnel current with respect to the bias voltage, peaking during tunneling through the hBN impurity level. We revealed that the origin of the photocurrent generation lies in the change of the tunneling probability upon radiation-induced electron heating in graphene layers, in agreement with the theoretical model that we developed. Finally, we show that at a finite bias voltage, the photocurrent is proportional to the either of the graphene layers heating under the illumination, while at zero bias, it is proportional to the heating difference. Thus, the photocurrent in such devices can be used for accurate measurements of the electronic temperature providing a convenient alternative to Johnson noise thermometry.


title: Correlating isothermal compressibility to nucleon fluctuations in the inner crust of neutron stars

abstract: The question of how and which physical observables or thermodynamic parameters can best predict the onset of a possible phase transition in the inner crust of neutron stars remains largely unresolved. Using semiclassical Monte Carlo simulations, we investigate the isothermal compressibility and density fluctuations in a region of relevance to the dynamics of the inner crust. We show that the isothermal compressibility serves as a robust observable to characterize the transition from the non-uniform crust to the uniform core for proton fractions over 0.2. Moreover, we show explicitly how the two-component isothermal compressibility, computed using the Kirkwood-Buff theory, is directly connected to the fluctuations in the number density, recorded in the grand canonical ensemble by monitoring the number of particles in a small volume located at the center of the simulation box. That is, we compute mean-square particle fluctuations and compare them against the isothermal compressibility for different proton fractions. Although our results show that the mean-square particle fluctuations are proportional to the isothermal compressibility, the lack of a perfect correlation is attributed to the relatively small number of particles included in the simulations. The non-unity slope observed in the dimensionless isothermal compressibility-total nucleon fluctuation variance relationship suggests that the inner crust of neutron stars is composed of anisotropic and inhomogeneous matter.


title: Transformer as Linear Expansion of Learngene

abstract: We propose expanding the shared Transformer module to produce and initialize Transformers of varying depths, enabling adaptation to diverse resource constraints. Drawing an analogy to genetic expansibility, we term such module as learngene. To identify the expansion mechanism, we delve into the relationship between the layer's position and its corresponding weight value, and find that linear function appropriately approximates this relationship. Building on this insight, we present Transformer as Linear Expansion of learnGene (TLEG), a novel approach for flexibly producing and initializing Transformers of diverse depths. Specifically, to learn learngene, we firstly construct an auxiliary Transformer linearly expanded from learngene, after which we train it through employing soft distillation. Subsequently, we can produce and initialize Transformers of varying depths via linearly expanding the well-trained learngene, thereby supporting diverse downstream scenarios. Extensive experiments on ImageNet-1K demonstrate that TLEG achieves comparable or better performance in contrast to many individual models trained from scratch, while reducing around 2x training cost. When transferring to several downstream classification datasets, TLEG surpasses existing initialization methods by a large margin (e.g., +6.87% on iNat 2019 and +7.66% on CIFAR-100). Under the situation where we need to produce models of varying depths adapting for different resource constraints, TLEG achieves comparable results while reducing around 19x parameters stored to initialize these models and around 5x pre-training costs, in contrast to the pre-training and fine-tuning approach. When transferring a fixed set of parameters to initialize different models, TLEG presents better flexibility and competitive performance while reducing around 2.9x parameters stored to initialize, compared to the pre-training approach.


title: Poisson Geometric Formulation of Quantum Mechanics

abstract: We study the Poisson geometrical formulation of quantum mechanics for finite dimensional mixed and pure states. Equivalently, we show that quantum mechanics can be understood in the language of classical mechanics. We review the symplectic structure of the Hilbert space and identify its canonical coordinates. We extend the geometric picture to the space of density matrices $D_N^+$. We find it is not symplectic but admits a linear $\mathfrak{su}(N)$ Poisson structure. We identify Casimir surfaces of $D_N^+$ and show that the space of pure states $P_N \equiv \mathbb{C}P^{N-1}$ is one of its symplectic submanifolds which is an intersection of primitive Casimirs. We identify generic symplectic submanifolds of $D_N^+$ and calculate their dimensions. We find that $D_N^+$ is singularly foliated by the symplectic leaves of varying dimensions, also known as coadjoint orbits. We also find an ascending chain of Poisson submanifolds $D_N^M \subset D_N^{M+1}$ for $ 1 \leq M \leq N-1$. Each such Poisson submanifold $D_N^M$ is obtained by tracing out the $\mathbb{C}^M$ states from the bipartite system $\mathbb{C}^N \times \mathbb{C}^M$ and is an intersection of $N-M$ primitive Casimirs of $D_N^+$. Their Poisson structure is induced from the symplectic structure of the bipartite system. We also show their foliations. Finally, we study the positive semi-definite geometry of the symplectic submanifold $E_N^M$ consisting of the mixed states with maximum entropy in $D_N^M$.


title: Iterative Token Evaluation and Refinement for Real-World Super-Resolution

abstract: Real-world image super-resolution (RWSR) is a long-standing problem as low-quality (LQ) images often have complex and unidentified degradations. Existing methods such as Generative Adversarial Networks (GANs) or continuous diffusion models present their own issues including GANs being difficult to train while continuous diffusion models requiring numerous inference steps. In this paper, we propose an Iterative Token Evaluation and Refinement (ITER) framework for RWSR, which utilizes a discrete diffusion model operating in the discrete token representation space, i.e., indexes of features extracted from a VQGAN codebook pre-trained with high-quality (HQ) images. We show that ITER is easier to train than GANs and more efficient than continuous diffusion models. Specifically, we divide RWSR into two sub-tasks, i.e., distortion removal and texture generation. Distortion removal involves simple HQ token prediction with LQ images, while texture generation uses a discrete diffusion model to iteratively refine the distortion removal output with a token refinement network. In particular, we propose to include a token evaluation network in the discrete diffusion process. It learns to evaluate which tokens are good restorations and helps to improve the iterative refinement results. Moreover, the evaluation network can first check status of the distortion removal output and then adaptively select total refinement steps needed, thereby maintaining a good balance between distortion removal and texture generation. Extensive experimental results show that ITER is easy to train and performs well within just 8 iterative steps. Our codes will be available publicly.


title: Positivity is undecidable in tensor products of free algebras

abstract: It is well known that an element of the algebra of noncommutative *-polynomials is positive in all *-representations if and only if it is a sum of squares. This provides an effective way to determine if a given *-polynomial is positive, by searching through sums of squares decompositions. We show that no such procedure exists for the tensor product of two noncommutative *-polynomial algebras: determining whether a *-polynomial of such an algebra is positive is coRE-hard. We also show that it is coRE-hard to determine whether a noncommutative *-polynomial is trace-positive. Our results hold if noncommutative *-polynomial algebras are replaced by other sufficiently free algebras such as group algebras of free groups or free products of cyclic groups.


title: Poisson structures of some heavenly type dynamical systems

abstract: The paper investigates the Poisson structures associated with dynamical systems of the heavenly type, focusing on the Mikhalev-Pavlov and Pleba\'nski equation. The dynamical system is represented as a Hamiltonian system on a functional manifold, and Poisson brackets are defined based on a non-degenerate Poisson operator. The study explores the Lax-type integrability and bi-Hamiltonian properties of the systems, revealing the existence of compatible Poisson operators. The Lie-algebraic approach, particularly the AKS-algebraic and $\mathcal{R}$-structure schemes, is employed to analyze the holomorphic loop Lie algebra, providing insights into the Lie-algebraic structure of heavenly equations. The Mikhalev-Pavlov and Pleba\'nski equations are studied in detail, and the associated Poisson brackets for specific coordinate functions are derived, revealing interesting mathematical properties. The paper establishes a foundation for understanding the symplectic structures associated with heavenly-type dynamical systems.


title: Contributions of the subprocess $K^*_0(1430) \to K\eta^{\prime}$ in the charmless three-body $B$ meson decays

abstract: We study the contributions for $K\eta^{\prime}$ pair originating from the scalar intermediate state $K_0^{*}(1430)$ in the three-body decays $B\to K\eta^{\prime} h$ ($h=\pi, K$) within the perturbative QCD approach. The contribution of $K^*_0(1430)\to K\eta^{\prime}$ is described by the Flatt${\rm \acute{e}}$ formula with coupled channels $K\pi$, $K\eta$ and $K\eta^{\prime}$. The strong coupling constants $g_{K^*_0K\eta^{(\prime)}}$ are extracted from $g_{K^*_0 K\pi}$ within flavor SU$(3)$ symmetry. In spite of the strong depression by phase space near the threshold of $K\eta^\prime$, the $CP$ averaged branching fractions for the $B\to K^*_0(1430) h \to K\eta^\prime h$ decays are predicted to be on the order of $10^{-8}$ to $10^{-5}$, which are non-negligible for the corresponding three-body $B$ decays. Since the K$\eta$ system is almost decoupled from the even-spin strange mesons under flavor SU$(3)$ symmetry, those quasi-two-body $B$ decays with subprocess $K^*_0(1430) \to K \eta$ shall have quite small branching ratios and are not taken into account in this work. We also estimate that the branching fraction for $K_0^{*}(1430)\to K\eta^{\prime}$ is about one fifth of that for $K_0^{*}(1430)\to K\pi$. The predictions for the relevant decays are expected to be tested by the LHCb and Belle-II experiments in the future.


title: Geometric constructions of small regular graphs with girth 7

abstract: We present simple, geometric constructions for small regular graphs of girth 7 from the incidence graphs of some generalized quadrangles. We obtain infinite families of (q-1)-regular, q-regular and (q + 1)-regular graphs of girth 7, for q a prime power. Some of them have the smallest order known so far.


title: PILLOW: Enhancing Efficient Instruction Fine-tuning via Prompt Matching

abstract: Instruction fine-tuning has conventionally been employed to adapt Large Language Models (LLMs) to a variety of tasks. Nonetheless, this technique often necessitates substantial computational resources, making it impractical for deployment by individuals or small-scale entities. Recently, Low-Rank Adaptation (LoRA) has become a promising alternative, offering high capabilities on par with full tuning with reduced resource overhead. However, attaining satisfactory performance through the fine-tuning of LoRA is a non-trivial challenge. In this paper, we propose PILLOW, which aims to improve LoRA's performance by a discrimination-based prompting method, leveraging LLMs' In-Context Learning ability. PILLOW incorporates a matching network that selects prompts from a user-defined prompt pool, concatenates the selected prompts with the user instruction as input, and performs inference using the LoRA-fine-tuned LLMs. Trained with Reinforcement Learning, PILLOW exhibits commensurate performance on various evaluation metrics compared with typical instruction fine-tuning methods, utilizing only consumer-grade GPU resources and exhibiting a large reduction in computational costs.


title: Sequential Processing in Cell-free Massive MIMO Uplink with Limited Memory Access Points

abstract: Cell-free massive multiple-input multiple-output (MIMO) is an emerging technology that will reshape the architecture of next-generation networks. This paper considers the sequential fronthaul, whereby the access points (APs) are connected in a daisy chain topology with multiple sequential processing stages. With this sequential processing in the uplink, each AP refines users' signal estimates received from the previous AP based on its own local received signal vector. While this processing architecture has been shown to achieve the same performance as centralized processing, the impact of the limited memory capacity at the APs on the store and forward processing architecture is yet to be analyzed. Thus, we model the received signal vector compression using rate-distortion theory to demonstrate the effect of limited memory capacity on the optimal number of APs in the daisy chain fronthaul. Without this memory constraint, more geographically distributed antennas alleviate the adverse effect of large-scale fading on the signal-to-interference-plus-noise-ratio (SINR). However, we show that in case of limited memory capacity at each AP, the memory capacity to store the received signal vectors at the final AP of this fronthaul becomes a limiting factor. In other words, we show that when deciding on the number of APs to distribute the antennas, there is an inherent trade-off between more macro-diversity and compression noise power on the stored signal vectors at the APs. Hence, the available memory capacity at the APs significantly influences the optimal number of APs in the fronthaul.


title: Impact of Urban Street Geometry on the Detection Probability of Automotive Radars

abstract: Prior works have analyzed the performance of millimeter wave automotive radars in the presence of diverse clutter and interference scenarios using stochastic geometry tools instead of more time-consuming measurement studies or system-level simulations. In these works, the distributions of radars or discrete clutter scatterers were modeled as Poisson point processes in the Euclidean space. However, since most automotive radars are likely to be mounted on vehicles and road infrastructure, road geometries are an important factor that must be considered. Instead of considering each road geometry as an individual case for study, in this work, we model each case as a specific instance of an underlying Poisson line process and further model the distribution of vehicles on the road as a Poisson point process - forming a Poisson line Cox process. Then, through the use of stochastic geometry tools, we estimate the average number of interfering radars for specific road and vehicular densities and the effect of radar parameters such as noise and beamwidth on the radar detection metrics. The numerical results are validated with Monte Carlo simulations.


title: Extended Kohler's Rule of Magnetoresistance in TaCo$_2$Te$_2$

abstract: TaCo$_2$Te$_2$ is recently reported to be an air-stable, high mobility Van der Waals material with probable magnetic order. Here we investigate the scaling behavior of its magnetoresistance. We measured both the longitudinal ($\rho_{xx}$) and Hall ($\rho_{xy}$) magnetoresistivities of TaCo$_2$Te$_2$ crystals in magnetic fields parallel to the c-axis and found that the magnetoresistance violates the Kohler's rule $MR \sim f[H/\rho_0]$ while obeying the extended Kohler's rule $MR \sim f[H/(n_T\rho_0)]$, where $MR \sim [\rho_{xx}(H)-\rho_0]/\rho_0$, $H$ is the magnetic field, $n_T$ is a thermal factor, $\rho_{xx}(H)$ and $\rho_0$ are the resistivities at $H$ and zero field, respectively. While deviating from those of the densities of electrons ($n_e$) and holes ($n_h$) obtained from the two-band model analysis of the magnetoconductivities, the temperature dependence of $n_T$ is close to that of the Hall carrier densities $n_H$ calculated from the slopes of $\rho_{xy}(H)$ curves at low magnetic fields, providing a new way to obtain the thermal factor in the extended Kohler's rule.


title: Generation of C-NOT, SWAP, and C-Z Gates for Two Qubits Using Coherent and Incoherent Controls and Stochastic Optimization

abstract: In this work, we consider a general form of the dynamics of open quantum systems determined by the Gorini-Kossakowsky-Sudarchhan-Lindblad type master equation with simultaneous coherent and incoherent controls with three particular forms of the two-qubit Hamiltonians. Coherent control enters in the Hamiltonian and incoherent control enters in both the Hamiltonian and the superoperator of dissipation. For these systems, we analyze the control problems of generating two-qubit C-NOT, SWAP, and C-Z gates using with piecewise constant controls and stochastic optimization in the form of an adapted version of the dual annealing algorithm. In the numerical experiment, we analyze the minimal infidelity obtained by the dual annealing for various values of strength of the interaction between the system and the environment.


title: Redefining Developer Assistance: Through Large Language Models in Software Ecosystem

abstract: In this paper, we delve into the advancement of domain-specific Large Language Models (LLMs) with a focus on their application in software development. We introduce DevAssistLlama, a model developed through instruction tuning, to assist developers in processing software-related natural language queries. This model, a variant of instruction tuned LLM, is particularly adept at handling intricate technical documentation, enhancing developer capability in software specific tasks. The creation of DevAssistLlama involved constructing an extensive instruction dataset from various software systems, enabling effective handling of Named Entity Recognition (NER), Relation Extraction (RE), and Link Prediction (LP). Our results demonstrate DevAssistLlama's superior capabilities in these tasks, in comparison with other models including ChatGPT. This research not only highlights the potential of specialized LLMs in software development also the pioneer LLM for this domain.


title: Exploring the collinear Lagrangian points of exoplanet systems with P-R drag and oblateness

abstract: In this paper we study the location and stability of the collinear Lagrangian points for the RTBP for the case in which one of the primary bodies is radiating and the other is oblate. We consider the effect of Poynting-Roberson drag and investigate how the location and stability of the Lagrangian points change with changes in the radiation parameter $\beta$ and oblateness $a$. We apply our results to ten exoplanet systems -- CoRoT-2~b, TOI-1278~b, HAT-P-20~b, Kepler-75~b, WASP- 89~b, TIC 172900988~b, NGTS 9~b, LP 714 - 47~b, WASP- 162~b and XO- 3~b, data of which has been taken from NASA exoplanet archives, with the aim of finding locations in these exoplanet systems where one can detect asteroids, primodial material or seeds where planet formation can take place. We find that the location of the collinear Lagrangian points changes with variation in radiation pressure and oblateness. Further, for all the ten planetary systems, studied in this paper, the Lagrangian points are unstable and can be locations where we expect to find minor planets, asteroids or debris. The unstability of the the Lagrangian points can be a possible cause of relocation and migration of planetesimals.


title: Sharper bounds for the error in the prime number theorem assuming the Riemann Hypothesis

abstract: Assuming the Riemann Hypothesis, we combine powerful theoretical methods, computational techniques, and the latest explicit knowledge on the zeros of the Riemann zeta-function to prove $$|\psi(x) - x| \leq \frac{\sqrt{x}\log{x}(\log{x} - \log\log{x})}{8\pi}$$ for all $x\geq 401\,211\,790$, where $\psi(x)$ is the Chebyshev $\psi$-function. These bounds for the error term in the prime number theorem refine classical results from Schoenfeld. We also demonstrate how our results can be used to refine bounds for other prime counting functions, which have broad applications throughout the literature.


title: Enhancing Situational Awareness in Surveillance: Leveraging Data Visualization Techniques for Machine Learning-based Video Analytics Outcomes

abstract: The pervasive deployment of surveillance cameras produces a massive volume of data, requiring nuanced interpretation. This study thoroughly examines data representation and visualization techniques tailored for AI surveillance data within current infrastructures. It delves into essential data metrics, methods for situational awareness, and various visualization techniques, highlighting their potential to enhance safety and guide urban development. This study is built upon real-world research conducted in a community college environment, utilizing eight cameras over eight days. This study presents tools like the Occupancy Indicator, Statistical Anomaly Detection, Bird's Eye View, and Heatmaps to elucidate pedestrian behaviors, surveillance, and public safety. Given the intricate data from smart video surveillance, such as bounding boxes and segmented images, we aim to convert these computer vision results into intuitive visualizations and actionable insights for stakeholders, including law enforcement, urban planners, and social scientists. The results emphasize the crucial impact of visualizing AI surveillance data on emergency handling, public health protocols, crowd control, resource distribution, predictive modeling, city planning, and informed decision-making.


title: An empirical analysis of the determinants of network construction for Azul Airlines

abstract: This paper describes an econometric model of the Brazilian domestic carrier Azul Airlines' network construction. We employed a discrete-choice framework of airline route entry to examine the effects of the merger of another regional carrier, Trip Airlines, with Azul in 2012, especially on its entry decisions. We contrasted the estimated entry determinants before and after the merger with the benchmarks of the US carriers JetBlue Airways and Southwest Airlines obtained from the literature, and proposed a methodology for comparing different airline entry patterns by utilizing the kappa statistic for interrater agreement. Our empirical results indicate a statistically significant agreement between raters of Azul and JetBlue, but not Southwest, and only for entries on previously existing routes during the pre-merger period. The results suggest that post-merger, Azul has adopted a more idiosyncratic entry pattern, focusing on the regional flights segment to conquer many monopoly positions across the country, and strengthening its profitability without compromising its distinguished expansion pace in the industry.


title: Test Generation Strategies for Building Failure Models and Explaining Spurious Failures

abstract: Test inputs fail not only when the system under test is faulty but also when the inputs are invalid or unrealistic. Failures resulting from invalid or unrealistic test inputs are spurious. Avoiding spurious failures improves the effectiveness of testing in exercising the main functions of a system, particularly for compute-intensive (CI) systems where a single test execution takes significant time. In this paper, we propose to build failure models for inferring interpretable rules on test inputs that cause spurious failures. We examine two alternative strategies for building failure models: (1) machine learning (ML)-guided test generation and (2) surrogate-assisted test generation. ML-guided test generation infers boundary regions that separate passing and failing test inputs and samples test inputs from those regions. Surrogate-assisted test generation relies on surrogate models to predict labels for test inputs instead of exercising all the inputs. We propose a novel surrogate-assisted algorithm that uses multiple surrogate models simultaneously, and dynamically selects the prediction from the most accurate model. We empirically evaluate the accuracy of failure models inferred based on surrogate-assisted and ML-guided test generation algorithms. Using case studies from the domains of cyber-physical systems and networks, we show that our proposed surrogate-assisted approach generates failure models with an average accuracy of 83%, significantly outperforming ML-guided test generation and two baselines. Further, our approach learns failure-inducing rules that identify genuine spurious failures as validated against domain knowledge.


title: Subject-Based Domain Adaptation for Facial Expression Recognition

abstract: Adapting a deep learning model to a specific target individual is a challenging facial expression recognition (FER) task that may be achieved using unsupervised domain adaptation (UDA) methods. Although several UDA methods have been proposed to adapt deep FER models across source and target data sets, multiple subject-specific source domains are needed to accurately represent the intra- and inter-person variability in subject-based adaption. This paper considers the setting where domains correspond to individuals, not entire datasets. Unlike UDA, multi-source domain adaptation (MSDA) methods can leverage multiple source datasets to improve the accuracy and robustness of the target model. However, previous methods for MSDA adapt image classification models across datasets and do not scale well to a more significant number of source domains. This paper introduces a new MSDA method for subject-based domain adaptation in FER. It efficiently leverages information from multiple source subjects (labeled source domain data) to adapt a deep FER model to a single target individual (unlabeled target domain data). During adaptation, our subject-based MSDA first computes a between-source discrepancy loss to mitigate the domain shift among data from several source subjects. Then, a new strategy is employed to generate augmented confident pseudo-labels for the target subject, allowing a reduction in the domain shift between source and target subjects. Experiments performed on the challenging BioVid heat and pain dataset with 87 subjects and the UNBC-McMaster shoulder pain dataset with 25 subjects show that our subject-based MSDA can outperform state-of-the-art methods yet scale well to multiple subject-based source domains.


title: The New Age of Collusion? An Empirical Study into Airbnb's Pricing Dynamics and Market Behavior

abstract: This study investigates the implications of algorithmic pricing in digital marketplaces, focusing on Airbnb's pricing dynamics. With the advent of Airbnb's new pricing tool, this research explores how digital tools influence hosts' pricing strategies, potentially leading to market dynamics that straddle the line between efficiency and collusion. Utilizing a Regression Discontinuity Design (RDD) and Propensity Score Matching (PSM), the study examines the causal effects of the pricing tool on pricing behavior among hosts with different operational strategies. The findings aim to provide insights into the evolving landscape of digital economies, examining the balance between competitive market practices and the risk of tacit collusion facilitated by algorithmic pricing. This study contributes to the discourse on digital market regulation, offering a nuanced understanding of the implications of AI-driven tools in market dynamics and antitrust analysis.


title: PGDS: Pose-Guidance Deep Supervision for Mitigating Clothes-Changing in Person Re-Identification

abstract: Person Re-Identification (Re-ID) task seeks to enhance the tracking of multiple individuals by surveillance cameras. It supports multimodal tasks, including text-based person retrieval and human matching. One of the most significant challenges faced in Re-ID is clothes-changing, where the same person may appear in different outfits. While previous methods have made notable progress in maintaining clothing data consistency and handling clothing change data, they still rely excessively on clothing information, which can limit performance due to the dynamic nature of human appearances. To mitigate this challenge, we propose the Pose-Guidance Deep Supervision (PGDS), an effective framework for learning pose guidance within the Re-ID task. It consists of three modules: a human encoder, a pose encoder, and a Pose-to-Human Projection module (PHP). Our framework guides the human encoder, i.e., the main re-identification model, with pose information from the pose encoder through multiple layers via the knowledge transfer mechanism from the PHP module, helping the human encoder learn body parts information without increasing computation resources in the inference stage. Through extensive experiments, our method surpasses the performance of current state-of-the-art methods, demonstrating its robustness and effectiveness for real-world applications. Our code is available at https://github.com/huyquoctrinh/PGDS.


abstract: In this paper, we study Bohr's inequality and refined versions of Bohr-Rogosinski inequalities involving Schwarz functions. Moreover, we establish a version of multidimensional analogue of Bohr inequality and Bohr-Rogosinski inequalities involving Schwarz functions. Finally, we establish a multidimensional analogue of the refined version of Bohr inequalities with the initial coefficient being zero. All the results are proved to be sharp.


title: Pressure induced Topological Dirac semimetals in XCdP(X=Na, K)

abstract: We present a theoretical investigation on the pressure-induced emergence of Dirac semimetallic properties in the XCdP (X = Na, K) materials, employing first-principles calculations. Dirac semimetals, characterized by linear dispersion relations in their electronic band structures, have gained prominence due to their unique topological features and potential applications in electronic devices. Through systematic calculations, we explore the electronic structure evolution of NaCdP and KCdP under varying pressure conditions. Our findings reveal a compelling transition to a Dirac semimetallic state in both NaCdP and KCdP under applied pressure. The electronic band structures exhibit distinct Dirac cones at the Fermi level, indicating the presence of massless Dirac fermions. Moreover, the pressure-induced Dirac semi-metallic phase in these compounds are found to be robust, and are protected by crystal symmetry. We provide a comprehensive analysis of the bandgap, Fermi surface, and other relevant electronic properties, offering insights into the pressure-driven phase transition in NaCdP and KCdP. The tunability of these materials under external pressure suggests their potential utility in next-generation electronic devices and quantum technologies.


title: Microtube self-assembly leads to conformational freezing point depression

abstract: Concentric microtubes of $\beta$-cyclodextrin and SDS grow from the outside in and melt from the inside out, we observe using in situ small angle X-ray scattering. We find that the conformation of the crystalline bilayer affects the saturation concentration, providing an example of a phenomenon we call conformational freezing point depression. We propose a model based on freezing point depression, well known from undergraduate physics, and use it to explain the energetics of this hierarchical system, and giving access to material properties without free parameters.


title: Alignment-Free Coupling to Arrays of Diamond Microdisk Cavities for Scalable Spin-Photon Interfaces

abstract: We propose a scalable design for a spin-photon interface to a color center in a diamond microdisk. The design consists of a silicon oxynitride hexagonal lattice overlaid on a diamond microdisk to enable vertical emission from the microdisk into low-numerical aperture modes, with quantum efficiencies as high as 45\% for a tin vacancy (SnV) center. Our design is robust to manufacturing errors, potentially enabling large scale fabrication of quantum emitters coupled to optical collection modes. We also introduce a novel approach for optimizing the free space performance of a complex structure using a dipole model, achieving comparable results to full-wave finite difference time domain simulations with a 650,000 times reduction in computational time.


title: JITSPMM: Just-in-Time Instruction Generation for Accelerated Sparse Matrix-Matrix Multiplication

abstract: Achieving high performance for Sparse MatrixMatrix Multiplication (SpMM) has received increasing research attention, especially on multi-core CPUs, due to the large input data size in applications such as graph neural networks (GNNs). Most existing solutions for SpMM computation follow the aheadof-time (AOT) compilation approach, which compiles a program entirely before it is executed. AOT compilation for SpMM faces three key limitations: unnecessary memory access, additional branch overhead, and redundant instructions. These limitations stem from the fact that crucial information pertaining to SpMM is not known until runtime. In this paper, we propose JITSPMM, a just-in-time (JIT) assembly code generation framework to accelerated SpMM computation on multi-core CPUs with SIMD extensions. First, JITSPMM integrates the JIT assembly code generation technique into three widely-used workload division methods for SpMM to achieve balanced workload distribution among CPU threads. Next, with the availability of runtime information, JITSPMM employs a novel technique, coarse-grain column merging, to maximize instruction-level parallelism by unrolling the performance-critical loop. Furthermore, JITSPMM intelligently allocates registers to cache frequently accessed data to minimizing memory accesses, and employs selected SIMD instructions to enhance arithmetic throughput. We conduct a performance evaluation of JITSPMM and compare it two AOT baselines. The first involves existing SpMM implementations compiled using the Intel icc compiler with auto-vectorization. The second utilizes the highly-optimized SpMM routine provided by Intel MKL. Our results show that JITSPMM provides an average improvement of 3.8x and 1.4x, respectively.


title: Keyword spotting -- Detecting commands in speech using deep learning

abstract: Speech recognition has become an important task in the development of machine learning and artificial intelligence. In this study, we explore the important task of keyword spotting using speech recognition machine learning and deep learning techniques. We implement feature engineering by converting raw waveforms to Mel Frequency Cepstral Coefficients (MFCCs), which we use as inputs to our models. We experiment with several different algorithms such as Hidden Markov Model with Gaussian Mixture, Convolutional Neural Networks and variants of Recurrent Neural Networks including Long Short-Term Memory and the Attention mechanism. In our experiments, RNN with BiLSTM and Attention achieves the best performance with an accuracy of 93.9 %


title: Non-classical correlations between phonons and photons in a MHz-frequency mechanical oscillator coupled to an optical cavity

abstract: We demonstrate non-classical correlations between phonons and photons created using opto-mechanical spontaneous parametric down-conversion in a system based on a soft-clamped ultracoherent membrane oscillator inside of a Fabry-P\'erot optical resonator. We show that phonons stored in the mechanical oscillator, when subsequently read out, display strong signs of quantum coherence, which we demonstrate by single-photon counting enabled by our state-of-the-art optical filtering system. We observe a violation of the classical Cauchy-Schwarz inequality with a confidence of >92%. The presented system demonstrates the potential for studies of low-frequency quantum effects in sub-millimeter size nanogram-scale mechanical oscillators.


title: Speed Up Federated Learning in Heterogeneous Environment: A Dynamic Tiering Approach

abstract: Federated learning (FL) enables collaboratively training a model while keeping the training data decentralized and private. However, one significant impediment to training a model using FL, especially large models, is the resource constraints of devices with heterogeneous computation and communication capacities as well as varying task sizes. Such heterogeneity would render significant variations in the training time of clients, resulting in a longer overall training time as well as a waste of resources in faster clients. To tackle these heterogeneity issues, we propose the Dynamic Tiering-based Federated Learning (DTFL) system where slower clients dynamically offload part of the model to the server to alleviate resource constraints and speed up training. By leveraging the concept of Split Learning, DTFL offloads different portions of the global model to clients in different tiers and enables each client to update the models in parallel via local-loss-based training. This helps reduce the computation and communication demand on resource-constrained devices and thus mitigates the straggler problem. DTFL introduces a dynamic tier scheduler that uses tier profiling to estimate the expected training time of each client, based on their historical training time, communication speed, and dataset size. The dynamic tier scheduler assigns clients to suitable tiers to minimize the overall training time in each round. We first theoretically prove the convergence properties of DTFL. We then train large models (ResNet-56 and ResNet-110) on popular image datasets (CIFAR-10, CIFAR-100, CINIC-10, and HAM10000) under both IID and non-IID systems. Extensive experimental results show that compared with state-of-the-art FL methods, DTFL can significantly reduce the training time while maintaining model accuracy.


title: NiSNN-A: Non-iterative Spiking Neural Networks with Attention with Application to Motor Imagery EEG Classification

abstract: Motor imagery, an important category in electroencephalogram (EEG) research, often intersects with scenarios demanding low energy consumption, such as portable medical devices and isolated environment operations. Traditional deep learning algorithms, despite their effectiveness, are characterized by significant computational demands accompanied by high energy usage. As an alternative, spiking neural networks (SNNs), inspired by the biological functions of the brain, emerge as a promising energy-efficient solution. However, SNNs typically exhibit lower accuracy than their counterpart convolutional neural networks (CNNs). Although attention mechanisms successfully increase network accuracy by focusing on relevant features, their integration in the SNN framework remains an open question. In this work, we combine the SNN and the attention mechanisms for the EEG classification, aiming to improve precision and reduce energy consumption. To this end, we first propose a Non-iterative Leaky Integrate-and-Fire (LIF) neuron model, overcoming the gradient issues in the traditional SNNs using the Iterative LIF neurons. Then, we introduce the sequence-based attention mechanisms to refine the feature map. We evaluated the proposed Non-iterative SNN with Attention (NiSNN-A) model on OpenBMI, a large-scale motor imagery dataset. Experiment results demonstrate that 1) our model outperforms other SNN models by achieving higher accuracy, 2) our model increases energy efficiency compared to the counterpart CNN models (i.e., by 2.27 times) while maintaining comparable accuracy.