title: Towards Lifelong Scene Graph Generation with Knowledge-ware In-context Prompt Learning

abstract: Scene graph generation (SGG) endeavors to predict visual relationships between pairs of objects within an image. Prevailing SGG methods traditionally assume a one-off learning process for SGG. This conventional paradigm may necessitate repetitive training on all previously observed samples whenever new relationships emerge, mitigating the risk of forgetting previously acquired knowledge. This work seeks to address this pitfall inherent in a suite of prior relationship predictions. Motivated by the achievements of in-context learning in pretrained language models, our approach imbues the model with the capability to predict relationships and continuously acquire novel knowledge without succumbing to catastrophic forgetting. To achieve this goal, we introduce a novel and pragmatic framework for scene graph generation, namely Lifelong Scene Graph Generation (LSGG), where tasks, such as predicates, unfold in a streaming fashion. In this framework, the model is constrained to exclusive training on the present task, devoid of access to previously encountered training data, except for a limited number of exemplars, but the model is tasked with inferring all predicates it has encountered thus far. Rigorous experiments demonstrate the superiority of our proposed method over state-of-the-art SGG models in the context of LSGG across a diverse array of metrics. Besides, extensive experiments on the two mainstream benchmark datasets, VG and Open-Image(v6), show the superiority of our proposed model to a number of competitive SGG models in terms of continuous learning and conventional settings. Moreover, comprehensive ablation experiments demonstrate the effectiveness of each component in our model.


title: Simple Generating Functions for Certain Young Tableaux with Periodic Walls

abstract: Recently, Banderier et. al. considered Young tableaux with walls, which are similar to standard Young tableaux, except that local decreases are allowed at some walls. We count the numbers $\overline{f}_m(n)$ of Young tableaux of shape $2\times mn$ with walls, that allow local decreases at the $(jm+i)$-th columns for all $j=0,\dots, n-1$ and $i=2,\dots, m$. We find that they have nice generating functions (thanks to the OEIS) as follows. $$\overline{F}_m(x)=\sum_{n\geq 0}\overline{f}_m(n)x^n=\prod_{k=1}^{m}C(e^{k\frac{2\pi i}{m}} x^\frac{1}{m})=\exp \left(\sum_{n\geq 1}\binom{2mn-1}{mn-1}\frac{x^n}{n}\right),$$ where $C(x)=\frac{1-\sqrt{1-4x}}{2x}$ is the well-known Catalan generating function. We prove generalizations of this result. Firstly, we use the Yamanouchi word to transform Young tableaux with horizontal walls into lattice paths. This results in a determinant formula. Then by lattice path counting theory, we obtain the generating functions $F_r(x)$ for the number of lattice paths from $(0,0)$ to $(\ell n-r,kn)$ that never go above the path $(N^kE^{\ell})^{n-1}N^kE^{\ell-r}$, where $N,E$ stand for north and east steps, respectively. We also obtain exponential formulas for $F_1(x)$ and $F_\ell(x)$. The formula for $\overline{F}_m(x)$ is thus proved since it is just $F_1(x)$ specializes at $k=\ell=m$.


title: Inferring Data Preconditions from Deep Learning Models for Trustworthy Prediction in Deployment

abstract: Deep learning models are trained with certain assumptions about the data during the development stage and then used for prediction in the deployment stage. It is important to reason about the trustworthiness of the model's predictions with unseen data during deployment. Existing methods for specifying and verifying traditional software are insufficient for this task, as they cannot handle the complexity of DNN model architecture and expected outcomes. In this work, we propose a novel technique that uses rules derived from neural network computations to infer data preconditions for a DNN model to determine the trustworthiness of its predictions. Our approach, DeepInfer involves introducing a novel abstraction for a trained DNN model that enables weakest precondition reasoning using Dijkstra's Predicate Transformer Semantics. By deriving rules over the inductive type of neural network abstract representation, we can overcome the matrix dimensionality issues that arise from the backward non-linear computation from the output layer to the input layer. We utilize the weakest precondition computation using rules of each kind of activation function to compute layer-wise precondition from the given postcondition on the final output of a deep neural network. We extensively evaluated DeepInfer on 29 real-world DNN models using four different datasets collected from five different sources and demonstrated the utility, effectiveness, and performance improvement over closely related work. DeepInfer efficiently detects correct and incorrect predictions of high-accuracy models with high recall (0.98) and high F-1 score (0.84) and has significantly improved over prior technique, SelfChecker. The average runtime overhead of DeepInfer is low, 0.22 sec for all unseen datasets. We also compared runtime overhead using the same hardware settings and found that DeepInfer is 3.27 times faster than SelfChecker.


title: A First Look at the General Data Protection Regulation (GDPR) in Open-Source Software

abstract: This poster describes work on the General Data Protection Regulation (GDPR) in open-source software. Although open-source software is commonly integrated into regulated software, and thus must be engineered or adapted for compliance, we do not know how such laws impact open-source software development. We surveyed open-source developers (N=47) to understand their experiences and perceptions of GDPR. We learned many engineering challenges, primarily regarding the management of users' data and assessments of compliance. We call for improved policy-related resources, especially tools to support data privacy regulation implementation and compliance in open-source software.


title: An Empirical Investigation of Domain Adaptation Ability for Chinese Spelling Check Models

abstract: Chinese Spelling Check (CSC) is a meaningful task in the area of Natural Language Processing (NLP) which aims at detecting spelling errors in Chinese texts and then correcting these errors. However, CSC models are based on pretrained language models, which are trained on a general corpus. Consequently, their performance may drop when confronted with downstream tasks involving domain-specific terms. In this paper, we conduct a thorough evaluation about the domain adaption ability of various typical CSC models by building three new datasets encompassing rich domain-specific terms from the financial, medical, and legal domains. Then we conduct empirical investigations in the corresponding domain-specific test datasets to ascertain the cross-domain adaptation ability of several typical CSC models. We also test the performance of the popular large language model ChatGPT. As shown in our experiments, the performances of the CSC models drop significantly in the new domains.


title: Quantum Emitters in Aluminum Nitride Induced by Zirconium Ion Implantation

abstract: The integration of solid-state single-photon sources with foundry-compatible photonic platforms is crucial for practical and scalable quantum photonic applications. This study investigates aluminum nitride (AlN) as a material with properties highly suitable for integrated on-chip photonics specifically due to AlN capacity to host defect-center related single-photon emitters. We conduct a comprehensive study of the creation and photophysical properties of single-photon emitters in AlN utilizing Zirconium (Zr) and Krypton (Kr) heavy ion implantation and thermal annealing techniques. Guided by theoretical predictions, we assess the potential of Zr ions to create optically addressable spin-defects and employ Kr ions as an alternative approach that targets lattice defects without inducing chemical doping effects. With the 532 nm excitation wavelength, we found that single-photon emitters induced by ion implantation are primarily associated with vacancy-type defects in the AlN lattice for both Zr and Kr ions. The emitter density increases with the ion fluence, and there is an optimal value for the high density of emitters with low AlN background fluorescence. Additionally, under shorter excitation wavelength of 405 nm, Zr-implanted AlN exhibits isolated point-like emitters, which can be related to Zr-based defect complexes. This study provides important insights into the formation and properties of single-photon emitters in aluminum nitride induced by heavy ion implantation, contributing to the advancement of the aluminum nitride platform for on-chip quantum photonic applications.


title: Newton polytopes of dual $k$-Schur polynomials

abstract: Rado's theorem about permutahedra and dominance order on partitions reveals that each Schur polynomial is M-convex, or equivalently, it has a saturated Newton polytope and this polytope is a generalized permutahedron as well. In this paper we show that the support of each dual $k$-Schur polynomial indexed by a $k$-bounded partition coincides with that of the Schur polynomial indexed by the same partition, and hence the two polynomials share the same saturated Newton polytope. The main result is based on our recursive algorithm to generate a semistandard $k$-tableau for a given shape and $k$-weight. As consequences, we obtain the M-convexity of dual $k$-Schur polynomials, affine Stanley symmetric polynomials and cylindric skew Schur polynomials.


title: Semantic Arithmetic Coding using Synonymous Mappings

abstract: Recent semantic communication methods explore effective ways to expand the communication paradigm and improve the system performance of the communication systems. Nonetheless, the common problem of these methods is that the essence of semantics is not explicitly pointed out and directly utilized. A new epistemology suggests that synonymy, which is revealed as the fundamental feature of semantics, guides the establishment of the semantic information theory from a novel viewpoint. Building on this theoretical basis, this paper proposes a semantic arithmetic coding (SAC) method for semantic lossless compression using intuitive semantic synonymy. By constructing reasonable synonymous mappings and performing arithmetic coding procedures over synonymous sets, SAC can achieve higher compression efficiency for meaning-contained source sequences at the semantic level and thereby approximate the semantic entropy limits. Experimental results on edge texture map compression show an evident improvement in coding efficiency using SAC without semantic losses, compared to traditional arithmetic coding, which demonstrates its effectiveness.


title: Semantic Huffman Coding using Synonymous Mapping

abstract: Semantic communication stands out as a highly promising avenue for future developments in communications. Theoretically, source compression coding based on semantics can achieve lower rates than Shannon entropy. This paper introduces a semantic Huffman coding built upon semantic information theory. By incorporating synonymous mapping and synonymous sets, semantic Huffman coding can achieve shorter average code lengths. Furthermore, we demonstrate that semantic Huffman coding theoretically have the capability to approximate semantic entropy. Experimental results indicate that, under the condition of semantic lossless, semantic Huffman coding exhibits clear advantages in compression efficiency over classical Huffman coding.


title: Signing in Four Public Software Package Registries: Quantity, Quality, and Influencing Factors

abstract: Many software applications incorporate open-source third-party packages distributed by public package registries. Guaranteeing authorship along this supply chain is a challenge. Package maintainers can guarantee package authorship through software signing. However, it is unclear how common this practice is, and whether the resulting signatures are created properly. Prior work has provided raw data on registry signing practices, but only measured single platforms, did not consider quality, did not consider time, and did not assess factors that may influence signing. We do not have up-to-date measurements of signing practices nor do we know the quality of existing signatures. Furthermore, we lack a comprehensive understanding of factors that influence signing adoption. This study addresses this gap. We provide measurements across three kinds of package registries: traditional software (Maven, PyPI), container images (DockerHub), and machine learning models (Hugging Face). For each registry, we describe the nature of the signed artifacts as well as the current quantity and quality of signatures. Then, we examine longitudinal trends in signing practices. Finally, we use a quasi-experiment to estimate the effect that various factors had on software signing practices. To summarize our findings: (1) mandating signature adoption improves the quantity of signatures; (2) providing dedicated tooling improves the quality of signing; (3) getting started is the hard part -- once a maintainer begins to sign, they tend to continue doing so; and (4) although many supply chain attacks are mitigable via signing, signing adoption is primarily affected by registry policy rather than by public knowledge of attacks, new engineering standards, etc. These findings highlight the importance of software package registry managers and signing infrastructure.


title: Efficient Constraint Generation for Stochastic Shortest Path Problems

abstract: Current methods for solving Stochastic Shortest Path Problems (SSPs) find states' costs-to-go by applying Bellman backups, where state-of-the-art methods employ heuristics to select states to back up and prune. A fundamental limitation of these algorithms is their need to compute the cost-to-go for every applicable action during each state backup, leading to unnecessary computation for actions identified as sub-optimal. We present new connections between planning and operations research and, using this framework, we address this issue of unnecessary computation by introducing an efficient version of constraint generation for SSPs. This technique allows algorithms to ignore sub-optimal actions and avoid computing their costs-to-go. We also apply our novel technique to iLAO* resulting in a new algorithm, CG-iLAO*. Our experiments show that CG-iLAO* ignores up to 57% of iLAO*'s actions and it solves problems up to 8x and 3x faster than LRTDP and iLAO*.


title: T-Rex: Text-assisted Retrosynthesis Prediction

abstract: As a fundamental task in computational chemistry, retrosynthesis prediction aims to identify a set of reactants to synthesize a target molecule. Existing template-free approaches only consider the graph structures of the target molecule, which often cannot generalize well to rare reaction types and large molecules. Here, we propose T-Rex, a text-assisted retrosynthesis prediction approach that exploits pre-trained text language models, such as ChatGPT, to assist the generation of reactants. T-Rex first exploits ChatGPT to generate a description for the target molecule and rank candidate reaction centers based both the description and the molecular graph. It then re-ranks these candidates by querying the descriptions for each reactants and examines which group of reactants can best synthesize the target molecule. We observed that T-Rex substantially outperformed graph-based state-of-the-art approaches on two datasets, indicating the effectiveness of considering text information. We further found that T-Rex outperformed the variant that only use ChatGPT-based description without the re-ranking step, demonstrate how our framework outperformed a straightforward integration of ChatGPT and graph information. Collectively, we show that text generated by pre-trained language models can substantially improve retrosynthesis prediction, opening up new avenues for exploiting ChatGPT to advance computational chemistry. And the codes can be found at https://github.com/lauyikfung/T-Rex.


title: A Visual Approach to the Regularity Theory for Fully Nonlinear Elliptic Equations

abstract: In this set of notes we revisit the regularity theory for uniformly elliptic equations without divergence structure.


title: Constructing many-twist M\"obius bands with small aspect ratios

abstract: This paper presents a construction of a folded paper ribbon knot that provides a constant upper bound on the infimal aspect ratio for paper M\"obius bands and annuli with arbitrarily many half-twists. In particular, the construction shows that paper M\"obius bands and annuli with any number of half-twists can be embedded with aspect ratio less than 8.


title: Benchmarking Large Language Models in Complex Question Answering Attribution using Knowledge Graphs

abstract: The attribution of question answering is to provide citations for supporting generated statements, and has attracted wide research attention. The current methods for automatically evaluating the attribution, which are often based on Large Language Models (LLMs), are still inadequate, particularly in recognizing subtle differences between attributions, and complex relationships between citations and statements. To compare these attribution evaluation methods and develop new ones, we introduce a set of fine-grained categories (i.e., supportive, insufficient, contradictory and irrelevant) for measuring the attribution, and develop a Complex Attributed Question Answering (CAQA) benchmark by leveraging knowledge graphs (KGs) for automatically generating attributions of different categories to question-answer pairs. Our analysis reveals that existing evaluators perform poorly under fine-grained attribution settings and exhibit weaknesses in complex citation-statement reasoning. Our CAQA benchmark, validated with human annotations, emerges as a promising tool for selecting and developing LLM attribution evaluators.


title: Super Efficient Neural Network for Compression Artifacts Reduction and Super Resolution

abstract: Video quality can suffer from limited internet speed while being streamed by users. Compression artifacts start to appear when the bitrate decreases to match the available bandwidth. Existing algorithms either focus on removing the compression artifacts at the same video resolution, or on upscaling the video resolution but not removing the artifacts. Super resolution-only approaches will amplify the artifacts along with the details by default. We propose a lightweight convolutional neural network (CNN)-based algorithm which simultaneously performs artifacts reduction and super resolution (ARSR) by enhancing the feature extraction layers and designing a custom training dataset. The output of this neural network is evaluated for test streams compressed at low bitrates using variable bitrate (VBR) encoding. The output video quality shows a 4-6 increase in video multi-method assessment fusion (VMAF) score compared to traditional interpolation upscaling approaches such as Lanczos or Bicubic.


title: Inertial manifolds for the two-dimensional hyperviscous Navier-Stokes equations

abstract: This study establishes the existence of inertial manifolds for the hyperviscous Navier-Stokes equations (HNSE) on a 2D periodic domain: \begin{equation*} \partial_t u+ \nu(-\Delta) ^{\beta}u+(u\cdot \nabla )u+\nabla p=f, \;\; \text{on} \;\; \mathbb{T}^2, \end{equation*} with $\nabla \cdot u=0$, for any $\beta > \frac{17}{12} $. The exponent $\beta = \frac{3}{2}$ is identified as the "critical" value for the inertial manifold problem in 2D HNSE, below which the spectral gap condition is not satisfied. A breakthrough in this work is that it extends the theory to "supercritical" regimes where $\beta < \frac{3}{2}$. An important aspect of our argument involves a refined analysis on the sparse distribution of lattice points in annular regions.


title: Deficit Angles in 4D Spinfoam with Cosmological Constant: (Anti) de Sitter-ness and More

abstract: This paper investigates the critical behaviors of the 4-dimensional spinfoam model with cosmological constant for a general 4-dimensional simplicial complex as the discretization of spacetime. We find that, at the semi-classical regime, the spinfoam amplitude is peaked at the real critical points that correspond to zero deficit angles (modulo $4\pi\mathbb{Z}/\gamma$) hinged by internal triangles of the 4-complex. Since the 4-simplices from the model are of constant curvature, the discrete geometry with zero deficit angle manifests a de Sitter (dS) spacetime or an anti de Sitter (AdS) spacetime depending on the sign of the cosmological constant fixed by the boundary condition. The non-(A)dS spacetimes emerge from the complex critical points by an analytic continuation to complex configurations.


title: Burt-Butler algebras of the bocs associated to a finite partially ordered set

abstract: Given an algebra $A$ and an $A-A$-bimodule $U$ with co-algebra structure, a bocs, the algebras of endomorphisms of $A$ as left or right module of the bocs are known as Burt-Butler algebras (up to an appropriate opposite). Here we give a description of these algebras for the bocs associated to a finite partially ordered set in terms of incidence algebras and their balanced versions. We also exhibit their quasi-hereditary structure, provide bound quiver presentations for their Ringel duals, describe the embedding of $A$ as exact Borel subalgebra and characterize the corresponding subcategories of induced and co-induced modules.


title: Omnipredictors for Regression and the Approximate Rank of Convex Functions

abstract: Consider the supervised learning setting where the goal is to learn to predict labels $\mathbf y$ given points $\mathbf x$ from a distribution. An \textit{omnipredictor} for a class $\mathcal L$ of loss functions and a class $\mathcal C$ of hypotheses is a predictor whose predictions incur less expected loss than the best hypothesis in $\mathcal C$ for every loss in $\mathcal L$. Since the work of [GKR+21] that introduced the notion, there has been a large body of work in the setting of binary labels where $\mathbf y \in \{0, 1\}$, but much less is known about the regression setting where $\mathbf y \in [0,1]$ can be continuous. Our main conceptual contribution is the notion of \textit{sufficient statistics} for loss minimization over a family of loss functions: these are a set of statistics about a distribution such that knowing them allows one to take actions that minimize the expected loss for any loss in the family. The notion of sufficient statistics relates directly to the approximate rank of the family of loss functions. Our key technical contribution is a bound of $O(1/\varepsilon^{2/3})$ on the $\epsilon$-approximate rank of convex, Lipschitz functions on the interval $[0,1]$, which we show is tight up to a factor of $\mathrm{polylog} (1/\epsilon)$. This yields improved runtimes for learning omnipredictors for the class of all convex, Lipschitz loss functions under weak learnability assumptions about the class $\mathcal C$. We also give efficient omnipredictors when the loss families have low-degree polynomial approximations, or arise from generalized linear models (GLMs). This translation from sufficient statistics to faster omnipredictors is made possible by lifting the technique of loss outcome indistinguishability introduced by [GKH+23] for Boolean labels to the regression setting.


title: Strongly interacting matter in a sphere at nonzero magnetic field

abstract: We investigate the chiral phase transition within a sphere under a uniform background magnetic field. The Nambu--Jona-Lasinio (NJL) model is employed and the MIT boundary condition is imposed for the spherical confinement. Using the wave expansion method, the diagonalizable Hamiltonian and energy spectrum are derived for the system. By solving the gap equation in the NJL model, the influence of magnetic field on quark matter in a sphere is studied. It is found that inverse magnetic catalysis occurs at small radii, while magnetic catalysis occurs at large radii. Additionally, both magnetic catalysis and inverse magnetic catalysis are observed at the intermediate radii ($R\approx4$ fm).


title: Uniform Moment Bounds for Generalized Jackson Networks in Multi-scale Heavy Traffic

abstract: We establish uniform moment bounds for steady-state queue lengths of generalized Jackson networks (GJNs) in multi-scale heavy traffic as recently proposed by Dai et al. [2023]. Uniform moment bounds lay the foundation for further analysis of the limit stationary distribution. Our result can be used to verify the crucial moment state space collapse (SSC) assumption in Dai et al. [2023] to establish a product-form limit of GJN in the multi-scale heavy traffic regime. Our proof critically utilizes the Palm version of the basic adjoint relationship (BAR) as developed in Braverman et al. [2023].


title: A Solomon Mackey formula for graded bialgebras

abstract: Given a graded bialgebra $H$, we let $\Delta^{\left[ k\right] }:H\rightarrow H^{\otimes k}$ and $m^{\left[ k\right] }:H^{\otimes k}\rightarrow H$ be its iterated (co)multiplications for all $k\in\mathbb{N}$. For any $k$-tuple $\alpha=\left( \alpha_{1},\alpha_{2},\ldots,\alpha_{k}\right) \in\mathbb{N}^{k}$ of nonnegative integers, and any permutation $\sigma$ of $\left\{ 1,2,\ldots,k\right\} $, we consider the map $p_{\alpha,\sigma}:=m^{\left[ k\right] }\circ P_{\alpha}\circ\sigma^{-1}\circ\Delta^{\left[ k\right] }:H\rightarrow H$, where $P_{\alpha}$ denotes the projection of $H^{\otimes k}$ onto its multigraded component $H_{\alpha_{1}}\otimes H_{\alpha_{2}}\otimes\cdots\otimes H_{\alpha_{k}}$, and where $\sigma^{-1}:H\rightarrow H$ permutes the tensor factors. We prove formulas for the composition $p_{\alpha,\sigma}\circ p_{\beta,\tau}$ and the convolution $p_{\alpha,\sigma}\star p_{\beta,\tau}$ of two such maps. When $H$ is cocommutative, these generalize Patras's 1994 results (which, in turn, generalize Solomon's Mackey formula). We also construct a combinatorial Hopf algebra $\operatorname*{PNSym}$ ("permuted noncommutative symmetric functions") that governs the maps $p_{\alpha,\sigma}$ for arbitrary connected graded bialgebras $H$ in the same way as the well-known $\operatorname*{NSym}$ governs them in the cocommutative case. We end by outlining an application to checking identities for connected graded Hopf algebras.


title: Role of Coulomb interaction in elastic pion-proton scattering from holography

abstract: Differential cross sections of the elastic pion-proton scattering are investigated at very small momentum transfer in a holographic QCD model, considering both the strong and Coulomb interaction in the Regge regime. The strong interaction is described by the Pomeron and Reggeon exchange, and the Coulomb interaction is characterized by the one photon exchange. The two interactions are linked through an interference term and we only need to determine a single adjustable parameter involved in this term. As to the parameters for the strong interaction, we can utilize the values determined in the previous studies. The differential cross sections can be predicted without any additional parameters, and it is shown that our predictions are consistent with the experimental data. We explicitly show the momentum transfer dependence for the interference effect. The energy dependence of the contribution ratios for each component is also discussed.


title: Diffuse Light in Milky-Way like Haloes

abstract: We investigate the diffuse light (DL) content of dark matter haloes in the mass range $11.5\leq \log M_{halo}\leq13$, a range that includes also the dark matter halo of the Milky-Way, taking advantage of a state-of-the-art semi-analytic model run on the merger trees extracted from a set of high-resolution cosmological simulations. The fraction of DL in such relatively small haloes is found to progressively decrease from the high to the low mass end, in good agreement with analytic (\citealt{purcell2007}) and numerical results from simulations (\citealt{proctor2023,ahvazi2023}), in good agreement also with the fraction of the DL observed in the Milky-Way (\citealt{deason2019}) and M31 (\citealt{harmsen2017}). Haloes with different masses have a different efficiency in producing DL: $\log M_{halo} \simeq 13$ is found to be the characteristic halo mass where the production of DL is the most efficient, while the overall efficiency decreases at both larger (\citealt{contini2024}) and smaller scales (this work). The DL content in this range of halo mass is the result of stellar stripping due to tidal interaction between satellites and its host (95\%) and mergers between satellites and the central galaxy (5\%), with pre-processed material, sub-channel of mergers and stripping and so already included in the 100\%, that contributes no more than 8\% on average. The halo concentration is the main driver of the DL formation: more concentrated haloes have higher DL fractions that come from stripping of more massive satellites in the high halo mass end, while dwarfs contribute mostly in the low halo mass end.


title: Nonlocal Models in Biology and Life Sciences: Sources, Developments, and Applications

abstract: Nonlocality is important in realistic mathematical models of physical and biological systems at small-length scales. It characterizes the properties of two individuals located in different locations. This review illustrates different nonlocal mathematical models applied to biology and life sciences. The major focus has been given to sources, developments, and applications of such models. Among other things, a systematic discussion has been provided for the conditions of pattern formations in biological systems of population dynamics. Special attention has also been given to nonlocal interactions on networks, network coupling and integration, including models for brain dynamics that provide us with an important tool to better understand neurodegenerative diseases. In addition, we have discussed nonlocal modelling approaches for cancer stem cells and tumor cells that are widely applied in the cell migration processes, growth, and avascular tumors in any organ. Furthermore, the discussed nonlocal continuum models can go sufficiently smaller scales applied to nanotechnology to build biosensors to sense biomaterial and its concentration. Piezoelectric and other smart materials are among them, and these devices are becoming increasingly important in the digital and physical world that is intrinsically interconnected with biological systems. Additionally, we have reviewed a nonlocal theory of peridynamics, which deals with continuous and discrete media and applies to model the relationship between fracture and healing in cortical bone, tissue growth and shrinkage, and other areas increasingly important in biomedical and bioengineering applications. Finally, we provided a comprehensive summary of emerging trends and highlighted future directions in this rapidly expanding field.


title: LitE-SNN: Designing Lightweight and Efficient Spiking Neural Network through Spatial-Temporal Compressive Network Search and Joint Optimization

abstract: Spiking Neural Networks (SNNs) mimic the information-processing mechanisms of the human brain and are highly energy-efficient, making them well-suited for low-power edge devices. However, the pursuit of accuracy in current studies leads to large, long-timestep SNNs, conflicting with the resource constraints of these devices. In order to design lightweight and efficient SNNs, we propose a new approach named LitE-SNN that incorporates both spatial and temporal compression into the automated network design process. Spatially, we present a novel Compressive Convolution block (CompConv) to expand the search space to support pruning and mixed-precision quantization. Temporally, we are the first to propose a compressive timestep search to identify the optimal number of timesteps under specific computation cost constraints. Finally, we formulate a joint optimization to simultaneously learn the architecture parameters and spatial-temporal compression strategies to achieve high performance while minimizing memory and computation costs. Experimental results on CIFAR-10, CIFAR-100, and Google Speech Command datasets demonstrate our proposed LitE-SNNs can achieve competitive or even higher accuracy with remarkably smaller model sizes and fewer computation costs.


title: Complete characterization of graphs with local total antimagic chromatic number 3

abstract: A total labeling of a graph $G = (V, E)$ is said to be local total antimagic if it is a bijection $f: V\cup E \to\{1,\ldots ,|V|+|E|\}$ such that adjacent vertices, adjacent edges, and incident vertex and edge have distinct induced weights where the induced weight of a vertex $v$, $w_f(v) = \sum f(e)$ with $e$ ranging over all the edges incident to $v$, and the induced weight of an edge $uv$ is $w_f(uv) = f(u) + f(v)$. The local total antimagic chromatic number of $G$, denoted by $\chi_{lt}(G)$, is the minimum number of distinct induced vertex and edge weights over all local total antimagic labelings of $G$. In this paper, we first obtained general lower and upper bounds for $\chi_{lt}(G)$ and sufficient conditions to construct a graph $H$ with $k$ pendant edges and $\chi_{lt}(H) \in\{\Delta(H)+1, k+1\}$. We then completely characterized graphs $G$ with $\chi_{lt}(G)=3$. Many families of (disconnected) graphs $H$ with $k$ pendant edges and $\chi_{lt}(H) \in\{\Delta(H)+1, k+1\}$ are also obtained.


title: A Korean Legal Judgment Prediction Dataset for Insurance Disputes

abstract: This paper introduces a Korean legal judgment prediction (LJP) dataset for insurance disputes. Successful LJP models on insurance disputes can benefit insurance companies and their customers. It can save both sides' time and money by allowing them to predict how the result would come out if they proceed to the dispute mediation process. As is often the case with low-resource languages, there is a limitation on the amount of data available for this specific task. To mitigate this issue, we investigate how one can achieve a good performance despite the limitation in data. In our experiment, we demonstrate that Sentence Transformer Fine-tuning (SetFit, Tunstall et al., 2022) is a good alternative to standard fine-tuning when training data are limited. The models fine-tuned with the SetFit approach on our data show similar performance to the Korean LJP benchmark models (Hwang et al., 2022) despite the much smaller data size.


title: Distributionally Robust Optimization and Robust Statistics

abstract: We review distributionally robust optimization (DRO), a principled approach for constructing statistical estimators that hedge against the impact of deviations in the expected loss between the training and deployment environments. Many well-known estimators in statistics and machine learning (e.g. AdaBoost, LASSO, ridge regression, dropout training, etc.) are distributionally robust in a precise sense. We hope that by discussing the DRO interpretation of well-known estimators, statisticians who may not be too familiar with DRO may find a way to access the DRO literature through the bridge between classical results and their DRO equivalent formulation. On the other hand, the topic of robustness in statistics has a rich tradition associated with removing the impact of contamination. Thus, another objective of this paper is to clarify the difference between DRO and classical statistical robustness. As we will see, these are two fundamentally different philosophies leading to completely different types of estimators. In DRO, the statistician hedges against an environment shift that occurs after the decision is made; thus DRO estimators tend to be pessimistic in an adversarial setting, leading to a min-max type formulation. In classical robust statistics, the statistician seeks to correct contamination that occurred before a decision is made; thus robust statistical estimators tend to be optimistic leading to a min-min type formulation.


title: Scientific Large Language Models: A Survey on Biological & Chemical Domains

abstract: Large Language Models (LLMs) have emerged as a transformative power in enhancing natural language comprehension, representing a significant stride toward artificial general intelligence. The application of LLMs extends beyond conventional linguistic boundaries, encompassing specialized linguistic systems developed within various scientific disciplines. This growing interest has led to the advent of scientific LLMs, a novel subclass specifically engineered for facilitating scientific discovery. As a burgeoning area in the community of AI for Science, scientific LLMs warrant comprehensive exploration. However, a systematic and up-to-date survey introducing them is currently lacking. In this paper, we endeavor to methodically delineate the concept of "scientific language", whilst providing a thorough review of the latest advancements in scientific LLMs. Given the expansive realm of scientific disciplines, our analysis adopts a focused lens, concentrating on the biological and chemical domains. This includes an in-depth examination of LLMs for textual knowledge, small molecules, macromolecular proteins, genomic sequences, and their combinations, analyzing them in terms of model architectures, capabilities, datasets, and evaluation. Finally, we critically examine the prevailing challenges and point out promising research directions along with the advances of LLMs. By offering a comprehensive overview of technical developments in this field, this survey aspires to be an invaluable resource for researchers navigating the intricate landscape of scientific LLMs.


title: Validating Climate Models with Spherical Convolutional Wasserstein Distance

abstract: The validation of global climate models is crucial to ensure the accuracy and efficacy of model output. We introduce the spherical convolutional Wasserstein distance to more comprehensively measure differences between climate models and reanalysis data. This new similarity measure accounts for spatial variability using convolutional projections and quantifies local differences in the distribution of climate variables. We apply this method to evaluate the historical model outputs of the Coupled Model Intercomparison Project (CMIP) members by comparing them to observational and reanalysis data products. Additionally, we investigate the progression from CMIP phase 5 to phase 6 and find modest improvements in the phase 6 models regarding their ability to produce realistic climatologies.


title: On the Scarcity of Dense Cores ($n>10^{5}$ cm$^{-3}$) in High Latitude Planck Galactic Cold Clumps

abstract: High-latitude ($|b|>30^{\circ}$) molecular clouds have virial parameters that exceed 1, but whether these clouds can form stars has not been studied systematically. Using JCMT SCUBA-2 archival data, we surveyed 70 fields that target high-latitude Planck galactic cold clumps (HLPCs) to find dense cores with density of $10^{5}$-$10^{6}$ cm$^{-3}$ and size of $<0.1$ pc. The sample benefits from both the representativeness of the parent sample and covering densest clumps at the high column density end ($>1\times10^{21}$ cm$^{-2}$). At an average noise rms of 15 mJy/beam, we detected Galactic dense cores in only one field, G6.04+36.77 (L183), while also identifying 12 extragalactic objects and two young stellar objects. Compared to the low-latitude clumps, dense cores are scarce in HLPCs. With synthetic observations, the densities of cores are constrained to be $n_c\lesssim10^5$ cm$^{-3}$, should they exist in HLPCs. Low-latitude clumps, Taurus clumps, and HLPCs form a sequence where a higher virial parameter corresponds to a lower dense core detection rate. If HLPCs were affected by the Local Bubble, the scarcity should favor turbulence-inhibited rather than supernova-driven star formation. Studies of the formation mechanism of the L183 molecular cloud are warranted.


title: The 2D Muskat Problem I: Local Regularity on the Half-plane, Plane, and Strips

abstract: We obtain local well-posedness for the Muskat problem on the half-plane, which models motion of an interface between two fluids of distinct densities (e.g., oil and water) in a porous medium (e.g., an aquifer) that sits atop an impermeable layer (e.g., bedrock). Our result allows for the interface to touch the bottom, and hence applies to the important scenario of the heavier fluid invading a region occupied by the lighter fluid along the impermeable layer. We use this result in the companion paper [24] to prove existence of finite time stable regime singularities in this model, including for arbitrarily small initial data. We do not require the interface and its derivatives to vanish at $\pm\infty$ or be periodic, and even allow it to be $O(|x|^{1-})$, which is an optimal bound on the power of growth. We also extend our results to the cases of the Muskat problem on the whole plane and on horizontal strips, where all previous works did impose such limiting requirements.


title: The 2D Muskat Problem II: Stable Regime Small Data Singularity on the Half-plane

abstract: We study the Muskat problem on the half-plane, which models motion of an interface between two fluids of distinct densities (e.g., oil and water) in a porous medium (e.g., an aquifer) that sits atop an impermeable layer (e.g., bedrock). We show that unlike on the whole plane, finite time stable regime singularities do arise in this setting, including from arbitrarily small smooth initial data. To obtain this result, we establish maximum principles for both the $L^2$ norm and the slope of solutions in this model, as well as develop a general local well-posedness theory in the companion paper [21].


title: From Blurry to Brilliant Detection: YOLOv5-Based Aerial Object Detection with Super Resolution

abstract: The demand for accurate object detection in aerial imagery has surged with the widespread use of drones and satellite technology. Traditional object detection models, trained on datasets biased towards large objects, struggle to perform optimally in aerial scenarios where small, densely clustered objects are prevalent. To address this challenge, we present an innovative approach that combines super-resolution and an adapted lightweight YOLOv5 architecture. We employ a range of datasets, including VisDrone-2023, SeaDroneSee, VEDAI, and NWPU VHR-10, to evaluate our model's performance. Our Super Resolved YOLOv5 architecture features Transformer encoder blocks, allowing the model to capture global context and context information, leading to improved detection results, especially in high-density, occluded conditions. This lightweight model not only delivers improved accuracy but also ensures efficient resource utilization, making it well-suited for real-time applications. Our experimental results demonstrate the model's superior performance in detecting small and densely clustered objects, underlining the significance of dataset choice and architectural adaptation for this specific task. In particular, the method achieves 52.5% mAP on VisDrone, exceeding top prior works. This approach promises to significantly advance object detection in aerial imagery, contributing to more accurate and reliable results in a variety of real-world applications.


title: Liouville Irregular States of Half-Integer Ranks

abstract: We conjecture a set of differential equations that characterizes the Liouville irregular states of half-integer ranks, which extends the generalized AGT correspondence to all the $(A_1,A_\text{even})$ and $(A_1,D_\text{odd})$ types Argyres-Douglas theories. For lower half-integer ranks, our conjecture is verified by deriving it as a suitable limit of a similar set of differential equations for integer ranks. This limit is interpreted as the 2D counterpart of a 4D RG-flow from $(A_1,D_{2n})$ to $(A_1,D_{2n-1})$. For rank $3/2$, we solve the conjectured differential equations and find a power series expression for the irregular state $|I^{(3/2)}\rangle$. For rank $5/2$, our conjecture is consistent with the differential equations recently discovered by H. Poghosyan and R. Poghossian.


title: Two classes of LCD BCH codes over finite fields

abstract: BCH codes form an important subclass of cyclic codes, and are widely used in compact discs, digital audio tapes and other data storage systems to improve data reliability. As far as we know, there are few results on $q$-ary BCH codes of length $n=\frac{q^{m}+1}{q+1}$. This is because it is harder to deal with BCH codes of such length. In this paper, we study $q$-ary BCH codes with lengths $n=\frac{q^{m}+1}{q+1}$ and $n=q^m+1$. These two classes of BCH codes are always LCD codes. For $n=\frac{q^{m}+1}{q+1}$, the dimensions of narrow-sense BCH codes of length $n$ with designed distance $\delta=\ell q^{\frac{m-1}{2}}+1$ are determined, where $q>2$ and $2\leq \ell \leq q-1$. Moreover, the largest coset leader is given for $m=3$ and the first two largest coset leaders are given for $q=2$. The parameters of BCH codes related to the first few largest coset leaders are investigated. Some binary BCH codes of length $n=\frac{2^m+1}{3}$ have optimal parameters. For ternary narrow-sense BCH codes of length $n=3^m+1$, a lower bound on the minimum distance of their dual codes is developed, which is good in some cases.


title: UNIT-DSR: Dysarthric Speech Reconstruction System Using Speech Unit Normalization

abstract: Dysarthric speech reconstruction (DSR) systems aim to automatically convert dysarthric speech into normal-sounding speech. The technology eases communication with speakers affected by the neuromotor disorder and enhances their social inclusion. NED-based (Neural Encoder-Decoder) systems have significantly improved the intelligibility of the reconstructed speech as compared with GAN-based (Generative Adversarial Network) approaches, but the approach is still limited by training inefficiency caused by the cascaded pipeline and auxiliary tasks of the content encoder, which may in turn affect the quality of reconstruction. Inspired by self-supervised speech representation learning and discrete speech units, we propose a Unit-DSR system, which harnesses the powerful domain-adaptation capacity of HuBERT for training efficiency improvement and utilizes speech units to constrain the dysarthric content restoration in a discrete linguistic space. Compared with NED approaches, the Unit-DSR system only consists of a speech unit normalizer and a Unit HiFi-GAN vocoder, which is considerably simpler without cascaded sub-modules or auxiliary tasks. Results on the UASpeech corpus indicate that Unit-DSR outperforms competitive baselines in terms of content restoration, reaching a 28.2% relative average word error rate reduction when compared to original dysarthric speech, and shows robustness against speed perturbation and noise.


title: PepGB: Facilitating peptide drug discovery via graph neural networks

abstract: Peptides offer great biomedical potential and serve as promising drug candidates. Currently, the majority of approved peptide drugs are directly derived from well-explored natural human peptides. It is quite necessary to utilize advanced deep learning techniques to identify novel peptide drugs in the vast, unexplored biochemical space. Despite various in silico methods having been developed to accelerate peptide early drug discovery, existing models face challenges of overfitting and lacking generalizability due to the limited size, imbalanced distribution and inconsistent quality of experimental data. In this study, we propose PepGB, a deep learning framework to facilitate peptide early drug discovery by predicting peptide-protein interactions (PepPIs). Employing graph neural networks, PepGB incorporates a fine-grained perturbation module and a dual-view objective with contrastive learning-based peptide pre-trained representation to predict PepPIs. Through rigorous evaluations, we demonstrated that PepGB greatly outperforms baselines and can accurately identify PepPIs for novel targets and peptide hits, thereby contributing to the target identification and hit discovery processes. Next, we derive an extended version, diPepGB, to tackle the bottleneck of modeling highly imbalanced data prevalent in lead generation and optimization processes. Utilizing directed edges to represent relative binding strength between two peptide nodes, diPepGB achieves superior performance in real-world assays. In summary, our proposed frameworks can serve as potent tools to facilitate peptide early drug discovery.


title: Joint Transmitter Design for Robust Secure Radar-Communication Coexistence Systems

abstract: This paper investigates the spectrum sharing between a multiple-input single-output (MISO) secure communication system and a multiple-input multiple-output (MIMO) radar system in the presence of one suspicious eavesdropper. We jointly design the radar waveform and communication beamforming vector at the two systems, such that the interference between the base station (BS) and radar is reduced, and the detrimental radar interference to the communication system is enhanced to jam the eavesdropper, thereby increasing secure information transmission performance. In particular, by considering the imperfect channel state information (CSI) for the user and eavesdropper, we maximize the worst-case secrecy rate at the user, while ensuring the detection performance of radar system. To tackle this challenging problem, we propose a two-layer robust cooperative algorithm based on the S-lemma and semidefinite relaxation techniques. Simulation results demonstrate that the proposed algorithm achieves significant secrecy rate gains over the non-robust scheme. Furthermore, we illustrate the trade-off between secrecy rate and detection probability.


title: On the modulus of continuity of fractional Orlicz-Sobolev functions

abstract: Necessary and sufficient conditions are presented for a fractional Orlicz-Sobolev space on $\rn$ to be continuously embedded into a space of uniformly continuous functions. The optimal modulus of continuity is exhibited whenever these conditions are fulfilled. These results pertain to the supercritical Sobolev regime and complement earlier sharp embeddings into rearrangement-invariant spaces concerning the subcritical setting. Classical embeddings for fractional Sobolev spaces into H\"older spaces are recovered as special instances. Proofs require novel strategies, since customary methods fail to produce optimal conclusions.


title: An area-bounce exchanging bijection on a large subset of Dyck paths

abstract: It is a longstanding open problem to find a bijection exchanging area and bounce statistics on Dyck paths. We settle this problem for an exponentially large subset of Dyck paths via an explicit bijection. Moreover, we prove that this bijection is natural by showing that it maps what we call bounce-minimal paths to area-minimal paths. As a consequence of the proof ideas, we show combinatorially that a path with area $a$ and bounce $b$ exists if and only if a path with area $b$ and bounce $a$ exists. We finally show that the number of distinct values of the sum of the area and bounce statistics is the number of nonzero coefficients in Johnson's $q$-Bell polynomial.


title: Hidden Markov Models and the Bayes Filter in Categorical Probability

abstract: We use Markov categories to develop generalizations of the theory of Markov chains and hidden Markov models in an abstract setting. This comprises characterizations of hidden Markov models in terms of local and global conditional independences as well as existing algorithms for Bayesian filtering and smoothing applicable in all Markov categories with conditionals. We show that these algorithms specialize to existing ones such as the Kalman filter, forward-backward algorithm, and the Rauch-Tung-Striebel smoother when instantiated in appropriate Markov categories. Under slightly stronger assumptions, we also prove that the sequence of outputs of the Bayes filter is itself a Markov chain with a concrete formula for its transition maps. There are two main features of this categorical framework. The first is its generality, as it can be used in any Markov category with conditionals. In particular, it provides a systematic unified account of hidden Markov models and algorithms for filtering and smoothing in discrete probability, Gaussian probability, measure-theoretic probability, possibilistic nondeterminism and others at the same time. The second feature is the intuitive visual representation of information flow in these algorithms in terms of string diagrams.


title: Sparse sampling recovery in integral norms on some function classes

abstract: This paper is a direct followup of the recent author's paper. In this paper we continue to analyze approximation and recovery properties with respect to systems satisfying universal sampling discretization property and a special unconditionality property. In addition we assume that the subspace spanned by our system satisfies some Nikol'skii-type inequalities. We concentrate on recovery with the error measured in the $L_p$ norm for $2\le p<\infty$. We apply a powerful nonlinear approximation method -- the Weak Orthogonal Matching Pursuit (WOMP) also known under the name Weak Orthogonal Greedy Algorithm (WOGA). We establish that the WOMP based on good points for the $L_2$-universal discretization provides good recovery in the $L_p$ norm for $2\le p<\infty$. For our recovery algorithms we obtain both the Lebesgue-type inequalities for individual functions and the error bounds for special classes of multivariate functions. We combine here two deep and powerful techniques -- Lebesgue-type inequalities for the WOMP and theory of the universal sampling dicretization -- in order to obtain new results in sampling recovery.


title: The dual codes of two classes of LCD BCH codes

abstract: Cyclic BCH codes and negacyclic BCH codes form important subclasses of cyclic codes and negacyclic codes, respectively, and can produce optimal linear codes in many cases. To the best of our knowledge, there are few results on the dual codes of cyclic and negacyclic BCH codes. In this paper, we study the dual codes of narrow-sense cyclic BCH codes of length $q^m+1$ over a finite field $\mathbb{F}_q$, where $q$ is an odd prime power, and the dual codes of narrow-sense negacyclic BCH codes of length $\frac{q^{m}+1}{2}$ over $\mathbb{F}_q$, where $q$ is an odd prime power satisfying $q\equiv 3~({\rm mod}~4)$. Some lower bounds on the minimum distances of the dual codes are established, which are very close to the true minimum distances of the dual codes in many cases. Sufficient and necessary conditions for the even-like subcodes of narrow-sense cyclic BCH codes of length $q^{m}+1$ being cyclic dually-BCH codes are given in terms of designed distances, where $q$ is odd and $m$ is odd or $m\equiv 2~({\rm mod~}4)$. The concept of negacyclic dually-BCH codes is proposed, and sufficient and necessary conditions in terms of designed distances are presented to ensure that narrow-sense negacyclic BCH codes of length $\frac{q^{m}+1}{2}$ are dually-BCH codes, where $q\equiv 3~({\rm mod}~4)$.


title: Optimal portfolio under ratio-type periodic evaluation in incomplete markets with stochastic factors

abstract: This paper studies a type of periodic utility maximization for portfolio management in an incomplete market model, where the underlying price diffusion process depends on some external stochastic factors. The portfolio performance is periodically evaluated on the relative ratio of two adjacent wealth levels over an infinite horizon. For both power and logarithmic utilities, we formulate the auxiliary one-period optimization problems with modified utility functions, for which we develop the martingale duality approach to establish the existence of the optimal portfolio processes and the dual minimizers can be identified as the "least favorable" completion of the market. With the help of the duality results in the auxiliary problems and some fixed point arguments, we further derive and verify the optimal portfolio processes in a periodic manner for the original periodic evaluation problems over an infinite horizon.


title: Generative Expressive Robot Behaviors using Large Language Models

abstract: People employ expressive behaviors to effectively communicate and coordinate their actions with others, such as nodding to acknowledge a person glancing at them or saying "excuse me" to pass people in a busy corridor. We would like robots to also demonstrate expressive behaviors in human-robot interaction. Prior work proposes rule-based methods that struggle to scale to new communication modalities or social situations, while data-driven methods require specialized datasets for each social situation the robot is used in. We propose to leverage the rich social context available from large language models (LLMs) and their ability to generate motion based on instructions or user preferences, to generate expressive robot motion that is adaptable and composable, building upon each other. Our approach utilizes few-shot chain-of-thought prompting to translate human language instructions into parametrized control code using the robot's available and learned skills. Through user studies and simulation experiments, we demonstrate that our approach produces behaviors that users found to be competent and easy to understand. Supplementary material can be found at https://generative-expressive-motion.github.io/.


title: A Scalable Compact Model for the Static Drain Current of Graphene FETs

abstract: The main target of this article is to propose for the first time a physics-based continuous and symmetric compact model that accurately captures IV experimental dependencies induced by geometrical scaling effects for graphene transistor (GFET) technologies. Such a scalable model is an indispensable ingredient for the boost of large-scale GFET applications, as it has been already proved in solid industry-based CMOS technologies. Dependencies of the physical model parameters on channel dimensions, are thoroughly investigated, and semi?empirical expressions are derived, which precisely characterize such behaviors for an industry-based GFET technology, as well as for others developed in research labs. This work aims at the establishment of the first industry standard GFET compact model that can be integrated in circuit simulation tools and hence, can contribute to the update of GFET technology from the research level to massive industry production.


title: Multi-model learning by sequential reading of untrimmed videos for action recognition

abstract: We propose a new method for learning videos by aggregating multiple models by sequentially extracting video clips from untrimmed video. The proposed method reduces the correlation between clips by feeding clips to multiple models in turn and synchronizes these models through federated learning. Experimental results show that the proposed method improves the performance compared to the no synchronization.


title: Spintronic virtual neural network by a voltage controlled ferromagnet for associative memory

abstract: Recently, an associative memory operation by a virtual oscillator network, consisting of a single spintronic oscillator, was examined to solve issues in conventional, real oscillators-based neural networks such as inhomogeneities between the oscillators. However, the spintronic oscillator still carries issues dissipating large amount of energy because it is driven by electric current. Here, we propose to use a single ferromagnet manipulated by voltage-controlled magnetic anisotropy (VCMA) effect as a fundamental element in a virtual neural network, which will contribute to significantly reducing the Joule heating caused by electric current. Instead of the oscillation in oscillator networks, magnetization relaxation dynamics were used for the associative memory operation. The associative memory operation for alphabet patterns is successfully demonstrated by giving correspondences between the colors in a pattern recognition task and the sign of a perpendicular magnetic anisotropy coefficient, which could be either positive or negative via the VCMA effect.


title: Maximum plasmon thermal conductivity of a thin metal film

abstract: Due to their extremely long propagation lengths compared to the wavelengths, surface plasmon polaritons (SPPs) have been considered as a key in enhancing thermal conductivity in thin metal films. This study explores the conditions at which the plasmon thermal conductivity is maximized, considering the thickness-dependent metal permittivity. We derived the analytical solutions for the plasmon thermal conductivity in both the thin-film and thick-film limits to analyze the effect of the permittivities of metals and substrates. From the analytical solutions of plasmon thermal conductivity, we deduced that the plasmon thermal conductivity is proportional to the electron thermal conductivity based on the Wiedemann-Franz law. Additionally, we analyzed the conditions where the enhancement ratio of the thermal conductivity via SPPs is maximized. Metals with high plasma frequency and low damping coefficient are desirable for achieving the maximum plasmon thermal conductivity as well as the maximum enhancement ratio of thermal conductivity among metals. Significantly, 10-cm-long and 14-nm-thick Al film demonstrates most superior in-plane heat transfer via SPPs, showing a 53.5\% enhancement in thermal conductivity compared to its electron thermal counterpart on a lossless glass substrate.


title: Prompt-enhanced Federated Content Representation Learning for Cross-domain Recommendation

abstract: Cross-domain Recommendation (CDR) as one of the effective techniques in alleviating the data sparsity issues has been widely studied in recent years. However, previous works may cause domain privacy leakage since they necessitate the aggregation of diverse domain data into a centralized server during the training process. Though several studies have conducted privacy preserving CDR via Federated Learning (FL), they still have the following limitations: 1) They need to upload users' personal information to the central server, posing the risk of leaking user privacy. 2) Existing federated methods mainly rely on atomic item IDs to represent items, which prevents them from modeling items in a unified feature space, increasing the challenge of knowledge transfer among domains. 3) They are all based on the premise of knowing overlapped users between domains, which proves impractical in real-world applications. To address the above limitations, we focus on Privacy-preserving Cross-domain Recommendation (PCDR) and propose PFCR as our solution. For Limitation 1, we develop a FL schema by exclusively utilizing users' interactions with local clients and devising an encryption method for gradient encryption. For Limitation 2, we model items in a universal feature space by their description texts. For Limitation 3, we initially learn federated content representations, harnessing the generality of natural language to establish bridges between domains. Subsequently, we craft two prompt fine-tuning strategies to tailor the pre-trained model to the target domain. Extensive experiments on two real-world datasets demonstrate the superiority of our PFCR method compared to the SOTA approaches.


title: Stability of solutions to contact Hamilton-Jacobi equation on the circle

abstract: Combing the weak KAM method for contact Hamiltonian systems and the theory of viscosity solutions for Hamilton-Jacobi equations, we study the Lyapunov stability and instability of viscosity solutions for evolutionary contact Hamilton-Jacobi equation in the first part. In the second part, we study the existence and multiplicity of time-periodic solutions.


title: MaLLaM -- Malaysia Large Language Model

abstract: Addressing the gap in Large Language Model pretrained from scratch with Malaysian context, We trained models with 1.1 billion, 3 billion, and 5 billion parameters on a substantial 349GB dataset, equivalent to 90 billion tokens based on our pretrained Byte Pair Encoding (BPE) tokenizer for a single epoch. MaLLaM contributes to enhanced natural language understanding and generation tasks in the Malay language. Although trained on a smaller dataset of 90 billion tokens, our instruction-tuned MaLLaM models perform competitively. When compared to ChatGPT3.5 and Malaysian Mistral, MaLLaM's instruction-tuned models demonstrate notable proficiency, underscoring the effectiveness of our approach in capturing and understanding the nuances of the Malaysian language. MaLLaM models mark a significant contribution to the field, providing comprehensive language representations grounded in Malaysian context. This endeavor aims to pave the way for enhanced natural language understanding and generation tasks specific to the linguistic nuances present in Malaysia. We discuss the training methodology, dataset composition, and the potential impact of MaLLaM in advancing the capabilities of large language models within the context of the Malay language. All models released at https://huggingface.co/collections/mesolitica/mallam-6577b59d1e0b436ae75f930f


title: MasonTigers@LT-EDI-2024: An Ensemble Approach Towards Detecting Homophobia and Transphobia in Social Media Comments

abstract: In this paper, we describe our approaches and results for Task 2 of the LT-EDI 2024 Workshop, aimed at detecting homophobia and/or transphobia across ten languages. Our methodologies include monolingual transformers and ensemble methods, capitalizing on the strengths of each to enhance the performance of the models. The ensemble models worked well, placing our team, MasonTigers, in the top five for eight of the ten languages, as measured by the macro F1 score. Our work emphasizes the efficacy of ensemble methods in multilingual scenarios, addressing the complexities of language-specific tasks.


title: Diversity-guided Search Exploration for Self-driving Cars Test Generation through Frenet Space Encoding

abstract: The rise of self-driving cars (SDCs) presents important safety challenges to address in dynamic environments. While field testing is essential, current methods lack diversity in assessing critical SDC scenarios. Prior research introduced simulation-based testing for SDCs, with Frenetic, a test generation approach based on Frenet space encoding, achieving a relatively high percentage of valid tests (approximately 50%) characterized by naturally smooth curves. The "minimal out-of-bound distance" is often taken as a fitness function, which we argue to be a sub-optimal metric. Instead, we show that the likelihood of leading to an out-of-bound condition can be learned by the deep-learning vanilla transformer model. We combine this "inherently learned metric" with a genetic algorithm, which has been shown to produce a high diversity of tests. To validate our approach, we conducted a large-scale empirical evaluation on a dataset comprising over 1,174 simulated test cases created to challenge the SDCs behavior. Our investigation revealed that our approach demonstrates a substantial reduction in generating non-valid test cases, increased diversity, and high accuracy in identifying safety violations during SDC test execution.


title: Generating Shuttling Procedures for Constrained Silicon Quantum Dot Array

abstract: In silicon quantum computers, a single electron is trapped in a microstructure called a quantum dot, and its spin is used as a qubit. For large-scale integration of qubits, we previously proposed an approach of arranging the quantum dots in a two-dimensional array and sharing a control gate in a row or column of the array. In our array, the shuttling of electrons is a useful technique to operate the target qubit independently and avoid crosstalk. However, since the shuttling is also conducted using shared control gates, the movement of qubits is complexly constrained. We therefore propose a formal model on the basis of state transition systems to describe those constraints and operation procedures on the array. We also present an approach to generate operation procedures under the constraints. Utilizing this approach, we present a concrete method for our 16 $\times$ 8 quantum dot array. By implementing the proposed method as a quantum compiler, we confirmed that it is possible to generate operation procedures in a practical amount of time for arbitrary quantum circuits. We also demonstrated that crosstalk can be avoided by shuttling and that the fidelity in that case is higher than when crosstalk is not avoided.


title: Inference for Cumulative Incidences and Treatment Effects in Randomized Controlled Trials with Time-to-Event Outcomes under ICH E9 (R1)

abstract: In randomized controlled trials (RCT) with time-to-event outcomes, intercurrent events occur as semi-competing/competing events, and they could affect the hazard of outcomes or render outcomes ill-defined. Although five strategies have been proposed in ICH E9 (R1) addendum to address intercurrent events in RCT, they did not readily extend to the context of time-to-event data for studying causal effects. In this study, we show how to define, estimate, and infer the time-dependent cumulative incidence of outcome events in such contexts for obtaining causal interpretations. Specifically, we derive the mathematical forms of the scientific objective (i.e., causal estimands) under the five strategies and clarify the required data structure to identify these causal estimands. Furthermore, we summarize estimation and inference methods for these causal estimands by adopting methodologies in survival analysis, including analytic formulas for asymptotic analysis and hypothesis testing. We illustrate our methods with the LEADER Trial on investigating the effect of liraglutide on cardiovascular outcomes. Studies of multiple endpoints and combining strategies to address multiple intercurrent events can help practitioners understand treatment effects more comprehensively.


title: Data-dependent density estimation for the Fokker-Planck equation in higher dimensions

abstract: We present a new strategy to approximate the global solution of the Fokker-Planck equation efficiently in higher dimensions and show its convergence. The main ingredients are the Euler scheme to solve the associated stochastic differential equation and a histogram method for tree-structured density estimation on a data-dependent partitioning of the state space R^d.


title: SSR: SAM is a Strong Regularizer for domain adaptive semantic segmentation

abstract: We introduced SSR, which utilizes SAM (segment-anything) as a strong regularizer during training, to greatly enhance the robustness of the image encoder for handling various domains. Specifically, given the fact that SAM is pre-trained with a large number of images over the internet, which cover a diverse variety of domains, the feature encoding extracted by the SAM is obviously less dependent on specific domains when compared to the traditional ImageNet pre-trained image encoder. Meanwhile, the ImageNet pre-trained image encoder is still a mature choice of backbone for the semantic segmentation task, especially when the SAM is category-irrelevant. As a result, our SSR provides a simple yet highly effective design. It uses the ImageNet pre-trained image encoder as the backbone, and the intermediate feature of each stage (ie there are 4 stages in MiT-B5) is regularized by SAM during training. After extensive experimentation on GTA5$\rightarrow$Cityscapes, our SSR significantly improved performance over the baseline without introducing any extra inference overhead.


title: Heavy Neutral Leptons in Gauged $U(1)_{L_\mu-L_\tau}$ at Muon Collider

abstract: Heavy neutral leptons $N$ are the most appealing candidates to generate the tiny neutrino masses. In this paper, we study the signature of heavy neutral leptons in gauged $U(1)_{L_\mu-L_\tau}$ at a muon collider. Charged under the $U(1)_{L_\mu-L_\tau}$ symmetry, the heavy neutral leptons can be pair produced via the new gauge boson $Z'$ at muon collider as $\mu^+\mu^-\to Z^{\prime *}\to NN$ and $\mu^+\mu^-\to Z^{\prime (*)} \gamma\to NN\gamma$. We then perform a detailed analysis on the lepton number violation signature $\mu^+\mu^-\to NN\to \mu^\pm\mu^\pm W^\mp W^\mp$ and $\mu^+\mu^-\to NN \gamma\to \mu^\pm\mu^\pm W^\mp W^\mp \gamma$ at the 3 TeV muon collider, where the hadronic decays of $W$ boson are treated as fat-jets $J$. These lepton number violation signatures have quite clean backgrounds at the muon collider. Our simulation shows that a wide range of viable parameter space is within the reach of the 3 TeV muon collider. For instance, with new gauge coupling $g'=0.6$ and an integrated luminosity of 1000 fb$^{-1}$, the $\mu^\pm\mu^\pm JJ$ signal could probe $m_{Z'}\lesssim 12.5$ TeV. Meanwhile, if the gauge boson mass satisfies $2 m_N<m_{Z'}<\sqrt{s}$, the $\mu^\pm\mu^\pm JJ\gamma$ signature would be more promising than the $\mu^\pm\mu^\pm JJ$ signature.


title: Taiyi-Diffusion-XL: Advancing Bilingual Text-to-Image Generation with Large Vision-Language Model Support

abstract: Recent advancements in text-to-image models have significantly enhanced image generation capabilities, yet a notable gap of open-source models persists in bilingual or Chinese language support. To address this need, we present Taiyi-Diffusion-XL, a new Chinese and English bilingual text-to-image model which is developed by extending the capabilities of CLIP and Stable-Diffusion-XL through a process of bilingual continuous pre-training. This approach includes the efficient expansion of vocabulary by integrating the most frequently used Chinese characters into CLIP's tokenizer and embedding layers, coupled with an absolute position encoding expansion. Additionally, we enrich text prompts by large vision-language model, leading to better images captions and possess higher visual quality. These enhancements are subsequently applied to downstream text-to-image models. Our empirical results indicate that the developed CLIP model excels in bilingual image-text retrieval.Furthermore, the bilingual image generation capabilities of Taiyi-Diffusion-XL surpass previous models. This research leads to the development and open-sourcing of the Taiyi-Diffusion-XL model, representing a notable advancement in the field of image generation, particularly for Chinese language applications. This contribution is a step forward in addressing the need for more diverse language support in multimodal research. The model and demonstration are made publicly available at \href{https://huggingface.co/IDEA-CCNL/Taiyi-Stable-Diffusion-XL-3.5B/}, fostering further research and collaboration in this domain.


title: First isola of modulational instability of Stokes waves in deep water

abstract: We prove high-frequency modulational instability of small-amplitude Stokes waves in deep water under longitudinal perturbations, providing the first isola of unstable eigenvalues branching off from $\mathtt{i}\frac34$. Unlike the finite depth case this is a degenerate problem and the real part of the unstable eigenvalues has a much smaller size than in finite depth. By a symplectic version of Kato theory we reduce to search the eigenvalues of a $2\times 2$ Hamiltonian and reversible matrix which has eigenvalues with non-zero real part if and only if a certain analytic function is not identically zero. In deep water we prove that the Taylor coefficients up to order three of this function vanish, but not the fourth-order one.


title: Hidden nonreciprocity as a stabilizing effective potential in active matter

abstract: Active matter with nonreciprocal interactions is known for its distinctive dynamics. To shed light on the stationary properties of such systems, we consider paradigmatic systems of nonreciprocally coupled active Ornstein-Uhlenbeck particles. For each system, we uniquely decompose the interparticle force into an energy gradient and a transverse nonconservative force. We show that the steady-state distribution of positions, which would only reflect the energy if the noise were thermal, features the transverse force as an effective potential that stabilizes the energy minima, due to the persistent noise that propels the particles. We exactly solve the distribution for nonreciprocal harmonic oscillators and numerically verify it for systems with more complex couplings. When the breaking of reciprocity in the interactions produces a transverse force without changing the energy gradient, we indeed find that the nonreciprocity plays a stabilizing role in the stationary state.


title: The OpenMMPol Library for Polarizable QM/MM Calculations of Properties and Dynamics

abstract: We present a new library designed to provide a simple and straightforward way to implement QM/AMOEBA and other polarizable QM/MM methods based on induced point dipoles. The library, herein referred to as OpenMMPol, is free and open-sourced and is engineered to address the increasing demand for accurate and efficient QM/MM simulations. OpenMMPol is specifically designed to allow polarizable QM/MM calculations of ground state energies and gradients, and excitation properties. Key features of OpenMMPol include a modular architecture facilitating extensibility, parallel computing capabilities for enhanced performance on modern cluster architectures, and a user-friendly interface for intuitive implementation and a simple and flexible structure for providing input data. To show the capabilities of fered by the library we present an interface with PySCF to perform QM/AMOEBA molecular dynamics, geometry optimization and excited state calculation based on (TD)DFT.


title: Variable white dwarfs in TMTS: Asteroseismological analysis of a ZZ Ceti star, TMTS J17184064+2524314

abstract: The Tsinghua University-Ma Huateng Telescope for Survey (TMTS) has been constantly monitoring the northern sky since 2020 in search of rapidly variable stars. To find variable white dwarfs (WDs), the TMTS catalog is cross-matched with the WD catalog of Gaia EDR3, resulting in over 3000 light curves of WD candidates. The WD TMTS J17184064+2524314 (hereafter J1718) is the second ZZ~Ceti star discovered among these common sources. Based on the light curves from TMTS, follow-up photometric observations, and TESS, 10 periods and 3 combination periods are detected. A rotation period of $25.12\pm0.18$ hr is derived, according to the identified rotational splitting. Our spectroscopic observation indicates that this WD belongs to DA type with $T_{\rm eff}=11,670\pm604$ K, log $g=8.16\pm0.36$, $M = 0.70\pm0.23$ M$_{\odot}$, and age=$0.51\pm0.34$ Gyr. Based on core-parameterized asteroseismological model grids ($\geqslant$ 14 million), we derive a best-fit solution of $T_{\rm eff}=11,640\pm20$ K, log $g=8.267\pm0.008$, and $M = 0.750\pm0.005$ M$_{\odot}$ for J1718, consistent with the spectral fitting results. For this WD, the corresponding carbon and oxygen abundances in the core are 0.43 and 0.57, respectively. The distance derived from the intrinsic luminosity given by asteroseismology is $64\pm15$ pc, in accord with the distance of $70.1\pm0.2$ pc from Gaia DR3 within the uncertainties.


title: An explicit-implicit Generalized Finite Difference scheme for a parabolic-elliptic density-suppressed motility system

abstract: In this work, a Generalized Finite Difference (GFD) scheme is presented for effectively computing the numerical solution of a parabolic-elliptic system modelling a bacterial strain with density-suppressed motility. The GFD method is a meshless method known for its simplicity for solving non-linear boundary value problems over irregular geometries. The paper first introduces the basic elements of the GFD method, and then an explicit-implicit scheme is derived. The convergence of the method is proven under a bound for the time step, and an algorithm is provided for its computational implementation. Finally, some examples are considered comparing the results obtained with a regular mesh and an irregular cloud of points.


title: TA-RNN: an Attention-based Time-aware Recurrent Neural Network Architecture for Electronic Health Records

abstract: Motivation: Electronic Health Records (EHR) represent a comprehensive resource of a patient's medical history. EHR are essential for utilizing advanced technologies such as deep learning (DL), enabling healthcare providers to analyze extensive data, extract valuable insights, and make precise and data-driven clinical decisions. DL methods such as Recurrent Neural Networks (RNN) have been utilized to analyze EHR to model disease progression and predict diagnosis. However, these methods do not address some inherent irregularities in EHR data such as irregular time intervals between clinical visits. Furthermore, most DL models are not interpretable. In this study, we propose two interpretable DL architectures based on RNN, namely Time-Aware RNN (TA-RNN) and TA-RNN-Autoencoder (TA-RNN-AE) to predict patient's clinical outcome in EHR at next visit and multiple visits ahead, respectively. To mitigate the impact of irregular time intervals, we propose incorporating time embedding of the elapsed times between visits. For interpretability, we propose employing a dual-level attention mechanism that operates between visits and features within each visit. Results: The results of the experiments conducted on Alzheimer's Disease Neuroimaging Initiative (ADNI) and National Alzheimer's Coordinating Center (NACC) datasets indicated superior performance of proposed models for predicting Alzheimer's Disease (AD) compared to state-of-the-art and baseline approaches based on F2 and sensitivity. Additionally, TA-RNN showed superior performance on Medical Information Mart for Intensive Care (MIMIC-III) dataset for mortality prediction. In our ablation study, we observed enhanced predictive performance by incorporating time embedding and attention mechanisms. Finally, investigating attention weights helped identify influential visits and features in predictions.


title: Continuously Evolving Graph Neural Controlled Differential Equations for Traffic Forecasting

abstract: As a crucial technique for developing a smart city, traffic forecasting has become a popular research focus in academic and industrial communities for decades. This task is highly challenging due to complex and dynamic spatial-temporal dependencies in traffic networks. Existing works ignore continuous temporal dependencies and spatial dependencies evolving over time. In this paper, we propose Continuously Evolving Graph Neural Controlled Differential Equations (CEGNCDE) to capture continuous temporal dependencies and spatial dependencies over time simultaneously. Specifically, a continuously evolving graph generator (CEGG) based on NCDE is introduced to generate the spatial dependencies graph that continuously evolves over time from discrete historical observations. Then, a graph neural controlled differential equations (GNCDE) framework is introduced to capture continuous temporal dependencies and spatial dependencies over time simultaneously. Extensive experiments demonstrate that CEGNCDE outperforms the SOTA methods by average 2.34% relative MAE reduction, 0.97% relative RMSE reduction, and 3.17% relative MAPE reduction.


title: Asymptotic Midpoint Mixup for Margin Balancing and Moderate Broadening

abstract: In the feature space, the collapse between features invokes critical problems in representation learning by remaining the features undistinguished. Interpolation-based augmentation methods such as mixup have shown their effectiveness in relieving the collapse problem between different classes, called inter-class collapse. However, intra-class collapse raised in coarse-to-fine transfer learning has not been discussed in the augmentation approach. To address them, we propose a better feature augmentation method, asymptotic midpoint mixup. The method generates augmented features by interpolation but gradually moves them toward the midpoint of inter-class feature pairs. As a result, the method induces two effects: 1) balancing the margin for all classes and 2) only moderately broadening the margin until it holds maximal confidence. We empirically analyze the collapse effects by measuring alignment and uniformity with visualizing representations. Then, we validate the intra-class collapse effects in coarse-to-fine transfer learning and the inter-class collapse effects in imbalanced learning on long-tailed datasets. In both tasks, our method shows better performance than other augmentation methods.


title: Bifurcation mechanism of quasihalo orbit from Lissajous orbit in the restricted three-body problem

abstract: This paper presents a general analytical method to describe the center manifolds of collinear libration points in the Restricted Three-body Problem (RTBP). It is well-known that these center manifolds include Lissajous orbits, halo orbits, and quasihalo orbits. Previous studies have traditionally tackled these orbits separately by iteratively constructing high-order series solutions using the Lindstedt-Poincar\'e method. Instead of relying on resonance between their frequencies, this study identifies that halo and quasihalo orbits arise due to intricate coupling interactions between in-plane and out-of-plane motions. To characterize this coupling effect, a novel concept, coupling coefficient $\eta$, is introduced in the RTBP, incorporating the coupling term $\eta \Delta x$ in the $z$-direction dynamics equation, where $\Delta$ represents a formal power series concerning the amplitudes. Subsequently, a uniform series solution for these orbits is constructed up to a specified order using the Lindstedt-Poincar\'e method. For any given paired in-plane and out-of-plane amplitudes, the coupling coefficient $\eta$ is determined by the bifurcation equation $\Delta = 0$. When $\eta$ = 0, the proposed solution describes Lissajous orbits around libration points. As $\eta$ transitions from zero to non-zero values, the solution describes quasihalo orbits, which bifurcate from Lissajous orbits. Particularly, halo orbits bifurcate from planar Lyapunov orbits if the out-of-plane amplitude is zero. The proposed method provides a unified framework for understanding these intricate orbital behaviors in the RTBP.


title: Under the Surface: Tracking the Artifactuality of LLM-Generated Data

abstract: This work delves into the expanding role of large language models (LLMs) in generating artificial data. LLMs are increasingly employed to create a variety of outputs, including annotations, preferences, instruction prompts, simulated dialogues, and free text. As these forms of LLM-generated data often intersect in their application, they exert mutual influence on each other and raise significant concerns about the quality and diversity of the artificial data incorporated into training cycles, leading to an artificial data ecosystem. To the best of our knowledge, this is the first study to aggregate various types of LLM-generated text data, from more tightly constrained data like "task labels" to more lightly constrained "free-form text". We then stress test the quality and implications of LLM-generated artificial data, comparing it with human data across various existing benchmarks. Despite artificial data's capability to match human performance, this paper reveals significant hidden disparities, especially in complex tasks where LLMs often miss the nuanced understanding of intrinsic human-generated content. This study critically examines diverse LLM-generated data and emphasizes the need for ethical practices in data creation and when using LLMs. It highlights the LLMs' shortcomings in replicating human traits and behaviors, underscoring the importance of addressing biases and artifacts produced in LLM-generated content for future research and development. All data and code are available on our project page.


title: Quantum Oscillations Measurement of the Heavy Electron Mass near the van Hove Singularity in a Kagome Metal

abstract: Kagome metals with the Fermi energy tuned near the van Hove singularities (vHss) have shown to host exotic phases including unconventional superconductivity and a chiral flux phase arising from a charge density wave. However, most quantum oscillations studies of the electronic structure of kagome metals focus on compounds which electronically or magnetically order, obscuring the unperturbed vHs. Here we present quantum oscillation measurements of YV$_6$Sn$_6$ which contains a pristine kagome lattice free from long range order. We discovered quantum oscillations corresponding to a large orbit ($\approx$70% of the Brillouin Zone area) with the heaviest mass ever observed in vanadium based kagome metals ($\approx3.3 m_e$), consistent with a Fermi pocket whose Fermi level is near the vHs. Comparing with first principles calculations suggests that the effective mass of this pocket is highly sensitive to the position of Fermi level. Our study establishes the enhanced density of states associated with a vHs in a kagome metal, allowing further insight into a potential driving mechanism for the unconventional electronic orderings in this class of materials.


title: Exploring Holomorphic Retracts

abstract: The purpose of this article is towards systematically characterizing (holomorphic) retracts of domains of holomorphy; to begin with, bounded balanced pseudoconvex domains $B \subset \mathbb{C}^N$. Specifically, we show that every retract of $B$ passing through its center (origin), is the graph of a holomorphic map over a linear subspace of $B$. As for retracts not passing through origin, we obtain the following result: if $B$ is a strictly convex ball and $\rho$ any holomorphic retraction map on $B$ which is submersive at its center, then $Z=\rho(B)$ is the graph of a holomorphic map over a linear subspace of $B$. To deal with a case when $\partial B$ may fail to have sufficiently many extreme points, we consider products of strictly convex balls, with respect to various norms and obtain a complete description of retracts passing through its center. This can be applied to solve a special case of the union problem with a degeneracy, namely: to characterize those Kobayashi corank one complex manifolds $M$ which can be expressed as an increasing union of submanifolds which are biholomorphic to a prescribed homogeneous bounded balanced domain. Results about non-existence of retracts of each possible dimension is established for the simplest non-convex but pseudoconvex domain: the `$\ell^q$-ball' for $0<q<1$; this enables an illustration of applying retracts to establishing biholomorphic inequivalences. To go beyond balanced domains, we then first obtain a complete characterization of retracts of the Hartogs triangle and `analytic complements' thereof. Thereafter, similar characterization results for domains which are neither bounded nor topologically trivial. We conclude by reporting some results on the retracts of $\mathbb{C}^2$.


title: Curious ill-posedness phenomena in the composition of non-compact linear operators in Hilbert spaces

abstract: We consider the composition of operators with non-closed range in Hilbert spaces and how the nature of ill-posedness is affected by their composition. Specifically, we study the \mbox{Hausdorff-,} Ces\`{a}ro-, integration operator, and their adjoints, as well as some combinations of those. For the composition of the Hausdorff- and the Ces\`{a}ro-operator, we give estimates of the decay of the corresponding singular values. As a curiosity, this provides also an example of two practically relevant non-compact operators, for which their composition is compact. Furthermore, we characterize those operators for which a composition with a non-compact operator gives a compact one.


title: FairSample: Training Fair and Accurate Graph Convolutional Neural Networks Efficiently

abstract: Fairness in Graph Convolutional Neural Networks (GCNs) becomes a more and more important concern as GCNs are adopted in many crucial applications. Societal biases against sensitive groups may exist in many real world graphs. GCNs trained on those graphs may be vulnerable to being affected by such biases. In this paper, we adopt the well-known fairness notion of demographic parity and tackle the challenge of training fair and accurate GCNs efficiently. We present an in-depth analysis on how graph structure bias, node attribute bias, and model parameters may affect the demographic parity of GCNs. Our insights lead to FairSample, a framework that jointly mitigates the three types of biases. We employ two intuitive strategies to rectify graph structures. First, we inject edges across nodes that are in different sensitive groups but similar in node features. Second, to enhance model fairness and retain model quality, we develop a learnable neighbor sampling policy using reinforcement learning. To address the bias in node features and model parameters, FairSample is complemented by a regularization objective to optimize fairness.


title: The POKEMON Speckle Survey of Nearby M Dwarfs. III. The Stellar Multiplicity Rate of M Dwarfs within 15 pc

abstract: M dwarfs are ubiquitous in our galaxy, and the rate at which they host stellar companions, and the properties of these companions, provides a window into the formation and evolution of the star(s), and of any planets that they may host. The Pervasive Overview of 'Kompanions' of Every M dwarf in Our Neighborhood (POKEMON) speckle survey of nearby M dwarfs is volume-limited from M0V through M9V out to 15 pc, with additional targets at larger distances. In total, 1125 stars were observed, and 455 of these are within the volume-limited, 15-pc sample of M-dwarf primaries. When we combine the speckle observations with known companions from the literature, we find that the stellar multiplicity rate of M dwarfs within 15 pc is 23.5% plus or minus 2.0%, and that the companion rate is 28.8% plus or minus 2.1%. We also find that the projected separation distribution for multiples that are known to host planets peaks at 198 au, while the distribution for multiples that are not yet known to host planets peaks at 5.57 au. This result suggests that the presence of close-in stellar companions inhibits the formation of M-dwarf planetary systems, similar to what has been found for FGK stars.


title: Ground-state mass of $^{22}$Al and test of state-of-the-art \textit{ab initio} calculations

abstract: The ground-state mass excess of the $T_{z}=-2$ drip-line nucleus $^{22}$Al is measured for the first time to be $18103(10)$ keV using the newly-developed B$\rho$-defined isochronous mass spectrometry method at the cooler storage ring in Lanzhou. The new mass excess value allowed us to determine the excitation energies of the two low-lying $1^+$ states in $^{22}$Al with significantly reduced uncertainties of 51 keV. Comparing to the analogue states in its mirror nucleus $^{22}$F, the mirror energy differences of the two $1^+$ states in the $^{22}$Al-$^{22}$F mirror pair are determined to be $-625(51)$ keV and $-330(51)$ keV, respectively. The excitation energies and the mirror energy differences are used to test the state-of-the-art \textit{ab initio} valence-space in-medium similarity renormalization group calculations with four sets of interactions derived from the chiral effective field theory. The mechanism leading to the large mirror energy differences is investigated and attributed to the occupation of the $\pi s_{1/2}$ orbital.


title: Additional Look into GAN-based Augmentation for Deep Learning COVID-19 Image Classification

abstract: The availability of training data is one of the main limitations in deep learning applications for medical imaging. Data augmentation is a popular approach to overcome this problem. A new approach is a Machine Learning based augmentation, in particular usage of Generative Adversarial Networks (GAN). In this case, GANs generate images similar to the original dataset so that the overall training data amount is bigger, which leads to better performance of trained networks. A GAN model consists of two networks, a generator and a discriminator interconnected in a feedback loop which creates a competitive environment. This work is a continuation of the previous research where we trained StyleGAN2-ADA by Nvidia on the limited COVID-19 chest X-ray image dataset. In this paper, we study the dependence of the GAN-based augmentation performance on dataset size with a focus on small samples. Two datasets are considered, one with 1000 images per class (4000 images in total) and the second with 500 images per class (2000 images in total). We train StyleGAN2-ADA with both sets and then, after validating the quality of generated images, we use trained GANs as one of the augmentations approaches in multi-class classification problems. We compare the quality of the GAN-based augmentation approach to two different approaches (classical augmentation and no augmentation at all) by employing transfer learning-based classification of COVID-19 chest X-ray images. The results are quantified using different classification quality metrics and compared to the results from the literature. The GAN-based augmentation approach is found to be comparable with classical augmentation in the case of medium and large datasets but underperforms in the case of smaller datasets. The correlation between the size of the original dataset and the quality of classification is visible independently from the augmentation approach.


title: Polystyrene based scintillation detector studies in Astro particle Physics and medical physics

abstract: DEASA (Dayalbagh Educational Air Shower Array) consists of eight plastic scintillators each with an area of 1 square meter. The cosmic ray showers have been simulated in CORSIKA [1] for the different primary particles in the energy range of 1014- 1015 eV. The longitudinal and lateral profiles have been studied for Agra. The real-life applications of cosmic ray particles in space have been studied to protect the astronaut from the galactic cosmic rays [2]. A plastic scintillation detector is simulated in Geant4 to study applications in hadron and carbon ion therapy [3]. The proton and carbon beam are simulated through the tumour region to study the stopping power and depth dose distribution for different organs. The energy range for each study is optimized and the Bragg curve is then interpreted with Bragg peak position and range.