title: Effects of imaginary and real rotations on QCD matters

abstract: Inspired from perturbative calculations, this work introduces imaginary ($\Omega_{\rm I}$) and real ($\Omega$) rotation effects to the pure $SU(3)$ gauge potentials simply through variable transformations: The empirical Polyakov loop (PL) potentials can be rewritten as functions of the imaginary chemical potentials of gluons and ghosts $(q_{\rm ij})$, and the transformations are taken as $q_{\rm ij}\rightarrow q_{\rm ij}\pm\Omega_{\rm I}/T$ and $q_{\rm ij}\rightarrow q_{\rm ij}\pm i\,\Omega/T$, respectively. For the PL potential of Fukushima $(V_1)$, a smaller imaginary rotation $\Omega_{\rm I}$ tends to suppress PL at all temperature and the deconfinement transition keeps of first order. However, for the PL potential of Munich group $(V_2)$, $\Omega_{\rm I}$ tends to enhance PL at low temperature $T$, consistent with lattice simulations; but suppress PL at high $T$, consistent with perturbative calculations. Moreover, the deconfinement alters from first order to crossover with increasing $\Omega_{\rm I}$ as is expected from lattice simulations. On the other hand, the real rotation $\Omega$ tends to enhance PL at relatively low $T$ for both potentials, and the (pseudo-)critical temperature decreases with $\Omega$ as expected. Therefore, we find that analytic continuation of the phase diagram from imaginary to real rotation is not necessarily valid in the non-perturbative region. Finally, we apply the more successful PL potential $V_2$ to the Polyakov--Nambu-Jona-Lasinio (PNJL) model and discover that $\Omega_{\rm I}$ tends to break chiral symmetry while $\Omega$ tends to restore it. Especially, the modified model is even able to qualitatively explain the lattice result that a larger $T$ would catalyze chiral symmetry breaking for a large $\Omega_{\rm I}$.


title: Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses

abstract: Variational dimensionality reduction methods are known for their high accuracy, generative abilities, and robustness. We introduce a framework to unify many existing variational methods and design new ones. The framework is based on an interpretation of the multivariate information bottleneck, in which an encoder graph, specifying what information to compress, is traded-off against a decoder graph, specifying a generative model. Using this framework, we rederive existing dimensionality reduction methods including the deep variational information bottleneck and variational auto-encoders. The framework naturally introduces a trade-off parameter extending the deep variational CCA (DVCCA) family of algorithms to beta-DVCCA. We derive a new method, the deep variational symmetric informational bottleneck (DVSIB), which simultaneously compresses two variables to preserve information between their compressed representations. We implement these algorithms and evaluate their ability to produce shared low dimensional latent spaces on Noisy MNIST dataset. We show that algorithms that are better matched to the structure of the data (in our case, beta-DVCCA and DVSIB) produce better latent spaces as measured by classification accuracy, dimensionality of the latent variables, and sample efficiency. We believe that this framework can be used to unify other multi-view representation learning algorithms and to derive and implement novel problem-specific loss functions.

categories: cs.LG cond-mat.stat-mech cs.IT math.IT physics.data-an


title: Certifiably Robust Graph Contrastive Learning

abstract: Graph Contrastive Learning (GCL) has emerged as a popular unsupervised graph representation learning method. However, it has been shown that GCL is vulnerable to adversarial attacks on both the graph structure and node attributes. Although empirical approaches have been proposed to enhance the robustness of GCL, the certifiable robustness of GCL is still remain unexplored. In this paper, we develop the first certifiably robust framework in GCL. Specifically, we first propose a unified criteria to evaluate and certify the robustness of GCL. We then introduce a novel technique, RES (Randomized Edgedrop Smoothing), to ensure certifiable robustness for any GCL model, and this certified robustness can be provably preserved in downstream tasks. Furthermore, an effective training method is proposed for robust GCL. Extensive experiments on real-world datasets demonstrate the effectiveness of our proposed method in providing effective certifiable robustness and enhancing the robustness of any GCL model. The source code of RES is available at https://github.com/ventr1c/RES-GCL.


title: Kawaguchi-Silverman Conjecture for Projective Bundles on Curves

abstract: We prove the Kawaguchi-Silverman conjecture for projective bundles on elliptic curves, thereby completing the conjecture for all projective bundles over curves. Our approach is to use the transition functions of the bundles. This allows us to further prove the conjecture for projectivized split bundles over a smooth projective variety with finitely generated Mori cone.


title: Enhanced Human-Robot Collaboration using Constrained Probabilistic Human-Motion Prediction

abstract: Human motion prediction is an essential step for efficient and safe human-robot collaboration. Current methods either purely rely on representing the human joints in some form of neural network-based architecture or use regression models offline to fit hyper-parameters in the hope of capturing a model encompassing human motion. While these methods provide good initial results, they are missing out on leveraging well-studied human body kinematic models as well as body and scene constraints which can help boost the efficacy of these prediction frameworks while also explicitly avoiding implausible human joint configurations. We propose a novel human motion prediction framework that incorporates human joint constraints and scene constraints in a Gaussian Process Regression (GPR) model to predict human motion over a set time horizon. This formulation is combined with an online context-aware constraints model to leverage task-dependent motions. It is tested on a human arm kinematic model and implemented on a human-robot collaborative setup with a UR5 robot arm to demonstrate the real-time capability of our approach. Simulations were also performed on datasets like HA4M and ANDY. The simulation and experimental results demonstrate considerable improvements in a Gaussian Process framework when these constraints are explicitly considered.


title: Macroscopic quantum-mechanical scattering

abstract: In certain conditions a macroscopic quantum-mechanical scattering may occur, which may lead to a coherent cross-section on a macroscopic scale in a monocrystal. The conditions are satisfied by neutrinos, but not satisfied by other projectiles, with a higher cross-section. This may explain Weber-type experiments of neutrino detection by a perfect, stiff sapphire monocrystal. The occurrence of coherence domains for quantum-mechanical scattering and classical diffraction is analyzed, and the force exerted upon a macroscopic target is estimated. It is concluded that neutrinos exhibit a distinctive feature in this respect, due precisely to their very small cross-section.


title: Mirrors of conformal dynamics: Interplay between anti-rational maps, reflection groups, Schwarz reflections, and correspondences

abstract: The goal of this survey is to present intimate interactions between four branches of conformal dynamics: iterations of anti-rational maps, actions of Kleinian reflection groups, dynamics generated by Schwarz reflections in quadrature domains, and algebraic correspondences. We start with several examples of Schwarz reflections as well as algebraic correspondences obtained by matings between anti-rational maps and reflection groups, and examples of Julia set realizations for limit sets of reflection groups (including classical Apollonian-like gaskets). We follow up these examples with dynamical relations between explicit Schwarz reflection parameter spaces and parameter spaces of anti-rational maps and of reflection groups. These are complemented by a number of general results and illustrations of important technical tools, such as David surgery and straightening techniques. We also collect several analytic applications of the above theory.


title: Indeed, the Monster has no almost simple maximal subgroup with socle $\text{PSL}_2(16)$

abstract: The classification of the maximal subgroups of the Monster $\mathbf{M}$ is believed to be complete subject to an unpublished result of Holmes and Wilson asserting that $\mathbf{M}$ has no maximal subgroups that are almost simple with socle isomorphic to $\text{PSL}_2(8)$, $\text{PSL}_2(16)$, or $\text{PSU}_3(4)$. We prove this result for $\text{PSL}_2(16)$, with the intention that the other two cases will be dealt with in an expanded version of this paper. Our proof is supported by reproducible computations carried out using Seysen's publicly available Python package mmgroup for computing with $\mathbf{M}$.


title: On Metaverse Application Dependability Analysis

abstract: Metaverse as-a-Service (MaaS) enables Metaverse tenants to execute their APPlications (MetaAPP) by allocating Metaverse resources in the form of Metaverse service functions (MSF). Usually, each MSF is deployed in a virtual machine (VM) for better resiliency and security. However, these MSFs along with VMs and virtual machine monitors (VMM) running them may encounter software aging after prolonged continuous operation. Then, there is a decrease in MetaAPP dependability, namely, the dependability of the MSF chain (MSFC), consisting of MSFs allocated to MetaAPP. This paper aims to investigate the impact of both software aging and rejuvenation techniques on MetaAPP dependability in the scenarios, where both active components (MSF, VM and VMM) and their backup components are subject to software aging. We develop a hierarchical model to capture behaviors of aging, failure, and recovery by applying Semi-Markov process and reliability block diagram. Numerical analysis and simulation experiments are conducted to evaluate the approximation accuracy of the proposed model and dependability metrics. We then identify the key parameters for improving the MetaAPP/MSFC dependability through sensitivity analysis. The investigation is also made about the influence of various parameters on MetaAPP/MSFC dependability.


title: Hamiltonian Encoding for Quantum Approximate Time Evolution of Kinetic Energy Operator

abstract: The time evolution operator plays a crucial role in the precise computation of chemical experiments on quantum computers and holds immense promise for advancing the fields of physical and computer sciences, with applications spanning quantum simulation and machine learning. However, the construction of large-scale quantum computers poses significant challenges, prompting the need for innovative and resource-efficient strategies. Traditional methods like phase estimation or variational algorithms come with certain limitations such as the use of classical optimization or complex quantum circuitry. One successful method is the Trotterization technique used for quantum simulation, specifically in atomic structure problems with a gate complexity of approximately O(n^2) for an n-qubit realization. In this work, we have proposed a new encoding method, namely quantum approximate time evolution (QATE) for the quantum implementation of the kinetic energy operator as a diagonal unitary operator considering the first quantization level. The theoretical foundations of our approach are discussed, and experimental results are obtained on an IBM quantum machine. Our proposed method offers gate complexity in sub-quadratic polynomial with qubit size $n$ which is an improvement over previous work. Further, the fidelity improvement for the time evolution of the Gaussian wave packet has also been demonstrated.


title: BioBridge: Bridging Biomedical Foundation Models via Knowledge Graphs

abstract: Foundation models (FMs) are able to leverage large volumes of unlabeled data to demonstrate superior performance across a wide range of tasks. However, FMs developed for biomedical domains have largely remained unimodal, i.e., independently trained and used for tasks on protein sequences alone, small molecule structures alone, or clinical data alone. To overcome this limitation of biomedical FMs, we present BioBridge, a novel parameter-efficient learning framework, to bridge independently trained unimodal FMs to establish multimodal behavior. BioBridge achieves it by utilizing Knowledge Graphs (KG) to learn transformations between one unimodal FM and another without fine-tuning any underlying unimodal FMs. Our empirical results demonstrate that BioBridge can beat the best baseline KG embedding methods (on average by around 76.3%) in cross-modal retrieval tasks. We also identify BioBridge demonstrates out-of-domain generalization ability by extrapolating to unseen modalities or relations. Additionally, we also show that BioBridge presents itself as a general purpose retriever that can aid biomedical multimodal question answering as well as enhance the guided generation of novel drugs.


title: Hunting Gamma-ray emitting FR0 radio galaxies in wide-field sky surveys

abstract: The latest entry in the jetted active galactic nuclei (AGN) family is the Fanaroff-Riley type 0 (FR0) radio galaxies. They share several observational characteristics, e.g., nuclear emission and host galaxy morphology, with FR I sources; however, they lack extended, kiloparsec-scale radio structures, which are the defining features of canonical FR I and II sources. Here we report the identification of 7 gamma-ray emitting AGN as FR0 radio sources by utilizing the high-quality observations delivered by ongoing multi-wavelength wide-field sky surveys, e.g., Very Large Array Sky Survey. The broadband observational properties of these objects are found to be similar to their gamma-ray undetected counterparts. In the gamma-ray band, FR0 radio galaxies exhibit spectral features similar to more common FR I and II radio galaxies, indicating a common gamma-ray production mechanism and the presence of misaligned jets. Although the parsec-scale radio structure of FR0s generally exhibits a wide range, with about half having emission on opposite sides of the core, the gamma-ray detected FR0s tend to have dominant cores with core-jet structures. We conclude that dedicated, high-resolution observations are needed to unravel the origin of relativistic jets in this enigmatic class of faint yet numerous population of compact radio sources.


title: Finite-time scaling for kinetic rough interfaces

abstract: We consider discrete models of kinetic rough interfaces that exhibit space-time scale-invariance in height-height correlation. A generic scaling theory implies that the dynamical structure factor of the height profile can uniquely characterize the underlying dynamics. We provide a finite-time scaling that systematically allows an estimation of the critical exponents and the scaling functions, eventually establishing the universality class accurately. As an illustration, we investigate a class of self-organized interface models in random media with extremal dynamics. The isotropic version shows a faceted pattern and belongs to the same universality class (as shown numerically) as the Sneppen (model A). We also introduce an anisotropic version of the Sneppen (model A) and suggest that the model belongs to the universality class of the tensionless one-dimensional Kardar-Parisi-Zhang equation.


title: Existence and uniqueness for $p$-adic counterpart of the porous medium equation

abstract: We develop a theory of generalized solutions of the nonlinear evolution equations for complex-valued functions of a real positive time variable and $p$-adic spatial variable, which can be seen as non-Archimedean counterparts of the fractional porous medium equation. In this case, we face the problem that a $p$-adic ball is simultaneously open and closed, thus having an empty boundary. To address this issue, we use the algebraic structure of the field of $p$-adic numbers and apply the Pontryagin duality theory to construct the appropriate fractional Sobolev type spaces. We prove the existence and uniqueness results for the corresponding nonlinear equation and define an associated nonlinear semigroup.


title: Investigating the Limitation of CLIP Models: The Worst-Performing Categories

abstract: Contrastive Language-Image Pre-training (CLIP) provides a foundation model by integrating natural language into visual concepts, enabling zero-shot recognition on downstream tasks. It is usually expected that satisfactory overall accuracy can be achieved across numerous domains through well-designed textual prompts. However, we found that their performance in the worst categories is significantly inferior to the overall performance. For example, on ImageNet, there are a total of 10 categories with class-wise accuracy as low as 0\%, even though the overall performance has achieved 64.1\%. This phenomenon reveals the potential risks associated with using CLIP models, particularly in risk-sensitive applications where specific categories hold significant importance. To address this issue, we investigate the alignment between the two modalities in the CLIP model and propose the Class-wise Matching Margin (\cmm) to measure the inference confusion. \cmm\ can effectively identify the worst-performing categories and estimate the potential performance of the candidate prompts. We further query large language models to enrich descriptions of worst-performing categories and build a weighted ensemble to highlight the efficient prompts. Experimental results clearly verify the effectiveness of our proposal, where the accuracy on the worst-10 categories on ImageNet is boosted to 5.2\%, without manual prompt engineering, laborious optimization, or access to labeled validation data.


title: Learning Concept-Based Causal Transition and Symbolic Reasoning for Visual Planning

abstract: Visual planning simulates how humans make decisions to achieve desired goals in the form of searching for visual causal transitions between an initial visual state and a final visual goal state. It has become increasingly important in egocentric vision with its advantages in guiding agents to perform daily tasks in complex environments. In this paper, we propose an interpretable and generalizable visual planning framework consisting of i) a novel Substitution-based Concept Learner (SCL) that abstracts visual inputs into disentangled concept representations, ii) symbol abstraction and reasoning that performs task planning via the self-learned symbols, and iii) a Visual Causal Transition model (ViCT) that grounds visual causal transitions to semantically similar real-world actions. Given an initial state, we perform goal-conditioned visual planning with a symbolic reasoning method fueled by the learned representations and causal transitions to reach the goal state. To verify the effectiveness of the proposed model, we collect a large-scale visual planning dataset based on AI2-THOR, dubbed as CCTP. Extensive experiments on this challenging dataset demonstrate the superior performance of our method in visual task planning. Empirically, we show that our framework can generalize to unseen task trajectories, unseen object categories, and real-world data. Further details of this work are provided at https://fqyqc.github.io/ConTranPlan/.


title: Precursor that predicts the earthquakes, triggers, and indicators

abstract: it has been given scientifically proven suggestions for the classification of earthquake precursor, indicator, and triggering factors.


title: Formation of misaligned second-generation discs through flyby encounters

abstract: Observations reveal protoplanetary discs being perturbed by flyby candidates. We simulate a scenario where an unbound perturber, i.e., a flyby, undergoes an inclined grazing encounter, capturing material and forming a second-generation protoplanetary disc. We run $N$--body and three-dimensional hydrodynamical simulations of a parabolic flyby grazing a particle disc and a gas-rich protoplanetary disc, respectively. In both our $N$--body and hydrodynamic simulations, we find that the captured, second-generation disc forms at a tilt twice the initial flyby tilt. This relationship is robust to variations in the flyby's tilt, position angle, periastron, and mass. We extend this concept by also simulating the case where the flyby has a disc of material prior to the encounter but we do not find the same trend. An inclined disc with respect to the primary disc around a misaligned flyby is tilted by a few degrees, remaining close to its initial disc tilt. Therefore, if a disc is present around the flyby before the encounter, the disc may not tilt up to twice the perturber tilt depending on the balance between the angular momentum of the circumsecondary disc and captured particles. In the case where the perturber has no initial disc, analyzing the orientation of these second-generation discs can give information about the orbital properties of the flyby encounter.


title: Reformulating Domain Adaptation of Large Language Models as Adapt-Retrieve-Revise

abstract: While large language models (LLMs) like GPT-4 have recently demonstrated astonishing zero-shot capabilities in general domain tasks, they often generate content with hallucinations in specific domains such as Chinese law, hindering their application in these areas. This is typically due to the absence of training data that encompasses such a specific domain, preventing GPT-4 from acquiring in-domain knowledge. A pressing challenge is that it's not plausible to continue training LLMs of such scale on in-domain data. This paper introduces a simple and effective domain adaptation framework for GPT-4 by reformulating generation as an \textbf{adapt-retrieve-revise} process. The initial step is to \textbf{adapt} an affordable 7B LLM to the target domain by continuing learning on in-domain data. When solving a task, we leverage the adapted LLM to generate a draft answer given a task query. Then, the draft answer will be used to \textbf{retrieve} supporting evidence candidates from an external in-domain knowledge base. Finally, the draft answer and retrieved evidence are concatenated into a whole prompt to let GPT-4 assess the evidence and \textbf{revise} the draft answer to generate the final answer. Our proposal combines the advantages of the efficiency of adapting a smaller 7B model with the evidence-assessing capability of GPT-4 and effectively prevents GPT-4 from generating hallucinatory content. In the zero-shot setting of four Chinese legal tasks, our method improves accuracy by 33.3\% compared to the direct generation by GPT-4. When compared to two stronger retrieval-based baselines, our method outperforms them by 15.4\% and 23.9\%. Our code will be released


title: Nonextensive Effect on the Lump Soliton Structures in Dusty Plasma

abstract: In this paper, we use a very prominent technique, Hirota Bilinear Method (HBM) to survey the lump structures of the Kadomtsev-Petviashvili (KP) equation in the frame of a collisionless magnetized plasma system composed of dust grains, ions, and nonextensive electrons. Nonlinearity has worldwide applications, and soliton theory is a powerful appliance to illustrate its qualitative behaviors. So, lump solitons are very significant and also interesting. We have observed that lump structures differ due to the correlated parameters of the plasma system. It has also been found that the nonextensive parameter crucially changes the lump features.


title: Vehicle Cabin Climate MPC Parameter Tuning Using Constrained Contextual Bayesian Optimization (C-CMES)

abstract: Climate-controlled cabins have for decades been standard in vehicles. Model Predictive Controllers (MPCs) have shown promising results in achieving temperature tracking in vehicle cabins and may improve upon model-free control performance. However, for the multi-zone climate control case, proper controller tuning is challenging, as externally, e.g., passenger-triggered changes in compressor setting and thus mass flow lead to degraded control performance. This paper presents a tuning method to automatically determine robust MPC parameters, as a function of the blower mass flow. Constrained contextual Bayesian optimization (BO) is used to derive policies minimizing a high-level cost function subject to constraints in a defined scenario. The proposed method leverages random disturbances and model-plant mismatch within the training episodes to generate controller parameters achieving robust disturbance rejection. The method contains a postprocessing step to achieve smooth policies that can be utilized in real-world applications. First, simulation results show that the mass flow-dependent policy outperforms a constant parametrization, while achieving the desired closed-loop behavior. Second, the robust tuning method greatly reduces worst-case overshoot and produces consistent closed-loop behavior under varying operating conditions.


title: Fine-tune Language Models to Approximate Unbiased In-context Learning

abstract: In-context learning (ICL) is an astonishing emergent ability of large language models (LLMs). By presenting a prompt that includes multiple input-output pairs as examples and introducing a new query input, models can generate the corresponding output. However, the performance of models heavily relies on the quality of the input prompt when implementing in-context learning. Biased or imbalanced input prompts can significantly degrade the performance of language models. To address this issue, we introduce a reweighted algorithm called RICL (Reweighted In-context Learning). This algorithm fine-tunes language models using an unbiased validation set to determine the optimal weight for each input-output example to approximate unbiased in-context learning. Furthermore, we also introduce a low-cost reweighted algorithm, a linear optimal weight approximation algorithm called LARICL (Linear Approximation of Reweighted In-context Learning). This algorithm requires minimal training cost while providing effective results. We prove the convergence of our algorithm and validate its performance through experiments conducted on a numerical dataset. The experimental findings reveal a substantial improvement in comparison to benchmarks including the performance of casual prompt-based in-context learning and the performance of a classic fine-tuning method.


title: Simple-Sum Giant Graviton Expansions for Orbifolds and Orientifolds

abstract: We study giant graviton expansions of the superconformal index of 4d orbifold/orientifold theories. In general, a giant graviton expansion is given as a multiple sum over wrapping numbers. It has been known that the expansion can be reduced to a simple sum for the ${\cal N}=4$ $U(N)$ SYM by choosing appropriate expansion variables. We find such a reduction occurs for a few examples of orbifold and orientifold theories: $\mathbb{Z}_k$ orbifold and orientifolds with $O3$ and $O7$. We also argue that for a quiver gauge theory associated with a toric Calabi-Yau $3$-fold the simple-sum expansion works only if the toric diagram is a triangle, that is, the Calabi-Yau is an orbifold of $\mathbb{C}^3$.


title: Real-time Multi-modal Object Detection and Tracking on Edge for Regulatory Compliance Monitoring

abstract: Regulatory compliance auditing across diverse industrial domains requires heightened quality assurance and traceability. Present manual and intermittent approaches to such auditing yield significant challenges, potentially leading to oversights in the monitoring process. To address these issues, we introduce a real-time, multi-modal sensing system employing 3D time-of-flight and RGB cameras, coupled with unsupervised learning techniques on edge AI devices. This enables continuous object tracking thereby enhancing efficiency in record-keeping and minimizing manual interventions. While we validate the system in a knife sanitization context within agrifood facilities, emphasizing its prowess against occlusion and low-light issues with RGB cameras, its potential spans various industrial monitoring settings.


title: Untargeted White-box Adversarial Attack with Heuristic Defence Methods in Real-time Deep Learning based Network Intrusion Detection System

abstract: Network Intrusion Detection System (NIDS) is a key component in securing the computer network from various cyber security threats and network attacks. However, consider an unfortunate situation where the NIDS is itself attacked and vulnerable more specifically, we can say, How to defend the defender?. In Adversarial Machine Learning (AML), the malicious actors aim to fool the Machine Learning (ML) and Deep Learning (DL) models to produce incorrect predictions with intentionally crafted adversarial examples. These adversarial perturbed examples have become the biggest vulnerability of ML and DL based systems and are major obstacles to their adoption in real-time and mission-critical applications such as NIDS. AML is an emerging research domain, and it has become a necessity for the in-depth study of adversarial attacks and their defence strategies to safeguard the computer network from various cyber security threads. In this research work, we aim to cover important aspects related to NIDS, adversarial attacks and its defence mechanism to increase the robustness of the ML and DL based NIDS. We implemented four powerful adversarial attack techniques, namely, Fast Gradient Sign Method (FGSM), Jacobian Saliency Map Attack (JSMA), Projected Gradient Descent (PGD) and Carlini & Wagner (C&W) in NIDS. We analyzed its performance in terms of various performance metrics in detail. Furthermore, the three heuristics defence strategies, i.e., Adversarial Training (AT), Gaussian Data Augmentation (GDA) and High Confidence (HC), are implemented to improve the NIDS robustness under adversarial attack situations. The complete workflow is demonstrated in real-time network with data packet flow. This research work provides the overall background for the researchers interested in AML and its implementation from a computer network security point of view.


title: Continual Test-time Domain Adaptation via Dynamic Sample Selection

abstract: The objective of Continual Test-time Domain Adaptation (CTDA) is to gradually adapt a pre-trained model to a sequence of target domains without accessing the source data. This paper proposes a Dynamic Sample Selection (DSS) method for CTDA. DSS consists of dynamic thresholding, positive learning, and negative learning processes. Traditionally, models learn from unlabeled unknown environment data and equally rely on all samples' pseudo-labels to update their parameters through self-training. However, noisy predictions exist in these pseudo-labels, so all samples are not equally trustworthy. Therefore, in our method, a dynamic thresholding module is first designed to select suspected low-quality from high-quality samples. The selected low-quality samples are more likely to be wrongly predicted. Therefore, we apply joint positive and negative learning on both high- and low-quality samples to reduce the risk of using wrong information. We conduct extensive experiments that demonstrate the effectiveness of our proposed method for CTDA in the image domain, outperforming the state-of-the-art results. Furthermore, our approach is also evaluated in the 3D point cloud domain, showcasing its versatility and potential for broader applicability.


title: Open Strange and Open Heavy Flavour mesons in Asymmetric Nuclear Matter within Quark Meson Coupling model

abstract: The in-medium properties of open strange ($K$, $\bar{K}$), open charm ($D$, $\bar{D}$), and open bottom ($B$, $\bar{B}$) mesons are investigated in asymmetric nuclear matter using Quark Meson Coupling (QMC) model. A direct coupling of scalar ($\sigma$, $\delta$) and vector ($\omega$, $\rho$) mesons to the light quarks and anti-quarks of these mesons give rise to the in-medium modification of the properties of the corresponding meson within the model. The inclusion of the $\delta$ (scalar iso-vector) meson breaks the isospin symmetry for the masses of the light quark and antiquark doublets, causing mass splitting between ($u,\;d$) as well as ($\bar{d},\;\bar{u}$). Consequently, the considered mesons exhibit mass splittings within the isodoublets of $K$, $\bar{K}$, $D$, $\bar{D}$, $B$ and $\bar{B}$ mesons when embedded in asymmetric nuclear matter. In the current study, the interactions of the pseudoscalar meson with the scalar, as well as vector mesons, are considered, which lead to significant medium modifications of the excitation energies of the open strange (charm and bottom) mesons. In asymmetric nuclear matter, due to the interaction of the pseudoscalar meson with the vector iso-vector $\rho$ meson, there is a splitting in the excitation energies of the mesons within the isospin doublets. The isospin effects are seen to be large for high baryon densities. This study can have significant observable consequences, such as in the production ratios, e.g., $K^+/K^0$, $K^-/\bar {K^0}$, $D^+/D^0$, $D^-/\bar{D}^0$, $B^+/B^0$ and $B^-/\bar{B}^0$ in the upcoming heavy ion collision experiments at FAIR project at GSI, where the experiments are planned to be performed using neutron-rich beams to study the compressed baryonic matter.


title: Denoising Diffusion Step-aware Models

abstract: Denoising Diffusion Probabilistic Models (DDPMs) have garnered popularity for data generation across various domains. However, a significant bottleneck is the necessity for whole-network computation during every step of the generative process, leading to high computational overheads. This paper presents a novel framework, Denoising Diffusion Step-aware Models (DDSM), to address this challenge. Unlike conventional approaches, DDSM employs a spectrum of neural networks whose sizes are adapted according to the importance of each generative step, as determined through evolutionary search. This step-wise network variation effectively circumvents redundant computational efforts, particularly in less critical steps, thereby enhancing the efficiency of the diffusion model. Furthermore, the step-aware design can be seamlessly integrated with other efficiency-geared diffusion models such as DDIMs and latent diffusion, thus broadening the scope of computational savings. Empirical evaluations demonstrate that DDSM achieves computational savings of 49% for CIFAR-10, 61% for CelebA-HQ, 59% for LSUN-bedroom, 71% for AFHQ, and 76% for ImageNet, all without compromising the generation quality.


title: Wavelet transforms of microlensing data: Denoising, extracting intrinsic pulsations, and planetary signals

abstract: Wavelets are waveform functions that describe transient and unstable variations, such as noises. In this work, we study the advantages of discrete and continuous wavelet transforms (DWT and CWT) of microlensing data to denoise them and extract their planetary signals and intrinsic pulsations hidden by noises. We first generate synthetic microlensing data and apply wavelet denoising to them. For these simulated microlensing data with ideally Gaussian nosies based on the OGLE photometric accuracy, denoising with DWT reduces standard deviations of data from real models by $0.044$-$0.048$ mag. The efficiency to regenerate real models and planetary signals with denoised data strongly depends on the observing cadence and decreases from $37\%$ to $0.01\%$ by worsening cadence from $15$ min to $6$ hrs. We then apply denoising on $100$ microlensing events discovered by the OGLE group. On average, wavelet denoising for these data improves standard deviations and $\chi^{2}_{\rm n}$ of data with respect to the best-fitted models by $0.023$ mag, and $1.16$, respectively. The best-performing wavelets (based on either the highest signal-to-noise ratio's peak ($\rm{SNR}_{\rm{max}}$), or the highest Pearson's correlation, or the lowest Root Mean Squared Error (RMSE) for denoised data) are from 'Symlet', and 'Biorthogonal' wavelets families in simulated, and OGLE data, respectively. In some denoised data, intrinsic stellar pulsations or small planetary-like deviations appear which were covered with noises in raw data. However, through DWT denoising rather flattened and wide planetary signals could be reconstructed than sharp signals. CWT and 3D frequency-power-time maps could advise about the existence of sharp signals.


title: Probabilistic Forecasting of Day-Ahead Electricity Prices and their Volatility with LSTMs

abstract: Accurate forecasts of electricity prices are crucial for the management of electric power systems and the development of smart applications. European electricity prices have risen substantially and became highly volatile after the Russian invasion of Ukraine, challenging established forecasting methods. Here, we present a Long Short-Term Memory (LSTM) model for the German-Luxembourg day-ahead electricity prices addressing these challenges. The recurrent structure of the LSTM allows the model to adapt to trends, while the joint prediction of both mean and standard deviation enables a probabilistic prediction. Using a physics-inspired approach - superstatistics - to derive an explanation for the statistics of prices, we show that the LSTM model faithfully reproduces both prices and their volatility.


title: Constant rank subspaces of alternating bilinear forms from Galois Theory

abstract: Let $L/K$ be a cyclic extension of degree $n = 2m$. It is known that the space $\text{Alt}_K(L)$ of alternating $K$-bilinear forms (skew-forms) on $L$ decomposes into a direct sum of $K$-subspaces $A^{\sigma^i}$ indexed by the elements of $\text{Gal}(L/K) = \langle \sigma \rangle$. It is also known that the components $A^{\sigma^i}$ can have nice constant-rank properties. We enhance and enrich these constant-rank results and show that the component $A^\sigma$ often decomposes directly into a sum of constant rank subspaces, that is, subspaces all of whose non-zero skew-forms have a fixed rank $r$. In particular, this is always true when $-1 \not \in L^2$. As a result we deduce a decomposition of $\text{Alt}_K(L)$ into subspaces of constant rank in several interesting situations. We also establish that a subspace of dimension $\frac{n}{2}$ all of whose nonzero skew-forms are non-degenerate can always be found in $A^{\sigma^i}$ where $\sigma^i$ has order divisible by $2$.


title: Fermionic Quantum Turbulence: Pushing the Limits of High-Performance Computing

abstract: Ultracold atoms provide a platform for analog quantum computer capable of simulating the quantum turbulence that underlies puzzling phenomena like pulsar glitches in rapidly spinning neutron stars. Unlike other platforms like liquid helium, ultracold atoms have a viable theoretical framework for dynamics, but simulations push the edge of current classical computers. We present the largest simulations of fermionic quantum turbulence to date and explain the computing technology needed, especially improvements in the ELPA library that enable us to diagonalize matrices of record size (millions by millions). We quantify how dissipation and thermalization proceed in fermionic quantum turbulence by using the internal structure of vortices as a new probe of the local effective temperature. All simulation data and source codes are made available to facilitate rapid scientific progress in the field of ultracold Fermi gases.


title: LESSON: Learning to Integrate Exploration Strategies for Reinforcement Learning via an Option Framework

abstract: In this paper, a unified framework for exploration in reinforcement learning (RL) is proposed based on an option-critic model. The proposed framework learns to integrate a set of diverse exploration strategies so that the agent can adaptively select the most effective exploration strategy over time to realize a relevant exploration-exploitation trade-off for each given task. The effectiveness of the proposed exploration framework is demonstrated by various experiments in the MiniGrid and Atari environments.


title: An exactly solvable asymmetric $K$-exclusion process

abstract: We study an interacting particle process on a finite ring with $L$ sites with at most $K$ particles per site, in which particles hop to nearest neighbors with rates given in terms of $t$-deformed integers and asymmetry parameter $q$, where $t>0$ and $q \geq 0$ are parameters. This model, which we call the $(q, t)$~$K$-ASEP, reduces to the usual ASEP on the ring when $K = 1$ and to a model studied by Sch\"utz and Sandow (\emph{Phys. Rev. E}, 1994) when $t = q = 1$. This is a special case of the misanthrope process and as a consequence, the steady state does not depend on $q$ and is of product form, generalizing the same phenomena for the ASEP. What is interesting here is the steady state weights are given by explicit formulas involving $t$-binomial coefficients, and are palindromic polynomials in $t$. Interestingly, although the $(q, t)$~$K$-ASEP does not satisfy particle-hole symmetry, its steady state does. We analyze the density and calculate the most probable number of particles at a site in the steady state in various regimes of $t$. Lastly, we construct a two-dimensional exclusion process on a discrete cylinder with height $K$ and circumference $L$ which projects to the $(q, t)$~$K$-ASEP and whose steady state distribution is also of product form. We believe this model will serve as an illustrative example in constructing two-dimensional analogues of misanthrope processes. Simulations are attached as ancillary files.


title: Generalized Benders Decomposition with Continual Learning for Hybrid Model Predictive Control in Dynamic Environment

abstract: Hybrid model predictive control (MPC) with both continuous and discrete variables is widely applicable to robotic control tasks, especially those involving contact with the environment. Due to the combinatorial complexity, the solving speed of hybrid MPC can be insufficient for real-time applications. In this paper, we proposed a hybrid MPC solver based on Generalized Benders Decomposition (GBD) with continual learning. The algorithm accumulates cutting planes from the invariant dual space of the subproblems. After a short cold-start phase, the accumulated cuts provide warm-starts for the new problem instances to increase the solving speed. Despite the randomly changing environment that the control is unprepared for, the solving speed maintains. We verified our solver on controlling a cart-pole system with randomly moving soft contact walls and show that the solving speed is 2-3 times faster than the off-the-shelf solver Gurobi.


title: Eukaryotic swimming cells are shaped by hydrodynamic constraints

abstract: Eukaryotic swimming cells such as spermatozoa, algae or protozoa use flagella or cilia to move in viscous fluids. The motion of their flexible appendages in the surrounding fluid induces propulsive forces that balance with the viscous drag on the cells and lead to a directed swimming motion. Here, we use our recently built database of cell motility (BOSO-Micro) to investigate the extent to which the shapes of eukaryotic swimming cells may be optimal from a hydrodynamic standpoint. We first examine the morphology of flexible flagella undergoing waving deformation and show that their amplitude-to-wavelength ratio is near the one predicted theoretically to optimise the propulsive efficiency of active filaments. Next, we consider ciliates, for which locomotion is induced by the collective beating of short cilia covering their surface. We show that the aspect ratio of ciliates are close to the one predicted to minimise the viscous drag of the cell body. Both results strongly suggest a key role played by hydrodynamic constraints, in particular viscous drag, in shaping eukaryotic swimming cells.


title: Combining Datasets with Different Label Sets for Improved Nucleus Segmentation and Classification

abstract: Segmentation and classification of cell nuclei in histopathology images using deep neural networks (DNNs) can save pathologists' time for diagnosing various diseases, including cancers, by automating cell counting and morphometric assessments. It is now well-known that the accuracy of DNNs increases with the sizes of annotated datasets available for training. Although multiple datasets of histopathology images with nuclear annotations and class labels have been made publicly available, the set of class labels differ across these datasets. We propose a method to train DNNs for instance segmentation and classification on multiple datasets where the set of classes across the datasets are related but not the same. Specifically, our method is designed to utilize a coarse-to-fine class hierarchy, where the set of classes labeled and annotated in a dataset can be at any level of the hierarchy, as long as the classes are mutually exclusive. Within a dataset, the set of classes need not even be at the same level of the class hierarchy tree. Our results demonstrate that segmentation and classification metrics for the class set used by the test split of a dataset can improve by pre-training on another dataset that may even have a different set of classes due to the expansion of the training set enabled by our method. Furthermore, generalization to previously unseen datasets also improves by combining multiple other datasets with different sets of classes for training. The improvement is both qualitative and quantitative. The proposed method can be adapted for various loss functions, DNN architectures, and application domains.


title: Razumikhin-type ISS Lyapunov function and small gain theorem for discrete time time-delay systems with application to a biased min-consensus protocol

abstract: This paper considers small gain theorems for the global asymptotic and exponential input-to-state stability for discrete time time-delay systems using Razumikhin-type Lyapunov function. Among other things, unlike the existing literature, it provides both necessary and sufficient conditions for exponential input-to-state stability in terms of the Razumikhin-type Lyapunov function and the small gain theorem. Previous necessary ad sufficient conditions were with the more computationally onerous, Krasovskii-type Lyapunov functions. The result finds application in the robust stability analysis of a graph-based distributed algorithm, namely, the biased min-consensus protocol, which can be used to compute the length of the shortest path from each node to its nearest source in a graph. We consider the biased min-consensus protocol under perturbations that are common in communication networks, including noise, delay and asynchronous communication. By converting such a perturbed protocol into a discrete time time-delay nonlinear system, we prove its exponential input-to-state stability under perturbations using our Razumikhin-type Lyapunov-based small gain theorem. Simulations are provided to verify the theoretical results.


title: Boosting the Edelstein effect of two-dimensional electron gases by ferromagnetic exchange

abstract: Strontium titanate (SrTiO$_3$) two-dimensional electron gases (2DEGs) have broken spatial inversion symmetry and possess a finite Rashba spin-orbit coupling. This enables the interconversion of charge and spin currents through the direct and inverse Edelstein effects, with record efficiencies at low temperature, but more modest effects at room temperature. Here, we show that making these 2DEGs ferromagnetic enhances the conversion efficiency by nearly one order of magnitude. Starting from the experimental band structure of non-magnetic SrTiO$_3$ 2DEGs, we mimic magnetic exchange coupling by introducing an out-of-plane Zeeman term in a tight-binding model. We then calculate the band structure and spin textures for increasing internal magnetic fields and compute the Edelstein effect using a semiclassical Boltzmann approach. We find that the conversion efficiency first increases strongly with increasing magnetic field, then shows a maximum and finally decreases. This field dependence is caused by the competition of the exchange coupling with the effective Rashba interaction. While enhancing the splitting of band pairs amplifies the Edelstein effect, weakening the in-plane Rashba-type spin texture reduces it.


title: An Integrated Algorithm for Robust and Imperceptible Audio Adversarial Examples

abstract: Audio adversarial examples are audio files that have been manipulated to fool an automatic speech recognition (ASR) system, while still sounding benign to a human listener. Most methods to generate such samples are based on a two-step algorithm: first, a viable adversarial audio file is produced, then, this is fine-tuned with respect to perceptibility and robustness. In this work, we present an integrated algorithm that uses psychoacoustic models and room impulse responses (RIR) in the generation step. The RIRs are dynamically created by a neural network during the generation process to simulate a physical environment to harden our examples against transformations experienced in over-the-air attacks. We compare the different approaches in three experiments: in a simulated environment and in a realistic over-the-air scenario to evaluate the robustness, and in a human study to evaluate the perceptibility. Our algorithms considering psychoacoustics only or in addition to the robustness show an improvement in the signal-to-noise ratio (SNR) as well as in the human perception study, at the cost of an increased word error rate (WER).


title: Large Eddy Simulation of Non-stationary Hurricane Boundary Layer Winds

abstract: Recent extreme tropical cyclones caused extensive damages to critical civil infrastructure globally. To better capture the unique hurricane wind characteristics, a large eddy simulation (LES) Hurricane Boundary Layer (HBL) model is developed by considering the variation of meso-scale kinematic and thermodynamic conditions. An asymmetric model is adopted to obtain the gradient wind velocity using the National Hurricane Center data. The meso-scale thermal conditions are obtained by extracting the hourly air temperature and relative humidity profiles from generated proxy soundings. Measurements recorded at the Aransas County airport during Hurricane Harvey and that at the City of Naples during Irma are used to validate the developed LES model. Research results show that the simulated 10-minute average wind speed and direction are consistent with the observations. The developed model can well predict the high wind turbulences, which are around 20% in Hurricane Harvey and 26% in Hurricane Irma. The 3-s gust wind speeds reach 62.4 m/s at 10-m elevation during Hurricane Harvey and 53.5 m/s at 15-m elevation during Hurricane Irma, close to the field observed data of 61.3 m/s and 54.2 m/s, respectively. The simulated 3-s gust factors are close to the observation except at some moments with significant variations because of the poorly understood physical phenomena. The simulated wind spectrum in longitudinal and lateral directions agrees well with the observed results. In summary, the developed LES-based HBL model can capture the main characteristics of hurricane structure and turbulence characteristics and is applicable for modeling civil infrastructure exposed to hurricanes.


title: Efficiently analyzing large patient registries with Bayesian joint models for longitudinal and time-to-event data

abstract: The joint modeling of longitudinal and time-to-event outcomes has become a popular tool in follow-up studies. However, fitting Bayesian joint models to large datasets, such as patient registries, can require extended computing times. To speed up sampling, we divided a patient registry dataset into subsamples, analyzed them in parallel, and combined the resulting Markov chain Monte Carlo draws into a consensus distribution. We used a simulation study to investigate how different consensus strategies perform with joint models. In particular, we compared grouping all draws together with using equal- and precision-weighted averages. We considered scenarios reflecting different sample sizes, numbers of data splits, and processor characteristics. Parallelization of the sampling process substantially decreased the time required to run the model. We found that the weighted-average consensus distributions for large sample sizes were nearly identical to the target posterior distribution. The proposed algorithm has been made available in an R package for joint models, JMbayes2. This work was motivated by the clinical interest in investigating the association between ppFEV1, a commonly measured marker of lung function, and the risk of lung transplant or death, using data from the US Cystic Fibrosis Foundation Patient Registry (35,153 individuals with 372,366 years of cumulative follow-up). Splitting the registry into five subsamples resulted in an 85\% decrease in computing time, from 9.22 to 1.39 hours. Splitting the data and finding a consensus distribution by precision-weighted averaging proved to be a computationally efficient and robust approach to handling large datasets under the joint modeling framework.


title: Tractable Bounding of Counterfactual Queries by Knowledge Compilation

abstract: We discuss the problem of bounding partially identifiable queries, such as counterfactuals, in Pearlian structural causal models. A recently proposed iterated EM scheme yields an inner approximation of those bounds by sampling the initialisation parameters. Such a method requires multiple (Bayesian network) queries over models sharing the same structural equations and topology, but different exogenous probabilities. This setup makes a compilation of the underlying model to an arithmetic circuit advantageous, thus inducing a sizeable inferential speed-up. We show how a single symbolic knowledge compilation allows us to obtain the circuit structure with symbolic parameters to be replaced by their actual values when computing the different queries. We also discuss parallelisation techniques to further speed up the bound computation. Experiments against standard Bayesian network inference show clear computational advantages with up to an order of magnitude of speed-up.


title: Deep Geometric Learning with Monotonicity Constraints for Alzheimer's Disease Progression

abstract: Alzheimer's disease (AD) is a devastating neurodegenerative condition that precedes progressive and irreversible dementia; thus, predicting its progression over time is vital for clinical diagnosis and treatment. Numerous studies have implemented structural magnetic resonance imaging (MRI) to model AD progression, focusing on three integral aspects: (i) temporal variability, (ii) incomplete observations, and (iii) temporal geometric characteristics. However, deep learning-based approaches regarding data variability and sparsity have yet to consider inherent geometrical properties sufficiently. The ordinary differential equation-based geometric modeling method (ODE-RGRU) has recently emerged as a promising strategy for modeling time-series data by intertwining a recurrent neural network and an ODE in Riemannian space. Despite its achievements, ODE-RGRU encounters limitations when extrapolating positive definite symmetric metrics from incomplete samples, leading to feature reverse occurrences that are particularly problematic, especially within the clinical facet. Therefore, this study proposes a novel geometric learning approach that models longitudinal MRI biomarkers and cognitive scores by combining three modules: topological space shift, ODE-RGRU, and trajectory estimation. We have also developed a training algorithm that integrates manifold mapping with monotonicity constraints to reflect measurement transition irreversibility. We verify our proposed method's efficacy by predicting clinical labels and cognitive scores over time in regular and irregular settings. Furthermore, we thoroughly analyze our proposed framework through an ablation study.


title: Fictitious Cross-Play: Learning Global Nash Equilibrium in Mixed Cooperative-Competitive Games

abstract: Self-play (SP) is a popular multi-agent reinforcement learning (MARL) framework for solving competitive games, where each agent optimizes policy by treating others as part of the environment. Despite the empirical successes, the theoretical properties of SP-based methods are limited to two-player zero-sum games. However, for mixed cooperative-competitive games where agents on the same team need to cooperate with each other, we can show a simple counter-example where SP-based methods cannot converge to a global Nash equilibrium (NE) with high probability. Alternatively, Policy-Space Response Oracles (PSRO) is an iterative framework for learning NE, where the best responses w.r.t. previous policies are learned in each iteration. PSRO can be directly extended to mixed cooperative-competitive settings by jointly learning team best responses with all convergence properties unchanged. However, PSRO requires repeatedly training joint policies from scratch till convergence, which makes it hard to scale to complex games. In this work, we develop a novel algorithm, Fictitious Cross-Play (FXP), which inherits the benefits from both frameworks. FXP simultaneously trains an SP-based main policy and a counter population of best response policies. The main policy is trained by fictitious self-play and cross-play against the counter population, while the counter policies are trained as the best responses to the main policy's past versions. We validate our method in matrix games and show that FXP converges to global NEs while SP methods fail. We also conduct experiments in a gridworld domain, where FXP achieves higher Elo ratings and lower exploitabilities than baselines, and a more challenging football game, where FXP defeats SOTA models with over 94% win rate.


title: A Note on the LogRank Conjecture in Communication Complexity

abstract: The LogRank conjecture of Lov\'asz and Saks from 1988 is the most famous open problem in the communication complexity theory. The statement is as follows: Suppose that two players intend to compute a Boolean function $f(x,y)$ when $x$ is known for the first and $y$ for the second player, and they may send and receive messages encoded with bits, then they can compute $f(x,y)$ with exchanging $(\log \rank (M_f))^c $ bits, where $M_f$ is a Boolean matrix, determined by function $f$. The problem is widely open and very popular, and it has resisted numerous attacks in the last 35 years. The best upper bound is still exponential in the bound of the conjecture. Unfortunately, we cannot prove the conjecture, but we present a communication protocol with $(\log \rank (M_f))^c $ bits, which computes a -- somewhat -- related quantity to $f(x,y)$. The relation is characterized by a representation of low-degree, multi-linear polynomials modulo composite numbers. This result of ours may help to settle this long-time open conjecture.


title: Two product formulas for counting successive vertex orderings

abstract: A vertex ordering of a graph $G$ is a bijection $\pi\colon\{1,\dots,|V(G)|\}\to V(G)$. It is successive if the induced subgraph $G[v_{\pi(1)},\dots,v_{\pi(k)}]$ is connected for each $k$. Lixing Fang, Hao Huang, J\'anos Pach, G\'abor Tardos, and Junchi Zuo [J. Comb. Theory A199 (2023), 105776] gave formulas for counting the number of successive vertex orderings for a class of graphs they called "fully regular," and conjectured that these formulas could be written as certain products involving differences or ratios of binomial coefficients in two cases: When the graph is the line graph $L(K_n^{(3)})$ of the complete $3$-uniform hypergraph, or when it is the line graph $L(K_{m,n}^{(1,2)})$ of a complete "bipartite" $3$-uniform hypergraph. In this paper, we confirm both of these conjectures.


title: Electromagnetic interaction models for Monte Carlo simulation of protons and alpha particles

abstract: Electromagnetic interactions of protons and alpha particles are modeled in a form that is suitable for Monte Carlo simulation of the transport of charged particles. The differential cross section (DCS) for elastic collisions with neutral atoms is expressed as the product of the DCS for collisions with the bare nucleus and a correction factor that accounts for the screening of the nuclear charge by the atomic electrons. The screening factor is obtained as the ratio of the DCS for scattering of the projectile by an atom with a point nucleus and the parameterized Dirac-Hartree-Fock-Slater (DHFS) electron density, calculated from the eikonal approximation, and the Rutherford DCS for collisions with the bare point nucleus. Inelastic collisions, which cause electronic excitations of the material, are described by means of the plane-wave Born approximation, with an empirical simple model of the generalized oscillator strength (GOS) that combines several extended oscillators with resonance energies and strengths determined from the atomic configurations and from the empirical mean excitation energy of the material. The contributions from inner subshells are renormalized to agree with realistic ionization cross sections calculated numerically from the DHFS self-consistent model of atoms by means of the plane-wave Born approximation. The resulting DCS allows analytical random sampling of individual hard inelastic interactions.


title: Enhancing Robust Representation in Adversarial Training: Alignment and Exclusion Criteria

abstract: Deep neural networks are vulnerable to adversarial noise. Adversarial Training (AT) has been demonstrated to be the most effective defense strategy to protect neural networks from being fooled. However, we find AT omits to learning robust features, resulting in poor performance of adversarial robustness. To address this issue, we highlight two criteria of robust representation: (1) Exclusion: \emph{the feature of examples keeps away from that of other classes}; (2) Alignment: \emph{the feature of natural and corresponding adversarial examples is close to each other}. These motivate us to propose a generic framework of AT to gain robust representation, by the asymmetric negative contrast and reverse attention. Specifically, we design an asymmetric negative contrast based on predicted probabilities, to push away examples of different classes in the feature space. Moreover, we propose to weight feature by parameters of the linear classifier as the reverse attention, to obtain class-aware feature and pull close the feature of the same class. Empirical evaluations on three benchmark datasets show our methods greatly advance the robustness of AT and achieve state-of-the-art performance.


title: Time-Optimal Trajectory Planning in Highway Scenarios using Basis-Spline Parameterization

abstract: Basis splines enable a time-continuous feasibility check with a finite number of constraints. Constraints apply to the whole trajectory for motion planning applications that require a collision-free and dynamically feasible trajectory. Existing motion planners that rely on gradient-based optimization apply time scaling to implement a shrinking planning horizon. They neither guarantee a recursively feasible trajectory nor enable reaching two terminal manifold parts at different time scales. This paper proposes a nonlinear optimization problem that addresses the drawbacks of existing approaches. Therefore, the spline breakpoints are included in the optimization variables. Transformations between spline bases are implemented so a sparse problem formulation is achieved. A strategy for breakpoint removal enables the convergence into a terminal manifold. The evaluation in an overtaking scenario shows the influence of the breakpoint number on the solution quality and the time required for optimization.


title: CSI: Enhancing the Robustness of 3D Point Cloud Recognition against Corruption

abstract: Despite recent advancements in deep neural networks for point cloud recognition, real-world safety-critical applications present challenges due to unavoidable data corruption. Current models often fall short in generalizing to unforeseen distribution shifts. In this study, we harness the inherent set property of point cloud data to introduce a novel critical subset identification (CSI) method, aiming to bolster recognition robustness in the face of data corruption. Our CSI framework integrates two pivotal components: density-aware sampling (DAS) and self-entropy minimization (SEM), which cater to static and dynamic CSI, respectively. DAS ensures efficient robust anchor point sampling by factoring in local density, while SEM is employed during training to accentuate the most salient point-to-point attention. Evaluations reveal that our CSI approach yields error rates of 18.4\% and 16.3\% on ModelNet40-C and PointCloud-C, respectively, marking a notable improvement over state-of-the-art methods by margins of 5.2\% and 4.2\% on the respective benchmarks. Code is available at \href{https://github.com/masterwu2115/CSI/tree/main}{https://github.com/masterwu2115/CSI/tree/main}


title: Measurement of $e^{+}e^{-}\rightarrow\eta J/\psi$ Cross Section from $\sqrt{s}=$ 3.808 GeV to 4.951 GeV

abstract: Using data samples with an integrated luminosity of 22.42 fb$^{-1}$ collected by the BESIII detector operating at the BEPCII storage ring, we measure the cross sections of the $e^{+}e^{-}\rightarrow\etaJ/\psi$ process at center-of-mass energies from 3.808 to 4.951 GeV. Three structures are observed in the line shape of the measured cross sections. A maximum-likelihood fit with $\psi(4040)$, two additional resonances, and a non-resonant component is performed. The mass and width of the first additional state are $(4219.7\pm2.5\pm4.5) \rm{MeV}/\rm{c}^2$ and $(80.7\pm4.4\pm1.4) \rm{MeV}$, respectively, consistent with the $\psi(4230)$. For the second state, the mass and width are $(4386\pm13\pm17) \rm{MeV}/\rm{c}^2$ and $(177\pm32\pm13) \rm{MeV}$, respectively, consistent with the $\psi(4360)$. The first uncertainties are statistical and the second ones are systematic. The statistical significance of $\psi(4040)$ is $8.0\sigma$ and those for $\psi(4230)$ and $\psi(4360)$ are more than $10.0\sigma$.


title: Inverter Pulse Width Modulation Control Techniques for Electric Motor Drive Systems

abstract: This paper provides a simple introduction to pulse width modulation control techniques used for the control of power converters in the context of electric motor drive systems. A summary of each technique is presented along with analytical models that provide intuitive insight and enable their rapid implementation for practical purposes.


title: Realistic Speech-to-Face Generation with Speech-Conditioned Latent Diffusion Model with Face Prior

abstract: Speech-to-face generation is an intriguing area of research that focuses on generating realistic facial images based on a speaker's audio speech. However, state-of-the-art methods employing GAN-based architectures lack stability and cannot generate realistic face images. To fill this gap, we propose a novel speech-to-face generation framework, which leverages a Speech-Conditioned Latent Diffusion Model, called SCLDM. To the best of our knowledge, this is the first work to harness the exceptional modeling capabilities of diffusion models for speech-to-face generation. Preserving the shared identity information between speech and face is crucial in generating realistic results. Therefore, we employ contrastive pre-training for both the speech encoder and the face encoder. This pre-training strategy facilitates effective alignment between the attributes of speech, such as age and gender, and the corresponding facial characteristics in the face images. Furthermore, we tackle the challenge posed by excessive diversity in the synthesis process caused by the diffusion model. To overcome this challenge, we introduce the concept of residuals by integrating a statistical face prior to the diffusion process. This addition helps to eliminate the shared component across the faces and enhances the subtle variations captured by the speech condition. Extensive quantitative, qualitative, and user study experiments demonstrate that our method can produce more realistic face images while preserving the identity of the speaker better than state-of-the-art methods. Highlighting the notable enhancements, our method demonstrates significant gains in all metrics on the AVSpeech dataset and Voxceleb dataset, particularly noteworthy are the improvements of 32.17 and 32.72 on the cosine distance metric for the two datasets, respectively.


title: Optimized Finite-Time Work Protocols for the Higgs RNA-Model

abstract: The Higgs RNA-Model is studied in regard to finite-time driving protocols with minimal-work requirement. In this paper, RNA sequences which at low temperature exhibits hairpins are considered, which are often cited as typical template systems in stochastic thermodynamics. The optimized work protocols for this glassy many-particle system are determined numerically using the parallel tempering method. The protocols show distinct jumps at the beginning and end, which have been observed previously already for single-particle systems. Counter intuitively, optimality seems to be achieved by staying close to the equilibrium unfolding transition point. The change of work distributions, compared to those resulting from a naive linear driving protocol, are discussed generally and in terms of free energy estimation as well as the effect of optimized protocols on rare work process starting conditions.


title: Swin-Tempo: Temporal-Aware Lung Nodule Detection in CT Scans as Video Sequences Using Swin Transformer-Enhanced UNet

abstract: Lung cancer is highly lethal, emphasizing the critical need for early detection. However, identifying lung nodules poses significant challenges for radiologists, who rely heavily on their expertise for accurate diagnosis. To address this issue, computer-aided diagnosis (CAD) systems based on machine learning techniques have emerged to assist doctors in identifying lung nodules from computed tomography (CT) scans. Unfortunately, existing networks in this domain often suffer from computational complexity, leading to high rates of false negatives and false positives, limiting their effectiveness. To address these challenges, we present an innovative model that harnesses the strengths of both convolutional neural networks and vision transformers. Inspired by object detection in videos, we treat each 3D CT image as a video, individual slices as frames, and lung nodules as objects, enabling a time-series application. The primary objective of our work is to overcome hardware limitations during model training, allowing for efficient processing of 2D data while utilizing inter-slice information for accurate identification based on 3D image context. We validated the proposed network by applying a 10-fold cross-validation technique to the publicly available Lung Nodule Analysis 2016 dataset. Our proposed architecture achieves an average sensitivity criterion of 97.84% and a competition performance metrics (CPM) of 96.0% with few parameters. Comparative analysis with state-of-the-art advancements in lung nodule identification demonstrates the significant accuracy achieved by our proposed model.


title: Elementary Properties of Free Lattices

abstract: We start a systematic analysis of the first-order model theory of free lattices. Firstly, we prove that the free lattices of finite rank are not positively indistinguishable, as there is a positive $\exists \forall$-sentence true in $\mathbf F_3$ and false in $\mathbf F_4$. Secondly, we show that every model of $\mathrm{Th}(\mathbf F_n)$ admits a canonical homomorphism into the profinite-bounded completion $\mathbf H_n$ of $\mathbf F_n$. Thirdly, we show that $\mathbf H_n$ is isomorphic to the Dedekind-MacNeille completion of $\mathbf F_n$, and that $\mathbf H_n$ is not positively elementarily equivalent to $\mathbf F_n$, as there is a positive $\forall\exists$-sentence true in $\mathbf H_n$ and false in $\mathbf F_n$. Finally, we show that $\mathrm{DM}(\mathbf F_n)$ is a retract of $\mathrm{Id}(\mathbf F_n)$ and that for any lattice $\mathbf K$ which satisfies Whitman's condition $\mathrm{(W)}$ and which is generated by join prime elements, the three lattices $\mathbf K$, $\mathrm{DM}(\mathbf K)$, and $\mathrm{Id}(\mathbf K)$ all share the same positive universal first-order theory.


title: A paraxial approach for the inverse problem of vibro-acoustic imaging in frequency domain

abstract: This paper presents a paraxial modeling approach for vibro-acoustography, a high-frequency ultrasound imaging technique that makes use of the excited low-frequency field to achieve a higher resolution while avoiding speckles. We start from a general second order wave equation, introduce a second order perturbation and make use of a paraxial change of variables to pass over to directed beams. Depending on the relation between the second order perturbation and the directivity of the beams this leads to different systems of PDEs that involve a spatially variable parameter governing the interaction of the incoming beams to generate the propagating acoustic field. We then consider the inverse problem of determining this parameter for one of these models where we present a Landweber-Kaczmarz reconstruction method to obtain a spatial image of the region of interest.


title: Evaluating Hallucinations in Chinese Large Language Models

abstract: In this paper, we establish a benchmark named HalluQA (Chinese Hallucination Question-Answering) to measure the hallucination phenomenon in Chinese large language models. HalluQA contains 450 meticulously designed adversarial questions, spanning multiple domains, and takes into account Chinese historical culture, customs, and social phenomena. During the construction of HalluQA, we consider two types of hallucinations: imitative falsehoods and factual errors, and we construct adversarial samples based on GLM-130B and ChatGPT. For evaluation, we design an automated evaluation method using GPT-4 to judge whether a model output is hallucinated. We conduct extensive experiments on 24 large language models, including ERNIE-Bot, Baichuan2, ChatGLM, Qwen, SparkDesk and etc. Out of the 24 models, 18 achieved non-hallucination rates lower than 50%. This indicates that HalluQA is highly challenging. We analyze the primary types of hallucinations in different types of models and their causes. Additionally, we discuss which types of hallucinations should be prioritized for different types of models.


title: The Injectivity Radius of Souls of Alexandrov Spaces

abstract: A sharp lower bound for the injectivity radius in noncompact nonnegatively curved Riemannian manifolds involving their soul goes back to \v{S}arafutdinov. We generalize this bound to the setting of Alexandrov spaces. Our main theorem reads as follows. If the injectivity radius of an Alexandrov space of nonnegative curvature does not coincide with the one of its souls, then it is at least $ \pi K^{-1/2} $, where $ K $ is an upper curvature bound. We introduce the soul of Alexandrov spaces in some detail and compare two notions of injectivity radii.


title: Motivating Next-Generation OS Physical Memory Management for Terabyte-Scale NVMMs

abstract: Software managed byte-addressable hybrid memory systems consisting of DRAMs and NVMMs offer a lot of flexibility to design efficient large scale data processing applications. Operating systems (OS) play an important role in enabling the applications to realize the integrated benefits of DRAMs' low access latency and NVMMs' large capacity along with its persistent characteristics. In this paper, we comprehensively analyze the performance of conventional OS physical memory management subsystems that were designed only based on the DRAM memory characteristics in the context of modern hybrid byte-addressable memory systems. To study the impact of high access latency and large capacity of NVMMs on physical memory management, we perform an extensive evaluation on Linux with Intel's Optane NVMM. We observe that the core memory management functionalities such as page allocation are negatively impacted by high NVMM media latency, while functionalities such as conventional fragmentation management are rendered inadequate. We also demonstrate that certain traditional memory management functionalities are affected by neither aspects of modern NVMMs. We conclusively motivate the need to overhaul fundamental aspects of traditional OS physical memory management in order to fully exploit terabyte-scale NVMMs.


title: Fundamental Limits of Distributed Optimization over Multiple Access Channel

abstract: We consider distributed optimization over a $d$-dimensional space, where $K$ remote clients send coded gradient estimates over an {\em additive Gaussian Multiple Access Channel (MAC)} with noise variance $\sigma_z^2$. Furthermore, the codewords from the clients must satisfy the average power constraint $P$, resulting in a signal-to-noise ratio (SNR) of $KP/\sigma_z^2$. In this paper, we study the fundamental limits imposed by MAC on the {convergence rate of any distributed optimization algorithm and design optimal communication schemes to achieve these limits.} Our first result is a lower bound for the convergence rate, showing that communicating over a MAC imposes a slowdown of $\sqrt{d/\frac{1}{2}\log(1+\SNR)}$ on any protocol compared to the centralized setting. Next, we design a computationally tractable {digital} communication scheme that matches the lower bound to a logarithmic factor in $K$ when combined with a projected stochastic gradient descent algorithm. At the heart of our communication scheme is carefully combining several compression and modulation ideas such as quantizing along random bases, {\em Wyner-Ziv compression}, {\em modulo-lattice decoding}, and {\em amplitude shift keying.} We also show that analog schemes, which are popular due to their ease of implementation, can give close to optimal convergence rates at low $\SNR$ but experience a slowdown of roughly $\sqrt{d}$ at high $\SNR$.


title: Some properties of n-matrix factorizations of polynomials

abstract: Let $R=K[x_{1},x_{2},\cdots, x_{m}]$ where $K$ is a field. In this paper, we give some properties of $n$-matrix factorizations of polynomials in $R$. We also derive some results giving some lower bounds on the number of $n$-matrix factors of polynomials. In particular, we give a lower bound on the number of matrix factors of minimal size for the sums of squares polynomial $f_{m}=x_{1}^{2}+\cdots + x_{m}^{2}$ for $m=8$.


title: Nanomechanical manipulation of superconducting charge-qubit quantum networks

abstract: We suggest a nanoelectromechanical setup and corresponding time-protocol for controlling parameters in order to demonstrate nanomechanical manipulation of superconducting charge-qubit quantum network. We illustrate it on an example reflecting important task for quantum information processing - transmission of quantum information between two charge-qubits facilitated by nanomechanics. The setup is based on terminals utilizing the AC Josephson effect between bias voltage-controlled bulk superconductors and mechanically vibrating mesoscopic superconducting grain in the regime of the Cooper pair box, controlled by the gate voltage. The described manipulation of quantum network is achieved by transduction of quantum information between charge-qubits and intentionally built nanomechanical coherent states, which facilitate its transmission between qubits. This performance is achieved using quantum entanglement between electrical and mechanical states.


title: Design Optimizer for Planar Soft-Growing Robot Manipulators

abstract: Soft-growing robots are innovative devices that feature plant-inspired growth to navigate environments. Thanks to their embodied intelligence of adapting to their surroundings and the latest innovation in actuation and manufacturing, it is possible to employ them for specific manipulation tasks. The applications of these devices include exploration of delicate/dangerous environments, manipulation of items, or assistance in domestic environments. This work presents a novel approach for design optimization of soft-growing robots, which will be used prior to manufacturing to suggest engineers -- or robot designer enthusiasts -- the optimal dimension of the robot to be built for solving a specific task. I modeled the design process as a multi-objective optimization problem, in which I optimize the kinematic chain of a soft manipulator to reach targets and avoid unnecessary overuse of material and resources. The method exploits the advantages of population-based optimization algorithms, in particular evolutionary algorithms, to transform the problem from multi-objective into a single-objective thanks to an efficient mathematical formulation, the novel rank-partitioning algorithm, and obstacle avoidance integrated within the optimizer operators. I tested the proposed method on different tasks to access its optimality, which showed significant performance in solving the problem. Finally, comparative experiments showed that the proposed method works better than the one existing in the literature in terms of precision, resource consumption, and run time.


title: Point-Based Radiance Fields for Controllable Human Motion Synthesis

abstract: This paper proposes a novel controllable human motion synthesis method for fine-level deformation based on static point-based radiance fields. Although previous editable neural radiance field methods can generate impressive results on novel-view synthesis and allow naive deformation, few algorithms can achieve complex 3D human editing such as forward kinematics. Our method exploits the explicit point cloud to train the static 3D scene and apply the deformation by encoding the point cloud translation using a deformation MLP. To make sure the rendering result is consistent with the canonical space training, we estimate the local rotation using SVD and interpolate the per-point rotation to the query view direction of the pre-trained radiance field. Extensive experiments show that our approach can significantly outperform the state-of-the-art on fine-level complex deformation which can be generalized to other 3D characters besides humans.


title: Procedural Text Mining with Large Language Models

abstract: Recent advancements in the field of Natural Language Processing, particularly the development of large-scale language models that are pretrained on vast amounts of knowledge, are creating novel opportunities within the realm of Knowledge Engineering. In this paper, we investigate the usage of large language models (LLMs) in both zero-shot and in-context learning settings to tackle the problem of extracting procedures from unstructured PDF text in an incremental question-answering fashion. In particular, we leverage the current state-of-the-art GPT-4 (Generative Pre-trained Transformer 4) model, accompanied by two variations of in-context learning that involve an ontology with definitions of procedures and steps and a limited number of samples of few-shot learning. The findings highlight both the promise of this approach and the value of the in-context learning customisations. These modifications have the potential to significantly address the challenge of obtaining sufficient training data, a hurdle often encountered in deep learning-based Natural Language Processing techniques for procedure extraction.


title: ACT-Net: Anchor-context Action Detection in Surgery Videos

abstract: Recognition and localization of surgical detailed actions is an essential component of developing a context-aware decision support system. However, most existing detection algorithms fail to provide high-accuracy action classes even having their locations, as they do not consider the surgery procedure's regularity in the whole video. This limitation hinders their application. Moreover, implementing the predictions in clinical applications seriously needs to convey model confidence to earn entrustment, which is unexplored in surgical action prediction. In this paper, to accurately detect fine-grained actions that happen at every moment, we propose an anchor-context action detection network (ACTNet), including an anchor-context detection (ACD) module and a class conditional diffusion (CCD) module, to answer the following questions: 1) where the actions happen; 2) what actions are; 3) how confidence predictions are. Specifically, the proposed ACD module spatially and temporally highlights the regions interacting with the extracted anchor in surgery video, which outputs action location and its class distribution based on anchor-context interactions. Considering the full distribution of action classes in videos, the CCD module adopts a denoising diffusion-based generative model conditioned on our ACD estimator to further reconstruct accurately the action predictions. Moreover, we utilize the stochastic nature of the diffusion model outputs to access model confidence for each prediction. Our method reports the state-of-the-art performance, with improvements of 4.0% mAP against baseline on the surgical video dataset.


title: Machine learning the interaction network in coupled dynamical systems

abstract: The study of interacting dynamical systems continues to attract research interest in various fields of science and engineering. In a collection of interacting particles, the interaction network contains information about how various components interact with one another. Inferring the information about the interaction network from the dynamics of agents is a problem of long-standing interest. In this work, we employ a self-supervised neural network model to achieve two outcomes: to recover the interaction network and to predict the dynamics of individual agents. Both these information are inferred solely from the observed trajectory data. This work presents an application of the Neural Relational Inference model to two dynamical systems: coupled particles mediated by Hooke's law interaction and coupled phase (Kuramoto) oscillators.


title: Safe Reinforcement Learning via Hierarchical Adaptive Chance-Constraint Safeguards

abstract: Ensuring safety in Reinforcement Learning (RL), typically framed as a Constrained Markov Decision Process (CMDP), is crucial for real-world exploration applications. Current approaches in handling CMDP struggle to balance optimality and feasibility, as direct optimization methods cannot ensure state-wise in-training safety, and projection-based methods correct actions inefficiently through lengthy iterations. To address these challenges, we propose Adaptive Chance-constrained Safeguards (ACS), an adaptive, model-free safe RL algorithm using the safety recovery rate as a surrogate chance constraint to iteratively ensure safety during exploration and after achieving convergence. Theoretical analysis indicates that the relaxed probabilistic constraint sufficiently guarantees forward invariance to the safe set. And extensive experiments conducted on both simulated and real-world safety-critical tasks demonstrate its effectiveness in enforcing safety (nearly zero-violation) while preserving optimality (+23.8%), robustness, and fast response in stochastic real-world settings.


title: StegGuard: Fingerprinting Self-supervised Pre-trained Encoders via Secrets Embeder and Extractor

abstract: In this work, we propose StegGuard, a novel fingerprinting mechanism to verify the ownership of the suspect pre-trained encoder using steganography. A critical perspective in StegGuard is that the unique characteristic of the transformation from an image to an embedding, conducted by the pre-trained encoder, can be equivalently exposed how an embeder embeds secrets into images and how an extractor extracts the secrets from encoder's embeddings with a tolerable error after the secrets are subjected to the encoder's transformation. While each independent encoder has a distinct transformation, the piracy encoder has a similar transformation to the victim. Based on these, we learn a pair of secrets embeder and extractor as the fingerprint for the victim encoder. We introduce a frequency-domain channel attention embedding block into the embeder to adaptively embed secrets into suitable frequency bands. During verification, if the secrets embedded into the query images can be extracted with an acceptable error from the suspect encoder's embeddings, the suspect encoder is determined as piracy, otherwise independent. Extensive experiments demonstrate that depending on a very limited number of query images, StegGuard can reliably identify across varied independent encoders, and is robust against model stealing related attacks including model extraction, fine-tuning, pruning, embedding noising and shuffle.


title: Learning Trivializing Flows in a $\phi^4$ theory from coarser lattices

abstract: The so-called trivializing flows were proposed to speed up Hybrid Monte Carlo simulations, where the Wilson flow was used as an approximation of a trivializing map, a transformation of the gauge fields which trivializes the theory. It was shown that the scaling of the computational costs towards the continuum did not change with respect to HMC. The introduction of machine learning tecniques, especially normalizing flows, for the sampling of lattice gauge theories has shed some hope on solving topology freezing in lattice QCD simulations. In this talk I will present our work in a $\phi^{4}$ theory using normalizing flows as trivializing flows (given its similarity with the idea of a trivializing map), training from a trivial distribution as well as from coarser lattices, and study its scaling towards the continuum, comparing it with standard HMC.


title: Maximal line-free sets in $\mathbb{F}_p^n$

abstract: We study subsets of $\mathbb{F}_p^n$ that do not contain progressions of length $k$. We denote by $r_k(\mathbb{F}_p^n)$ the cardinality of such subsets containing a maximal number of elements. In this paper we focus on the case $k=p$ and therefore sets containing no full line. A~trivial lower bound $r_p(\mathbb{F}_p^n)\geq(p-1)^n$ is achieved by a hypercube of side length $p-1$ and it is known that equality holds for $n\in\{1,2\}$. We will however show that $r_p(\mathbb{F}_p^3)\geq (p-1)^3+p-2\sqrt{p}$, which is the first improvement in the three dimensional case that is increasing in $p$. We will also give the upper bound $r_p(\mathbb{F}_p^{3})\leq p^3-2p^2-(\sqrt{2}-1)p+2$ as well as generalizations for higher dimensions. Finally we present some bounds for individual $p$ and $n$, in particular $r_5(\mathbb{F}_5^{3})\geq 70$ and $r_7(\mathbb{F}_7^{3})\geq 225$ which can be used to give the asymptotic lower bound $4.121^n$ for $r_5(\mathbb{F}_5^{n})$ and $6.082^n$ for $r_7(\mathbb{F}_7^{n})$.


title: Similarity Between Two Dynamical Systems

abstract: The main focus of this paper is to explore how much similarity between two dynamical systems. Analogous to the classical Hartman-Grobman theorem, the relationship between two systems can be linked by a homeomorphic map $K$, and the core is to study the minimizer $K^*$ to measure the degree of similarity. We prove the sufficient conditions and necessary conditions (the maximum principle) for the existence of the minimizer $K^*$. Further, we establish similarity theorem based on the Takens embedding theorem. As applications, Lorenz system, Chua's circuit system and Chen's system are simulated and tested. The results illustrate what is the similarity, which extends the conjugacy in dynamical systems.


title: Complex-valued universal linear transformations and image encryption using spatially incoherent diffractive networks

abstract: As an optical processor, a Diffractive Deep Neural Network (D2NN) utilizes engineered diffractive surfaces designed through machine learning to perform all-optical information processing, completing its tasks at the speed of light propagation through thin optical layers. With sufficient degrees-of-freedom, D2NNs can perform arbitrary complex-valued linear transformations using spatially coherent light. Similarly, D2NNs can also perform arbitrary linear intensity transformations with spatially incoherent illumination; however, under spatially incoherent light, these transformations are non-negative, acting on diffraction-limited optical intensity patterns at the input field-of-view (FOV). Here, we expand the use of spatially incoherent D2NNs to complex-valued information processing for executing arbitrary complex-valued linear transformations using spatially incoherent light. Through simulations, we show that as the number of optimized diffractive features increases beyond a threshold dictated by the multiplication of the input and output space-bandwidth products, a spatially incoherent diffractive visual processor can approximate any complex-valued linear transformation and be used for all-optical image encryption using incoherent illumination. The findings are important for the all-optical processing of information under natural light using various forms of diffractive surface-based optical processors.


title: Structural transformation of dusty plasma crystal in DC discharge plasma by changing confinement ring bias

abstract: We report the experimental study of the structural transition of a stable complex plasma crystal to a solid-liquid phase coexistence by the controlled adjustment of the confinement potential, while keeping all other parameters constant. The experiments are carried out in a tabletop Linear Dusty Plasma Experimental (LDPEx) device which consists of a circular powered electrode and an extended grounded cathode plate. A stationary crystal of melamine formaldehyde particles is formed in a background of Argon plasma inside a confining ring that is isolated to the cathode by a ceramic cover. The stable crystal structure breaks in the core region and transitions to a coexistent state by carefully changing the confining potential, thereby modifying the sheath structure. The transition is confirmed by evaluating the variation in different characteristic parameters such as the pair correlation function, local bond order parameter, and dust kinetic temperature as a function of confining bias potential. It is found that melting in the core is due to the onset of dust fluctuations in the layers beneath the topmost layer, which grow in amplitude as the confining bias potential is reduced below a threshold value. The present technique of changing confinement provides a unique feature to study structural transitions of plasma crystals without affecting the overall plasma parameters.


title: Large-Scale Bottom-Up Fabricated 3D Nonlinear Photonic Crystals

abstract: Nonlinear optical effects are used to generate coherent light at wavelengths difficult to reach with lasers. Materials periodically poled or nanostructured in the nonlinear susceptibility in three spatial directions are called 3D nonlinear photonic crystals (NPhCs). They enable enhanced nonlinear optical conversion efficiencies, emission control, and simultaneous generation of nonlinear wavelengths. The chemical inertness of efficient second-order nonlinear materials ($\chi^{(2)}$) prohibited their nanofabrication until 2018. The current method is restricted to top-down laser-based techniques limiting the periodicity along z-axis to 10 um. We demonstrate the first bottom-up fabricated 3D NPhC in sol-gel derived barium titanate by soft-nanoimprint lithography: a woodpile with eight layers and periodicities of 1 um (xy-plane) and 300 nm (z-plane). The surface areas exceed $5.3\cdot 10^4$ um^2, which is two orders of magnitude larger than the state-of-the-art. This study is expected to initiate bottom-up fabrication of 3D NPhCs with a supremely strong and versatile nonlinear response.


title: Ideal structure of Nica-Toeplitz algebras

abstract: We study the gauge-invariant ideal structure of the Nica-Toeplitz algebra $\mathcal{NT}(X)$ of a product system $(A, X)$ over $\mathbb{N}^n$. We obtain a clear description of $X$-invariant ideals in $A$, that is, restrictions of gauge-invariant ideals in $\mathcal{NT}(X)$ to $A$. The main result is a classification of gauge-invariant ideals in $\mathcal{NT}(X)$ for a proper product system in terms of families of ideals in $A$. We also apply our results to higher-rank graphs.


title: OpenPatch: a 3D patchwork for Out-Of-Distribution detection

abstract: Moving deep learning models from the laboratory setting to the open world entails preparing them to handle unforeseen conditions. In several applications the occurrence of novel classes during deployment poses a significant threat, thus it is crucial to effectively detect them. Ideally, this skill should be used when needed without requiring any further computational training effort at every new task. Out-of-distribution detection has attracted significant attention in the last years, however the majority of the studies deal with 2D images ignoring the inherent 3D nature of the real-world and often confusing between domain and semantic novelty. In this work, we focus on the latter, considering the objects geometric structure captured by 3D point clouds regardless of the specific domain. We advance the field by introducing OpenPatch that builds on a large pre-trained model and simply extracts from its intermediate features a set of patch representations that describe each known class. For any new sample, we obtain a novelty score by evaluating whether it can be recomposed mainly by patches of a single known class or rather via the contribution of multiple classes. We present an extensive experimental evaluation of our approach for the task of semantic novelty detection on real-world point cloud samples when the reference known data are synthetic. We demonstrate that OpenPatch excels in both the full and few-shot known sample scenarios, showcasing its robustness across varying pre-training objectives and network backbones. The inherent training-free nature of our method allows for its immediate application to a wide array of real-world tasks, offering a compelling advantage over approaches that need expensive retraining efforts.


title: Generalizing Ovchinnikovs Theorem

abstract: This note is an (exact) copy of the report of Jaak Peetre, "Generalizing Ovchinnikov's Theorem". Published as Technical Report, Lund (1981). Some more recent general references have been added, some references updated though (in italics) and some misprints corrected.