title: Segment Anything Model Meets Image Harmonization

abstract: Image harmonization is a crucial technique in image composition that aims to seamlessly match the background by adjusting the foreground of composite images. Current methods adopt either global-level or pixel-level feature matching. Global-level feature matching ignores the proximity prior, treating foreground and background as separate entities. On the other hand, pixel-level feature matching loses contextual information. Therefore, it is necessary to use the information from semantic maps that describe different objects to guide harmonization. In this paper, we propose Semantic-guided Region-aware Instance Normalization (SRIN) that can utilize the semantic segmentation maps output by a pre-trained Segment Anything Model (SAM) to guide the visual consistency learning of foreground and background features. Abundant experiments demonstrate the superiority of our method for image harmonization over state-of-the-art methods.


title: A Closer Look at the Few-Shot Adaptation of Large Vision-Language Models

abstract: Efficient transfer learning (ETL) is receiving increasing attention to adapt large pre-trained language-vision models on downstream tasks with a few labeled samples. While significant progress has been made, we reveal that state-of-the-art ETL approaches exhibit strong performance only in narrowly-defined experimental setups, and with a careful adjustment of hyperparameters based on a large corpus of labeled samples. In particular, we make two interesting, and surprising empirical observations. First, to outperform a simple Linear Probing baseline, these methods require to optimize their hyper-parameters on each target task. And second, they typically underperform -- sometimes dramatically -- standard zero-shot predictions in the presence of distributional drifts. Motivated by the unrealistic assumptions made in the existing literature, i.e., access to a large validation set and case-specific grid-search for optimal hyperparameters, we propose a novel approach that meets the requirements of real-world scenarios. More concretely, we introduce a CLass-Adaptive linear Probe (CLAP) objective, whose balancing term is optimized via an adaptation of the general Augmented Lagrangian method tailored to this context. We comprehensively evaluate CLAP on a broad span of datasets and scenarios, demonstrating that it consistently outperforms SoTA approaches, while yet being a much more efficient alternative.


title: Robustly Improving Bandit Algorithms with Confounded and Selection Biased Offline Data: A Causal Approach

abstract: This paper studies bandit problems where an agent has access to offline data that might be utilized to potentially improve the estimation of each arm's reward distribution. A major obstacle in this setting is the existence of compound biases from the observational data. Ignoring these biases and blindly fitting a model with the biased data could even negatively affect the online learning phase. In this work, we formulate this problem from a causal perspective. First, we categorize the biases into confounding bias and selection bias based on the causal structure they imply. Next, we extract the causal bound for each arm that is robust towards compound biases from biased observational data. The derived bounds contain the ground truth mean reward and can effectively guide the bandit agent to learn a nearly-optimal decision policy. We also conduct regret analysis in both contextual and non-contextual bandit settings and show that prior causal bounds could help consistently reduce the asymptotic regret.


title: Strassen's Matrix Multiplication Algorithm Is Still Faster

abstract: Recently, reinforcement algorithms discovered new algorithms that really jump-started a wave of excitements and a flourishing of publications. However, there is little on implementations, applications, and, especially, no absolute performance and, we show here they are not here to replace Strassen's original fast matrix multiplication yet. We present Matrix Flow, this is a simple Python project for the automatic formulation, design, implementation, code generation, and execution of fast matrix multiplication algorithms for CPUs, using BLAS interface GPUs, and in the future other accelerators. We shall not play with module-2 (Z2) algorithms and, for simplicity, we present only square double-precision matrices. By means of factorizing the operand matrices we can express many algorithms and prove them correct. These algorithms are represented by Data Flows and matrix data partitions: a Directed Acyclic Graph. We show that Strassen's original algorithm is still the top choice even for modern GPUs. We also address error analysis in double precision, because integer computations are correct, always


title: Single-photon manipulations based on optically-controlled chiral couplings in waveguide structures of Rydberg giant atoms

abstract: Two interacting Rydberg atoms coupled to a waveguide realize a giant-atom platform that exhibits the controllable (phase-dependent) chirality where the direction of nonreciprocal photon scattering can be switched on demand, e.g., by the geometrical tuning of an external driving field. At variance with previous chiral setups, the simplified approach of our proposed platform arises from an optical implementation of the local phase difference between two coupling points of the Rydberg giant atom. Furthermore, employing two or more driving fields, this platform could also be used as a frequency converter with its efficiency exhibiting a strong asymmetry and being significantly enhanced via the chiral couplings. Our results suggest an extendable giant-atom platform that is both innovative and promising for chiral quantum optics and tunable frequency conversion in the optical domain.


title: Dynamically tunable electromagnetically induced transparency-like metamaterial structure based on polarization sensitivity

abstract: In this paper, we propose a plasmon-induced transparency (PIT) metamaterial structure composed of Ag nanomaterials with polarization sensitivity. The metamaterial model consists of three bright modes with different resonant frequencies. The optical properties of the structure are further investigated using finite difference time domain (FDTD) method. The results show that the conversion between single-band PIT and dual-band PIT effects can be achieved by changing the polarization degree of the incident light, the number of transparent windows can be changed from one to two, and the process is accompanied by the conversion of bright and dark modes and the change of the resonance wavelength of the transmission peak. In addition, When the light is polarized in the Y-direction, the two transparency windows have different refractive index sensitivities, with FOM values of 5.94/RIU and 5.65/RIU, respectively.


title: MetaSegNet: Metadata-collaborative Vision-Language Representation Learning for Semantic Segmentation of Remote Sensing Images

abstract: Semantic segmentation of remote sensing images plays a vital role in a wide range of Earth Observation (EO) applications, such as land use land cover mapping, environment monitoring, and sustainable development. Driven by rapid developments in Artificial Intelligence (AI), deep learning (DL) has emerged as the mainstream tool for semantic segmentation and has achieved many breakthroughs in the field of remote sensing. However, the existing DL-based methods mainly focus on unimodal visual data while ignoring the rich multimodal information involved in the real world, usually demonstrating weak reliability and generlization. Inspired by the success of Vision Transformers and large language models, we propose a novel metadata-collaborative multimodal segmentation network (MetaSegNet) that applies vision-language representation learning for semantic segmentation of remote sensing images. Unlike the common model structure that only uses unimodal visual data, we extract the key characteristic (e.g. the climate zone) from freely available remote sensing image metadata and transfer it into knowledge-based text prompts via the generic ChatGPT. Then, we construct an image encoder, a text encoder and a cross-modal attention fusion subnetwork to extract the image and text feature and apply image-text interaction. Benefiting from such a design, the proposed MetaSegNet demonstrates superior generalization and achieves competitive accuracy with the state-of-the-art semantic segmentation methods on the large-scale OpenEarthMap dataset (68.6% mIoU) and Potsdam dataset (93.3% mean F1 score) as well as LoveDA dataset (52.2% mIoU).


title: Learning and Forgetting Unsafe Examples in Large Language Models

abstract: As the number of large language models (LLMs) released to the public grows, there is a pressing need to understand the safety implications associated with these models learning from third-party custom finetuning data. We explore the behavior of LLMs finetuned on noisy custom data containing unsafe content, represented by datasets that contain biases, toxicity, and harmfulness, finding that while aligned LLMs can readily learn this unsafe content, they also tend to forget it more significantly than other examples when subsequently finetuned on safer content. Drawing inspiration from the discrepancies in forgetting, we introduce the "ForgetFilter" algorithm, which filters unsafe data based on how strong the model's forgetting signal is for that data. We demonstrate that the ForgetFilter algorithm ensures safety in customized finetuning without compromising downstream task performance, unlike sequential safety finetuning. ForgetFilter outperforms alternative strategies like replay and moral self-correction in curbing LLMs' ability to assimilate unsafe content during custom finetuning, e.g. 75% lower than not applying any safety measures and 62% lower than using self-correction in toxicity score.


title: FSscore: A Machine Learning-based Synthetic Feasibility Score Leveraging Human Expertise

abstract: Determining whether a molecule can be synthesized is crucial for many aspects of chemistry and drug discovery, allowing prioritization of experimental work and ranking molecules in de novo design tasks. Existing scoring approaches to assess synthetic feasibility struggle to extrapolate to out-of-distribution chemical spaces or fail to discriminate based on minor differences such as chirality that might be obvious to trained chemists. This work aims to address these limitations by introducing the Focused Synthesizability score (FSscore), which learns to rank structures based on binary preferences using a graph attention network. First, a baseline trained on an extensive set of reactant-product pairs is established that subsequently is fine-tuned with expert human feedback on a chemical space of interest. Fine-tuning on focused datasets improves performance on these chemical scopes over the pre-trained model exhibiting moderate performance and generalizability. This enables distinguishing hard- from easy-to-synthesize molecules and improving the synthetic accessibility of generative model outputs. On very complex scopes with limited labels achieving satisfactory gains remains challenging. The FSscore showcases how human expert feedback can be utilized to optimize the assessment of synthetic feasibility for a variety of applications.


title: Magellan/M2FS and MMT/Hectochelle Spectroscopy of Dwarf Galaxies and Faint Star Clusters within the Galactic Halo

abstract: We present spectroscopic data for 16369 stellar targets within and/or toward 38 dwarf spheroidal galaxies and faint star clusters within the Milky Way halo environment. All spectra come from observations with the multi-object, fiber-fed echelle spectrographs M2FS at the Magellan/Clay telescope or Hectochelle at the MMT, reaching a typical limiting magnitude G < 21. Data products include processed spectra from all observations and catalogs listing estimates -- derived from template model fitting -- of line-of-sight velocity (median uncertainty 1.1 km/s) effective temperature (234 K), (base10 logarithm of) surface gravity (0.52 dex in cgs units), [Fe/H] (0.38 dex) and [Mg/Fe] (0.24 dex) abundance ratios. The sample contains multi-epoch measurements for 3720 sources, with up to 15 epochs per source, enabling studies of intrinsic spectroscopic variability. The sample contains 6078 likely red giant stars (based on surface gravity), and 4494 likely members (based on line-of-sight velocity and Gaia-measured proper motion) of the target systems. The number of member stars per individual target system ranges from a few, for the faintest systems, to ~ 850 for the most luminous. For most systems, our new samples extend over wider fields than have previously been observed; of the likely members in our samples, 823 lie beyond twice the projected halflight radius of their host system, and 42 lie beyond 5 Rhalf.


title: What is the correct definition of entropy for general relativistic field theory?

abstract: Recently, the author and collaborators proposed a method to construct a new conserved charge different from the Noether one for general relativistic field theory on curved space-time with energy-momentum tensor covariantly conserved, and that the new conserved charge describes the entropy of the system. As concrete evidence of the proposals, it was shown that such a new conserved charge indeed exists for several classic gravitational systems, and that the proposed entropy density computed in them satisfies the local Euler's relation and the first law of thermodynamics concurrently and non-perturbatively with respect to the Newton constant. These developments are reviewed including brief discussions of physical implications of the local thermodynamic relations.


title: Fine-tuning Large Language Models for Adaptive Machine Translation

abstract: This paper presents the outcomes of fine-tuning Mistral 7B, a general-purpose large language model (LLM), for adaptive machine translation (MT). The fine-tuning process involves utilising a combination of zero-shot and one-shot translation prompts within the medical domain. The primary objective is to enhance real-time adaptive MT capabilities of Mistral 7B, enabling it to adapt translations to the required domain at inference time. The results, particularly for Spanish-to-English MT, showcase the efficacy of the fine-tuned model, demonstrating quality improvements in both zero-shot and one-shot translation scenarios, surpassing Mistral 7B's baseline performance. Notably, the fine-tuned Mistral outperforms ChatGPT "gpt-3.5-turbo" in zero-shot translation while achieving comparable one-shot translation quality. Moreover, the zero-shot translation of the fine-tuned Mistral matches NLLB 3.3B's performance, and its one-shot translation quality surpasses that of NLLB 3.3B. These findings emphasise the significance of fine-tuning efficient LLMs like Mistral 7B to yield high-quality zero-shot translations comparable to task-oriented models like NLLB 3.3B. Additionally, the adaptive gains achieved in one-shot translation are comparable to those of commercial LLMs such as ChatGPT. Our experiments demonstrate that, with a relatively small dataset of 20,000 segments that incorporate a mix of zero-shot and one-shot prompts, fine-tuning significantly enhances Mistral's in-context learning ability, especially for real-time adaptive MT.


title: Locally Optimal Fixed-Budget Best Arm Identification in Two-Armed Gaussian Bandits with Unknown Variances

abstract: We address the problem of best arm identification (BAI) with a fixed budget for two-armed Gaussian bandits. In BAI, given multiple arms, we aim to find the best arm, an arm with the highest expected reward, through an adaptive experiment. Kaufmann et al. (2016) develops a lower bound for the probability of misidentifying the best arm. They also propose a strategy, assuming that the variances of rewards are known, and show that it is asymptotically optimal in the sense that its probability of misidentification matches the lower bound as the budget approaches infinity. However, an asymptotically optimal strategy is unknown when the variances are unknown. For this open issue, we propose a strategy that estimates variances during an adaptive experiment and draws arms with a ratio of the estimated standard deviations. We refer to this strategy as the Neyman Allocation (NA)-Augmented Inverse Probability weighting (AIPW) strategy. We then demonstrate that this strategy is asymptotically optimal by showing that its probability of misidentification matches the lower bound when the budget approaches infinity, and the gap between the expected rewards of two arms approaches zero (small-gap regime). Our results suggest that under the worst-case scenario characterized by the small-gap regime, our strategy, which employs estimated variance, is asymptotically optimal even when the variances are unknown.

categories: cs.LG econ.EM math.ST stat.ME stat.ML stat.TH


title: Cached Transformers: Improving Transformers with Differentiable Memory Cache

abstract: This work introduces a new Transformer model called Cached Transformer, which uses Gated Recurrent Cached (GRC) attention to extend the self-attention mechanism with a differentiable memory cache of tokens. GRC attention enables attending to both past and current tokens, increasing the receptive field of attention and allowing for exploring long-range dependencies. By utilizing a recurrent gating unit to continuously update the cache, our model achieves significant advancements in \textbf{six} language and vision tasks, including language modeling, machine translation, ListOPs, image classification, object detection, and instance segmentation. Furthermore, our approach surpasses previous memory-based techniques in tasks such as language modeling and displays the ability to be applied to a broader range of situations.


title: PointeNet: A Lightweight Framework for Effective and Efficient Point Cloud Analysis

abstract: Current methodologies in point cloud analysis predominantly explore 3D geometries, often achieved through the introduction of intricate learnable geometric extractors in the encoder or by deepening networks with repeated blocks. However, these approaches inevitably lead to a significant number of learnable parameters, resulting in substantial computational costs and imposing memory burdens on CPU/GPU. Additionally, the existing strategies are primarily tailored for object-level point cloud classification and segmentation tasks, with limited extensions to crucial scene-level applications, such as autonomous driving. In response to these limitations, we introduce PointeNet, an efficient network designed specifically for point cloud analysis. PointeNet distinguishes itself with its lightweight architecture, low training cost, and plug-and-play capability, effectively capturing representative features. The network consists of a Multivariate Geometric Encoding (MGE) module and an optional Distance-aware Semantic Enhancement (DSE) module. The MGE module employs operations of sampling, grouping, and multivariate geometric aggregation to lightweightly capture and adaptively aggregate multivariate geometric features, providing a comprehensive depiction of 3D geometries. The DSE module, designed for real-world autonomous driving scenarios, enhances the semantic perception of point clouds, particularly for distant points. Our method demonstrates flexibility by seamlessly integrating with a classification/segmentation head or embedding into off-the-shelf 3D object detection networks, achieving notable performance improvements at a minimal cost. Extensive experiments on object-level datasets, including ModelNet40, ScanObjectNN, ShapeNetPart, and the scene-level dataset KITTI, demonstrate the superior performance of PointeNet over state-of-the-art methods in point cloud analysis.


title: 3D-CLMI: A Motor Imagery EEG Classification Model via Fusion of 3D-CNN and LSTM with Attention

abstract: Due to the limitations in the accuracy and robustness of current electroencephalogram (EEG) classification algorithms, applying motor imagery (MI) for practical Brain-Computer Interface (BCI) applications remains challenging. This paper proposed a model that combined a three-dimensional convolutional neural network (CNN) with a long short-term memory (LSTM) network with attention to classify MI-EEG signals. This model combined MI-EEG signals from different channels into three-dimensional features and extracted spatial features through convolution operations with multiple three-dimensional convolutional kernels of different scales. At the same time, to ensure the integrity of the extracted MI-EEG signal temporal features, the LSTM network was directly trained on the preprocessed raw signal. Finally, the features obtained from these two networks were combined and used for classification. Experimental results showed that this model achieved a classification accuracy of 92.7% and an F1-score of 0.91 on the public dataset BCI Competition IV dataset 2a, which were both higher than the state-of-the-art models in the field of MI tasks. Additionally, 12 participants were invited to complete a four-class MI task in our lab, and experiments on the collected dataset showed that the 3D-CLMI model also maintained the highest classification accuracy and F1-score. The model greatly improved the classification accuracy of users' motor imagery intentions, giving brain-computer interfaces better application prospects in emerging fields such as autonomous vehicles and medical rehabilitation.


title: Graph connectivity with fixed endpoints in the random-connection model

abstract: We consider the count of subgraphs with an arbitrary configuration of endpoints in the random-connection model based on a Poisson point process on ${\Bbb R}^d$. We present combinatorial expressions for the computation of the cumulants and moments of all orders of such subgraph counts, which allow us to estimate the growth of cumulants as the intensity of the underlying Poisson point process goes to infinity. As a consequence, we obtain a central limit theorem with explicit convergence rates under the Kolmogorov distance, and connectivity bounds. Numerical examples are presented using a computer code in SageMath for the closed-form computation of cumulants of any order, for any type of connected subgraph and for any configuration of endpoints in any dimension $d\geq 1$. In particular, graph connectivity estimates, Gram-Charlier expansions for density estimation, and correlation estimates for joint subgraph counting are obtained.


title: ChatFDA: Medical Records Risk Assessment

abstract: In healthcare, the emphasis on patient safety and the minimization of medical errors cannot be overstated. Despite concerted efforts, many healthcare systems, especially in low-resource regions, still grapple with preventing these errors effectively. This study explores a pioneering application aimed at addressing this challenge by assisting caregivers in gauging potential risks derived from medical notes. The application leverages data from openFDA, delivering real-time, actionable insights regarding prescriptions. Preliminary analyses conducted on the MIMIC-III \cite{mimic} dataset affirm a proof of concept highlighting a reduction in medical errors and an amplification in patient safety. This tool holds promise for drastically enhancing healthcare outcomes in settings with limited resources. To bolster reproducibility and foster further research, the codebase underpinning our methodology is accessible on https://github.com/autonlab/2023.hackAuton/tree/main/prescription_checker. This is a submission for the 30th HackAuton CMU.


title: ALMANACS: A Simulatability Benchmark for Language Model Explainability

abstract: How do we measure the efficacy of language model explainability methods? While many explainability methods have been developed, they are typically evaluated on bespoke tasks, preventing an apples-to-apples comparison. To help fill this gap, we present ALMANACS, a language model explainability benchmark. ALMANACS scores explainability methods on simulatability, i.e., how well the explanations improve behavior prediction on new inputs. The ALMANACS scenarios span twelve safety-relevant topics such as ethical reasoning and advanced AI behaviors; they have idiosyncratic premises to invoke model-specific behavior; and they have a train-test distributional shift to encourage faithful explanations. By using another language model to predict behavior based on the explanations, ALMANACS is a fully automated benchmark. We use ALMANACS to evaluate counterfactuals, rationalizations, attention, and Integrated Gradients explanations. Our results are sobering: when averaged across all topics, no explanation method outperforms the explanation-free control. We conclude that despite modest successes in prior work, developing an explanation method that aids simulatability in ALMANACS remains an open challenge.


title: Emergence of Fairness Behavior Driven by Reputation-Based Voluntary Participation in Evolutionary Dictator Games

abstract: Recently, reputation-based indirect reciprocity has been widely applied to the study on fairness behavior. Previous works mainly investigate indirect reciprocity by considering compulsory participation. While in reality, individuals may choose voluntary participation according to the opponent's reputation. It is still unclear how such reputation-based voluntary participation influences the evolution of fairness. To address this question, we introduce indirect reciprocity with voluntary participation into the dictator game (DG). We respectively consider good dictators or recipients can voluntarily participate in games when the opponents are assessed as bad. We theoretically calculate the fairness level under all social norms of third-order information. Our findings reveal that several social norms induce the high fairness level in both scenarios. However, more social norms lead to a high fairness level for voluntary participation of recipients, compared with the one of good dictators. The results also hold when the probability of voluntary participation is not low. Our results demonstrate that recipients' voluntary participation is more effective in promoting the emergence of fairness behavior.


title: Nematic charge-density-wave correlations in FeSe$_{1-x}$S$_{x}$

abstract: The occurrence of charge-density-wave (CDW) order is a common thread in the phase diagram of cuprate high-transition-temperature ($T_c$) superconductors. In iron-based superconductors (FeSCs), nematic order and fluctuations play a decisive role in driving other emergent orders. CDW order has been observed by scanning tunneling microscopy for various FeSCs such as FeSe thin films, uniaxially strained LiFeAs, and tetragonal FeSe$_{0.81}$S$_{0.19}$. However, it remains elusive if the CDW in these materials is a bulk phenomenon as well as if and how it intertwines with the electronic nematicity. Using energy-resolved resonant X-ray scattering at the Fe-L$_3$ edge, we report the discovery of a local-strain-induced incommensurate isotropic CDW order in FeSe$_{0.82}$S$_{0.18}$. A highly anisotropic CDW response under uniaxial strain unambiguously manifests that the CDW is directly coupled to the nematicity. Transforming part of Fe$^{2+}$ to Fe$^{3+}$ on the surface of FeSe$_{1-x}$S$_{x}$ reveals that the same isotropic CDW can be induced, enhanced, and stabilized in the whole nematic regime measured ($x=0-0.19$). As Fe$^{3+}$ can create local lattice distortions on the surface, the CDW could arise from the interaction between the local strain around Fe$^{3+}$ and the nematic electron correlations. Our experimental observation of a local-strain-induced CDW gives vital information for understanding the interplay between electron correlations and the electronic nematicity in FeSCs.


title: Parallel Ranking of Ads and Creatives in Real-Time Advertising Systems

abstract: "Creativity is the heart and soul of advertising services". Effective creatives can create a win-win scenario: advertisers can reach target users and achieve marketing objectives more effectively, users can more quickly find products of interest, and platforms can generate more advertising revenue. With the advent of AI-Generated Content, advertisers now can produce vast amounts of creative content at a minimal cost. The current challenge lies in how advertising systems can select the most pertinent creative in real-time for each user personally. Existing methods typically perform serial ranking of ads or creatives, limiting the creative module in terms of both effectiveness and efficiency. In this paper, we propose for the first time a novel architecture for online parallel estimation of ads and creatives ranking, as well as the corresponding offline joint optimization model. The online architecture enables sophisticated personalized creative modeling while reducing overall latency. The offline joint model for CTR estimation allows mutual awareness and collaborative optimization between ads and creatives. Additionally, we optimize the offline evaluation metrics for the implicit feedback sorting task involved in ad creative ranking. We conduct extensive experiments to compare ours with two state-of-the-art approaches. The results demonstrate the effectiveness of our approach in both offline evaluations and real-world advertising platforms online in terms of response time, CTR, and CPM.


title: Human-Centred Learning Analytics and AI in Education: a Systematic Literature Review

abstract: The rapid expansion of Learning Analytics (LA) and Artificial Intelligence in Education (AIED) offers new scalable, data-intensive systems but also raises concerns about data privacy and agency. Excluding stakeholders -- like students and teachers -- from the design process can potentially lead to mistrust and inadequately aligned tools. Despite a shift towards human-centred design in recent LA and AIED research, there remain gaps in our understanding of the importance of human control, safety, reliability, and trustworthiness in the design and implementation of these systems. We conducted a systematic literature review to explore these concerns and gaps. We analysed 108 papers to provide insights about i) the current state of human-centred LA/AIED research; ii) the extent to which educational stakeholders have contributed to the design process of human-centred LA/AIED systems; iii) the current balance between human control and computer automation of such systems; and iv) the extent to which safety, reliability and trustworthiness have been considered in the literature. Results indicate some consideration of human control in LA/AIED system design, but limited end-user involvement in actual design. Based on these findings, we recommend: 1) carefully balancing stakeholders' involvement in designing and deploying LA/AIED systems throughout all design phases, 2) actively involving target end-users, especially students, to delineate the balance between human control and automation, and 3) exploring safety, reliability, and trustworthiness as principles in future human-centred LA/AIED systems.


title: Multi-messenger astronomy in the new physics modality with GPS constellation

abstract: We explore a novel, exotic physics, modality in multi-messenger astronomy. We are interested in exotic fields emitted by the mergers and their direct detection with a network of atomic clocks. We specifically focus on the rubidium clocks onboard satellites of the Global Positioning System. Bursts of exotic fields may be produced during the coalescence of black hole singularities, releasing quantum gravity messengers. To be detectable such fields must be ultralight and ultra-relativistic and we refer to them as exotic low-mass fields (ELFs). Since such fields possess non-zero mass, the ELF bursts lag behind the gravitational waves emitted by the very same merger. Then the gravitational wave observatories provide a detection trigger for the atomic clock networks searching for the feeble ELF signals. ELFs would imprint an anti-chirp transient across the sensor network. ELFs can be detectable by atomic clocks if they cause variations in fundamental constants. We report our progress in the development of techniques to search for ELF bursts with clocks onboard GPS satellites. We focus on the binary neutron star merger GW170817 of August 17, 2017. We find an intriguing excess in the clock noise post LIGO gravitational wave trigger. Potentially the excess noise could be explained away by the increased solar electron flux post LIGO trigger.

categories: astro-ph.IM astro-ph.HE gr-qc physics.atom-ph physics.ins-det


title: A generalization of the Hasse-Arf theorem

abstract: We use the theory of Harbater-Katz-Gabber curves to derive a generalization of the Hasse-Arf theorem for complete local field extensions in positive characteristic.


title: Spectral Prompt Tuning:Unveiling Unseen Classes for Zero-Shot Semantic Segmentation

abstract: Recently, CLIP has found practical utility in the domain of pixel-level zero-shot segmentation tasks. The present landscape features two-stage methodologies beset by issues such as intricate pipelines and elevated computational costs. While current one-stage approaches alleviate these concerns and incorporate Visual Prompt Training (VPT) to uphold CLIP's generalization capacity, they still fall short in fully harnessing CLIP's potential for pixel-level unseen class demarcation and precise pixel predictions. To further stimulate CLIP's zero-shot dense prediction capability, we propose SPT-SEG, a one-stage approach that improves CLIP's adaptability from image to pixel. Specifically, we initially introduce Spectral Prompt Tuning (SPT), incorporating spectral prompts into the CLIP visual encoder's shallow layers to capture structural intricacies of images, thereby enhancing comprehension of unseen classes. Subsequently, we introduce the Spectral Guided Decoder (SGD), utilizing both high and low-frequency information to steer the network's spatial focus towards more prominent classification features, enabling precise pixel-level prediction outcomes. Through extensive experiments on two public datasets, we demonstrate the superiority of our method over state-of-the-art approaches, performing well across all classes and particularly excelling in handling unseen classes. Code is available at:https://github.com/clearxu/SPT.


title: Flux coupled tunable superconducting resonator

abstract: We present a design and implementation of frequency-tunable superconducting resonator. The resonance frequency tunability is achieved by flux-coupling a superconducting LC-loop to a current-biased feedline; the resulting screening current leads to a change of the kinetic inductance and shift in the resonance frequency. The thin film aluminum resonator consists of an interdigitated capacitor and thin line inductors forming a closed superconducting loop. The magnetic flux from the nearby current feedline induces Meissner shielding currents in the resonator loop leading to change in the kinetic part of the total inductance of the resonator. We demonstarte continuous frequency tuning within 160 MHz around the resonant frequency of 2.7 GHz. We show that: (1) frequency upconversion is achieved when kHz AC modulation signal is superimposed onto the DC bias resulting in sidebands to the resonator tone; (2) three-wave mixing is attained by parametrically pumping the nonlinear kinetic inductance using a strong RF pump signal in the feedline. The simple architecture is amenable to large array multiplexing and on-chip integration with other circuit components. The concept could be applied in flux magnetometers, upconverters, and parametric amplifiers operating above 4 Kelvin cryogenic temperatures when alternative high critical temperature material with high kinetic inductance is used.


title: On components of the tensor square of a Weyl module

abstract: For a simple Lie algebra $\mathfrak{g}$ of type $A_n,B_n,C_n$ or $D_n$, we give a characterization of the set of dominant integral weights $\lambda$ such that for any rational point $\mu$ in the fundamental Weyl chamber, $2\lambda-\mu$ is a non-negative rational combination of the simple roots if and only if $V_{m\mu}\subseteq V_{m\lambda}\otimes V_{m\lambda}$ for some positive integer $m$.


title: Local momentum balance in electromagnetic gyrokinetic systems

abstract: The Eulerian variational formulation is presented to obtain governing equations of the electromagnetic turbulent gyrokinetic system. A local momentum balance in the system is derived from the invariance of the Lagrangian of the system under an arbitrary spatial coordinate transformation by extending the previous work [H. Sugama et al., Phys. Plasmas 28, 022312 (2021)]. Polarization and magnetization due to finite gyroradii and electromagnetic microturbulence are correctly described by the gyrokinetic Poisson equation and Amp\`{e}re's law which are derived from the variational principle. Also shown is how the momentum balance is influenced by including collisions and external sources. Momentum transport due to collisions and turbulence is represented by a symmetric pressure tensor which originates in a variational derivative of the Lagrangian with respect to the metric tensor. The relations of the axisymmetry and quasi-axisymmetry of the toroidal background magnetic field to a conservation form of the local momentum balance equation are clarified. In addition, an ensemble-averaged total momentum balance equation is shown to take the conservation form even in the background field with no symmetry when a constraint condition representing the macroscopic Amp\`{e}re's law is imposed on the background field. Using the WKB representation, the ensemble-averaged pressure tensor due to the microturbulence is expressed in detail and it is verified to reproduce the toroidal momentum transport derived in previous works for axisymmetric systems. The local momentum balance equation and the pressure tensor obtained in this work present a useful reference for elaborate gyrokinetic simulation studies of momentum transport processes.


title: Observation of Highly Correlated Ultrabright Biphotons Through Increased Atomic Ensemble Density in Spontaneous Four-Wave Mixing

abstract: The pairing ratio, a crucial metric assessing a biphoton source's ability to generate correlated photon pairs, remains underexplored despite theoretical predictions. This study presents experimental findings on the pairing ratio, utilizing a double-$\Lambda$ spontaneous four-wave mixing biphoton source in cold atoms. At an optical depth (OD) of 20, we achieved an ultrahigh biphoton generation rate of up to $1.3\times10^7$ per second, with a successful pairing ratio of $61\%$. Increasing the OD to 120 significantly improved the pairing ratio to $89\%$, while maintaining a consistent biphoton generation rate. This achievement, marked by high generation rates and robust biphoton pairing, holds great promise for advancing efficiency in quantum communication and information processing. Additionally, in a scenario with a lower biphoton generation rate of $5.0 \times 10^4$ per second, we attained an impressive signal-to-background ratio of 241 for the biphoton wavepacket, surpassing the Cauchy-Schwarz criterion by approximately $1.5\times10^4$ times.


title: Stochastic Control Barrier Functions with Bayesian Inference for Unknown Stochastic Differential Equations

abstract: Control barrier functions are widely used to synthesize safety-critical controls. However, the presence of Gaussian-type noise in dynamical systems can generate unbounded signals and potentially result in severe consequences. Although research has been conducted in the field of safety-critical control for stochastic systems, in many real-world scenarios, we do not have precise knowledge about the stochastic dynamics. In this paper, we delve into the safety-critical control for stochastic systems where both the drift and diffusion components are unknown. We employ Bayesian inference as a data-driven approach to approximate the system. To be more specific, we utilize Bayesian linear regression along with the central limit theorem to estimate the drift term, and employ Bayesian inference to approximate the diffusion term. Through simulations, we verify our findings by applying them to a nonlinear dynamical model and an adaptive cruise control model.


title: An equivalent inequality for the Riemann hypothesis

abstract: We present a purely analytical inequality which is equivalent to the Riemann hypothesis (RH). The proof of the equivalence is based on a representation of the modulus of the Riemann $\xi$ function. As the first step to analyze the inequality, we consider polynomial approximations. We also show that the RH is equivalent to the statement that some wave functions constructed using the Brownian motion never evolve into perfectly distinguishable states.


title: Zariski-van Kampen Method and Monodromy in Complexified Integrable Systems

abstract: We computed the fundamental groups of non-singular sets of some complexified Hamiltonian integrable systems by Zariski-van Kampen method. By our computation, we determined all possible monodromy in complexified planar Kepler problem and spherical pendulum, that is their monodromy groups. We also gave an answer to the conjecture proposed by You and Sun.


title: Deformations of Lie groupoid morphisms

abstract: We establish the deformation theory of Lie groupoid morphisms, describe the corresponding deformation cohomology of morphisms, and show the properties of the cohomology. We prove its invariance under isomorphisms of morphisms. Additionally, we establish stability properties of the morphisms using Moser-type arguments. Furthermore, we demonstrate the Morita invariance of the deformation cohomology and consider simultaneous deformations of the morphism, its domain, and codomain. These simultaneous deformations are utilized to define cohomology for generalized morphisms and to study deformations of multiplicative forms on Lie groupoids.


title: AMD:Anatomical Motion Diffusion with Interpretable Motion Decomposition and Fusion

abstract: Generating realistic human motion sequences from text descriptions is a challenging task that requires capturing the rich expressiveness of both natural language and human motion.Recent advances in diffusion models have enabled significant progress in human motion synthesis.However, existing methods struggle to handle text inputs that describe complex or long motions.In this paper, we propose the Adaptable Motion Diffusion (AMD) model, which leverages a Large Language Model (LLM) to parse the input text into a sequence of concise and interpretable anatomical scripts that correspond to the target motion.This process exploits the LLM's ability to provide anatomical guidance for complex motion synthesis.We then devise a two-branch fusion scheme that balances the influence of the input text and the anatomical scripts on the inverse diffusion process, which adaptively ensures the semantic fidelity and diversity of the synthesized motion.Our method can effectively handle texts with complex or long motion descriptions, where existing methods often fail. Experiments on datasets with relatively more complex motions, such as CLCD1 and CLCD2, demonstrate that our AMD significantly outperforms existing state-of-the-art models.


title: Lattice Rescoring Based on Large Ensemble of Complementary Neural Language Models

abstract: We investigate the effectiveness of using a large ensemble of advanced neural language models (NLMs) for lattice rescoring on automatic speech recognition (ASR) hypotheses. Previous studies have reported the effectiveness of combining a small number of NLMs. In contrast, in this study, we combine up to eight NLMs, i.e., forward/backward long short-term memory/Transformer-LMs that are trained with two different random initialization seeds. We combine these NLMs through iterative lattice generation. Since these NLMs work complementarily with each other, by combining them one by one at each rescoring iteration, language scores attached to given lattice arcs can be gradually refined. Consequently, errors of the ASR hypotheses can be gradually reduced. We also investigate the effectiveness of carrying over contextual information (previous rescoring results) across a lattice sequence of a long speech such as a lecture speech. In experiments using a lecture speech corpus, by combining the eight NLMs and using context carry-over, we obtained a 24.4% relative word error rate reduction from the ASR 1-best baseline. For further comparison, we performed simultaneous (i.e., non-iterative) NLM combination and 100-best rescoring using the large ensemble of NLMs, which confirmed the advantage of lattice rescoring with iterative NLM combination.


title: Operando real-space imaging of a structural phase transformation in a high-voltage electrode

abstract: Discontinuous solid-solid phase transformations play a pivotal role in determining properties of rechargeable battery electrodes. By leveraging operando Bragg Coherent Diffractive Imaging (BCDI), we investigate the discontinuous phase transformation in LixNi0.5Mn1.5O4 within a fully operational battery. Throughout Li-intercalation, we directly observe the nucleation and growth of the Li-rich phase within the initially charged Li-poor phase in a 500 nm particle. Supported by the microelasticity model, the operando imaging unveils an evolution from a curved coherent to planar semi-coherent interface driven by dislocation dynamics. We hypothesize these dislocations exhibit a glissile motion that facilitates interface migration without diffusion of host ions, leaving the particle defect-free post-transformation. Our data indicates negligible kinetic limitations impacting the transformation kinetics, even at discharge rates as fast as C/2. This study underscores BCDI's capability to provide operando insights into nanoscale phase transformations, offering valuable guidance for electrochemical materials design and optimization.


title: IOPS: An Unified SpMM Accelerator Based on Inner-Outer-Hybrid Product

abstract: Sparse matrix multiplication (SpMM) is widely applied to numerous domains, such as graph processing, machine learning, and data analytics. However, inner product based SpMM induces redundant zero-element computing for mismatched nonzero operands, while outer product based approach lacks input reuse across Process Elements (PEs) and poor output locality for accumulating partial sum (psum) matrices. Besides, current works only focus on sparse-sparse matrix multiplication (SSMM) or sparse-dense matrix multiplication (SDMM), rarely performing efficiently for both. To address these problems, this paper proposes an unified SpMM accelerator, called IOPS, hybridizing inner with outer products. It reuses the input matrix among PEs with inner product dataflow, and removes zero-element calculations with outer product approach in each PE, which can efficiently process SSMM and SDMM. Moreover, an address mapping method is designed to accumulate the irregular sparse psum matrices, reducing the latency and DRAM access of psum accumulating. Furthermore, an adaptive partition strategy is proposed to tile the input matrices based on their sparsity ratios, effectively utilizing the storage of architecture and reducing DRAM access. Compared with the SSMM accelerator, SpArch, we achieve 1.7x~6.3x energy efficiency and 1.2x~4.4x resource efficiency, with 1.4x~2.1x DRAM access saving.


title: Information thermodynamics of transition paths between multiple mesostates

abstract: A central concern across the natural sciences is a quantitative understanding of the mechanism governing rare transitions between two metastable states. Recent research has uncovered a fundamental equality between the time-reversal asymmetry of the ensemble of such transition paths and the informativeness of system dynamics about the reactivity of a given trajectory, immediately leading to quantitative criteria for judging the importance of distinct system coordinates for the transition. Here we generalize this framework to multiple mesostates. We find that the main system-wide and coordinate-specific results generalize intuitively, while the combinatorial diversity of pairwise transitions raises new questions and points to new concepts. This work increases the previous framework's generality and applicability and forges connections to enhanced-sampling and coarse-grained dynamical approaches such as milestoning and Markov-state models.


title: Mutual-modality Adversarial Attack with Semantic Perturbation

abstract: Adversarial attacks constitute a notable threat to machine learning systems, given their potential to induce erroneous predictions and classifications. However, within real-world contexts, the essential specifics of the deployed model are frequently treated as a black box, consequently mitigating the vulnerability to such attacks. Thus, enhancing the transferability of the adversarial samples has become a crucial area of research, which heavily relies on selecting appropriate surrogate models. To address this challenge, we propose a novel approach that generates adversarial attacks in a mutual-modality optimization scheme. Our approach is accomplished by leveraging the pre-trained CLIP model. Firstly, we conduct a visual attack on the clean image that causes semantic perturbations on the aligned embedding space with the other textual modality. Then, we apply the corresponding defense on the textual modality by updating the prompts, which forces the re-matching on the perturbed embedding space. Finally, to enhance the attack transferability, we utilize the iterative training strategy on the visual attack and the textual defense, where the two processes optimize from each other. We evaluate our approach on several benchmark datasets and demonstrate that our mutual-modal attack strategy can effectively produce high-transferable attacks, which are stable regardless of the target networks. Our approach outperforms state-of-the-art attack methods and can be readily deployed as a plug-and-play solution.


title: Wasserstein robust combinatorial optimization problems

abstract: This paper discusses a class of combinatorial optimization problems with uncertain costs in the objective function. It is assumed that a sample of the cost realizations is available, which defines an empirical probability distribution for the random cost vector. A Wasserstein ball, centered at the empirical distribution, is used to define an ambiguity set of probability distributions. A solution minimizing the Conditional Value at Risk for a worst probability distribution in the Wasserstein ball is computed. The complexity of the problem is investigated. Exact and approximate solution methods for various support sets are proposed. Some known results for the Wasserstein robust shortest path problem are generalized and refined.


title: Study of the hidden-heavy pentaquarks and $P_{cs}$ states

abstract: In light of the recently observed resonance states $P_{\psi s}^{\Lambda}(4338)^0$ and $P_{cs}(4459)^0$ by LHCb Collaboration in $J/\psi\Lambda$ decay channel, we perform a systematical study of all possible hidden-heavy pentaquarks with strangeness $S=0,-1,-2,-3$, in unified framework of MIT bag model. The color-spin wavefunctions presented in terms of Young-Yamanouchi bases and transformed into baryon-meson couplings, are utilized to calculate masses, magnetic moments and ratios of partial widths. With numerical analysis, the observed $P_{\psi s}^{\Lambda}(4338)^0$ is likely to be a $1/2^-$ compact $P_{cs}$ pentaquark, and $P_{cs}(4459)^0$ favors two-peak structure of $3/2^-$ and $1/2^-$ $P_{cs}$ states. Further predictions on hadron properties and decay channels are given to compact $P_{css}$, $P_{csss}$ states and bottom sectors.


title: Variational formulation and monolithic solution of computational homogenization methods

abstract: In this contribution, we derive a consistent variational formulation for computational homogenization methods and show that traditional FE2 and IGA2 approaches are special discretization and solution techniques of this most general framework. This allows us to enhance dramatically the numerical analysis as well as the solution of the arising algebraic system. In particular, we expand the dimension of the continuous system, discretize the higher dimensional problem consistently and apply afterwards a discrete null-space matrix to remove the additional dimensions. A benchmark problem, for which we can obtain an analytical solution, demonstrates the superiority of the chosen approach aiming to reduce the immense computational costs of traditional FE2 and IGA2 formulations to a fraction of the original requirements. Finally, we demonstrate a further reduction of the computational costs for the solution of general non-linear problems.


title: Realistic Rainy Weather Simulation for LiDARs in CARLA Simulator

abstract: Employing data augmentation methods to enhance perception performance in adverse weather has attracted considerable attention recently. Most of the LiDAR augmentation methods post-process the existing dataset by physics-based models or machine-learning methods. However, due to the limited environmental annotations and the fixed vehicle trajectories in the existing dataset, it is challenging to edit the scene and expand the diversity of traffic flow and scenario. To this end, we propose a simulator-based physical modeling approach to augment LiDAR data in rainy weather in order to improve the perception performance of LiDAR in this scenario. We complete the modeling task of the rainy weather in the CARLA simulator and establish a pipeline for LiDAR data collection. In particular, we pay special attention to the spray and splash rolled up by the wheels of surrounding vehicles in rain and complete the simulation of this special scenario through the Spray Emitter method we developed. In addition, we examine the influence of different weather conditions on the intensity of the LiDAR echo, develop a prediction network for the intensity of the LiDAR echo, and complete the simulation of 4-feat LiDAR point cloud data. In the experiment, we observe that the model augmented by the synthetic data improves the object detection task's performance in the rainy sequence of the Waymo Open Dataset. Both the code and the dataset will be made publicly available at https://github.com/PJLab-ADG/PCSim#rainypcsim.


title: Segmenting Messy Text: Detecting Boundaries in Text Derived from Historical Newspaper Images

abstract: Text segmentation, the task of dividing a document into sections, is often a prerequisite for performing additional natural language processing tasks. Existing text segmentation methods have typically been developed and tested using clean, narrative-style text with segments containing distinct topics. Here we consider a challenging text segmentation task: dividing newspaper marriage announcement lists into units of one announcement each. In many cases the information is not structured into sentences, and adjacent segments are not topically distinct from each other. In addition, the text of the announcements, which is derived from images of historical newspapers via optical character recognition, contains many typographical errors. As a result, these announcements are not amenable to segmentation with existing techniques. We present a novel deep learning-based model for segmenting such text and show that it significantly outperforms an existing state-of-the-art method on our task.


title: Data Extraction, Transformation, and Loading Process Automation for Algorithmic Trading Machine Learning Modelling and Performance Optimization

abstract: A data warehouse efficiently prepares data for effective and fast data analysis and modelling using machine learning algorithms. This paper discusses existing solutions for the Data Extraction, Transformation, and Loading (ETL) process and automation for algorithmic trading algorithms. Integrating the Data Warehouses and, in the future, the Data Lakes with the Machine Learning Algorithms gives enormous opportunities in research when performance and data processing time become critical non-functional requirements.


title: Quantum Criticality in YbCu4Ni

abstract: We report on the quantum criticality of YbCu$_4$Ni as revealed by our combined micro- and macro-measurements. We determine the crystal structure of YbCu$_4$Ni with site mixing by neutron diffraction measurements, which suggests the possible presence of Kondo disorder. However, decreasing the local spin susceptibility distribution and the development of spin fluctuations below 10 K at ambient pressure by muon spin rotation and relaxation measurements suggests that YbCu4Ni exhibits quantum criticality. Therefore, our experimental results indicate that YbCu4Ni is a new material that exhibits quantum criticality under a zero magnetic field and ambient pressure.


title: Computational homogenization of phase-field fracture

abstract: In this contribution we investigate the application of phase-field fracture models on non-linear multiscale computational homogenization schemes. In particular, we introduce different phase-fields on a two-scale problem and develop a thermodynamically consistent model. This allows on the one hand for the prediction of local micro-fracture patterns, which effectively acts as an anisotropic damage model on the macroscale. On the other and, the macro-fracture phase-field model allows to predict complex fracture pattern with regard to local microstructures. Both phase-fields are introduced in a common framework, such that a joint consistent linearization for the Newton-Raphson iteration can be developed. Finally, the limits of both models as well as the applicability are shown in different numerical examples.


title: octonionic Dirac operators in bounded lattices: convergence and Plemlj projections

abstract: This article explores octonionic analysis on the lattice $\mathbb Z^8$, emphasizing the octonionic discrete Cauchy integral within a bounded domain, the Sokhotski-Plemelj jump formulas, and the convergence of discrete regular functions. We address the challenge of articulating the discrete Cauchy-Pompeiu integral formula, particularly the complexities tied to the associator of octonions. Adopting an innovative approach, we assimilate complicating terms into integral kernels, leading to distinct surface and volume kernels. A new'star product' arises in handling octonionic function multiplications. Our study connects closely with the Teodorescu operator and singular kernel management, utilizing a Fourier variant with 24 unique singular points. Drawing from the foundational work of Shivakumar and Wong about the asymptotic expansion of the Fourier transform, we bridge the relationship between the Cauchy and Teodorescu integrals. This allows us to provide quantitative estimates for these kernels, which prove to be pivotal in the theory of discrete regular extensions. The research culminates in the revelation that a continuous octonionic function is regular precisely when it is a scale limit of discrete regular functions.


title: Collaborative business intelligence virtual assistant

abstract: The present-day business landscape necessitates novel methodologies that integrate intelligent technologies and tools capable of swiftly providing precise and dependable information for decision-making purposes. Contemporary society is characterized by vast amounts of accumulated data across various domains, which hold considerable potential for informing and guiding decision-making processes. However, these data are typically collected and stored by disparate and unrelated software systems, stored in diverse formats, and offer varying levels of accessibility and security. To address the challenges associated with processing such large volumes of data, organizations often rely on data analysts. Nonetheless, a significant hurdle in harnessing the benefits of accumulated data lies in the lack of direct communication between technical specialists, decision-makers, and business process analysts. To overcome this issue, the application of collaborative business intelligence (CBI) emerges as a viable solution. This research focuses on the applications of data mining and aims to model CBI processes within distributed virtual teams through the interaction of users and a CBI Virtual Assistant. The proposed virtual assistant for CBI endeavors to enhance data exploration accessibility for a wider range of users and streamline the time and effort required for data analysis. The key contributions of this study encompass: 1) a reference model representing collaborative BI, inspired by linguistic theory; 2) an approach that enables the transformation of user queries into executable commands, thereby facilitating their utilization within data exploration software; and 3) the primary workflow of a conversational agent designed for data analytics.


title: A distinction between the paraboloid and the sphere in weighted restriction

abstract: For several weights based on lattice point constructions in $\mathbb{R}^d (d \geq 2)$, we prove that the sharp $L^2$ weighted restriction inequality for the sphere is very different than the corresponding result for the paraboloid. The proof uses Poisson summation, linear algebra, and lattice counting. We conjecture that the $L^2$ weighted restriction is generally better for the circle for a wide variety of general sparse weights.


title: Twisted topology and Bipolar Non-Hermitian Skin Effect induced by long-range asymmetric coupling

abstract: We investigate the twisted topology of the complex eigenspectrum of a one-dimensional non-Hermitian system under the influence of long-range unidirectional coupling. Unlike the complex energy spectrum of the conventional Hatano-Nelson chain, which takes the form of a single loop with a topological winding index of a definite sign, the introduction of long-range unidirectional hopping results in the creation of multiple twisted loops. These twisted loops exhibit opposite signs of the topological winding index, which correlate to alternating clockwise and anticlockwise energy windings. The simultaneous presence of both signs of the winding index translates into a bipolar non-Hermitian skin effect (NHSE), which challenges the conventional wisdom that the NHSE localization is dependent on the direction of the dominant nearest-neighbor interactions. In this bipolar NHSE, the exponents of the complex energy eigenvectors corresponding to clockwise and anti-clockwise windings, lie inside and outside of the complex unit circle, respectively. Interestingly, at the intersections of oppositely oriented energy loops where the sign of the topological winding index flips, the energy becomes real-valued, leading to a suppression of the NHSE. This marks the emergence of Bloch-like contact points, where both the bipolar NHSE and the traditional NHSE vanish. Based on the non-Hermitian model we provide analytical insights into the effects of long-range unidirectional coupling to the winding topology of its complex energy spectra and their broader implications for the field of condensed matter physics.


title: DynaLay: An Introspective Approach to Dynamic Layer Selection for Deep Networks

abstract: Deep learning models have become increasingly computationally intensive, requiring extensive computational resources and time for both training and inference. A significant contributing factor to this challenge is the uniform computational effort expended on each input example, regardless of its complexity. We introduce \textbf{DynaLay}, an alternative architecture that features a decision-making agent to adaptively select the most suitable layers for processing each input, thereby endowing the model with a remarkable level of introspection. DynaLay reevaluates more complex inputs during inference, adjusting the computational effort to optimize both performance and efficiency. The core of the system is a main model equipped with Fixed-Point Iterative (FPI) layers, capable of accurately approximating complex functions, paired with an agent that chooses these layers or a direct action based on the introspection of the models inner state. The model invests more time in processing harder examples, while minimal computation is required for easier ones. This introspective approach is a step toward developing deep learning models that "think" and "ponder", rather than "ballistically'' produce answers. Our experiments demonstrate that DynaLay achieves accuracy comparable to conventional deep models while significantly reducing computational demands.


title: Spectral gap bounds for reversible hybrid Gibbs chains

abstract: Hybrid Gibbs samplers represent a prominent class of approximated Gibbs algorithms that utilize Markov chains to approximate conditional distributions, with the Metropolis-within-Gibbs algorithm standing out as a well-known example. Despite their widespread use in both statistical and non-statistical applications, very little is known about their convergence properties. This article introduces novel methods for establishing bounds on the convergence rates of hybrid Gibbs samplers. In particular, we examine the convergence characteristics of hybrid random-scan Gibbs and data augmentation algorithms. Our analysis confirms that the absolute spectral gap of a hybrid chain can be bounded based on the absolute spectral gap of the exact Gibbs chain and the absolute spectral gaps of the Markov chains employed for conditional distribution approximations. For application, we study the convergence properties of four practical hybrid Gibbs algorithms: a random-scan Metropolis-within-Gibbs sampler, a hybrid proximal sampler, random-scan Gibbs samplers with block updates, and a hybrid slice sampler.


title: Stable Distillation: Regularizing Continued Pre-training for Low-Resource Automatic Speech Recognition

abstract: Continued self-supervised (SSL) pre-training for adapting existing SSL models to the target domain has shown to be extremely effective for low-resource Automatic Speech Recognition (ASR). This paper proposes Stable Distillation, a simple and novel approach for SSL-based continued pre-training that boosts ASR performance in the target domain where both labeled and unlabeled data are limited. Stable Distillation employs self-distillation as regularization for continued pre-training, alleviating the over-fitting issue, a common problem continued pre-training faces when the source and target domains differ. Specifically, first, we perform vanilla continued pre-training on an initial SSL pre-trained model on the target domain ASR dataset and call it the teacher. Next, we take the same initial pre-trained model as a student to perform continued pre-training while enforcing its hidden representations to be close to that of the teacher (via MSE loss). This student is then used for downstream ASR fine-tuning on the target dataset. In practice, Stable Distillation outperforms all our baselines by 0.8 - 7 WER when evaluated in various experimental settings.


title: Fast Cell Library Characterization for Design Technology Co-Optimization Based on Graph Neural Networks

abstract: Design technology co-optimization (DTCO) plays a critical role in achieving optimal power, performance, and area (PPA) for advanced semiconductor process development. Cell library characterization is essential in DTCO flow, but traditional methods are time-consuming and costly. To overcome these challenges, we propose a graph neural network (GNN)-based machine learning model for rapid and accurate cell library characterization. Our model incorporates cell structures and demonstrates high prediction accuracy across various process-voltage-temperature (PVT) corners and technology parameters. Validation with 512 unseen technology corners and over one million test data points shows accurate predictions of delay, power, and input pin capacitance for 33 types of cells, with a mean absolute percentage error (MAPE) $\le$ 0.95% and a speed-up of 100X compared with SPICE simulations. Additionally, we investigate system-level metrics such as worst negative slack (WNS), leakage power, and dynamic power using predictions obtained from the GNN-based model on unseen corners. Our model achieves precise predictions, with absolute error $\le$3.0 ps for WNS, percentage errors $\le$0.60% for leakage power, and $\le$0.99% for dynamic power, when compared to golden reference. With the developed model, we further proposed a fine-grained drive strength interpolation methodology to enhance PPA for small-to-medium-scale designs, resulting in an approximate 1-3% improvement.


title: Resolution of the incongruency of dipole asymmetries within various large radio surveys -- implications for the Cosmological Principle

abstract: We investigate dipole asymmetries in four large radio surveys, each spanning more than 80\% of the sky. Two of them, the Very Large Array Sky Survey (VLASS) and the Rapid ASKAP Continuum Survey (RACS), have recently yielded dipoles that appear incongruent with each other as well as seem inconsistent with previous radio survey dipoles and the Cosmic Microwave Background (CMB) dipole. Because these radio surveys have large overlaps in sky coverage, comprising hence large majority of common radio sources, one would not expect significant differences between their radio dipoles, irrespective of their underlying source of origin. We examine here in detail these radio dipoles, to ascertain the source of incongruency amongst them. We find the VLASS and RACS data to be containing some declination-dependent systematics, seemingly in the vicinity of the declination limit of each survey. We show that the effects of such systematics can be mitigated by restricting the declination limits of the respective survey during the dipole determination. A weighted mean of the sky coordinates of thus derived dipoles from the four radio surveys lies within $1.2\sigma$ of the CMB dipole direction. However, the amplitude appears significantly larger, $3.7\pm 0.6$ times or more than the CMB dipole. This puts in doubt not only the conventional wisdom that the genesis of all these dipoles, including that of the CMB dipole, is due to the Solar peculiar motion, it also raises uncomfortable questions about the Cosmological Principle (CP), the basis of the standard $\Lambda$CDM cosmological model.


title: Heterogeneous Transfer Learning for Building High-Dimensional Generalized Linear Models with Disparate Datasets

abstract: Development of comprehensive prediction models are often of great interest in many disciplines of science, but datasets with information on all desired features typically have small sample sizes. In this article, we describe a transfer learning approach for building high-dimensional generalized linear models using data from a main study that has detailed information on all predictors, and from one or more external studies that have ascertained a more limited set of predictors. We propose using the external dataset(s) to build reduced model(s) and then transfer the information on underlying parameters for the analysis of the main study through a set of calibration equations, while accounting for the study-specific effects of certain design variables. We then use a generalized method of moment (GMM) with penalization for parameter estimation and develop highly scalable algorithms for fitting models taking advantage of the popular glmnet package. We further show that the use of adaptive-Lasso penalty leads to the oracle property of underlying parameter estimates and thus leads to convenient post-selection inference procedures. We conduct extensive simulation studies to investigate both predictive performance and post-selection inference properties of the proposed method. Finally, we illustrate a timely application of the proposed method for the development of risk prediction models for five common diseases using the UK Biobank study, combining baseline information from all study participants (500K) and recently released high-throughout proteomic data (# protein = 1500) on a subset (50K) of the participants.


title: Calderon-preconditioned boundary integral equations of the Burton-Miller type for transmission problems

abstract: This paper proposes well-conditioned boundary integral equations based on the Burton-Miller method for solving transmission problems. The Burton-Miller method is widely accepted as a highly accurate numerical method based on the boundary integral equation for solving exterior wave problems. While this method can also be applied to solve the transmission problems, a straightforward formulation may yield ill-conditioned integral equations. Consequently, the resulting linear algebraic equations may involve a coefficient matrix with a huge condition number, leading to poor convergence of Krylov-based linear solvers. To address this challenge, our study enhances Burton-Miller-type boundary integral equations tailored for transmission problems by exploiting the Calderon formula. In cases where a single material exists in an unbounded host medium, we demonstrate the formulation of the boundary integral equation such that the underlying integral operator ${\cal A}$ is spectrally well-conditioned. Specifically, ${\cal A}$ can be designed in a simple manner that ensures ${\cal A}^2$ is bounded and has only a single eigenvalue accumulation point. Furthermore, we extend our analysis to the multi-material case, proving that the square of the proposed operator has only a few eigenvalues except for a compact perturbation. Through numerical examples of several benchmark problems, we illustrate that our formulation reduces the iteration number required by iterative linear solvers, even in the presence of material junction points; locations where three or more sub-domains meet on the boundary.


title: Leveraging Sample Entropy for Enhanced Volatility Measurement and Prediction in International Oil Price Returns

abstract: This paper explores the application of Sample Entropy (SampEn) as a sophisticated tool for quantifying and predicting volatility in international oil price returns. SampEn, known for its ability to capture underlying patterns and predict periods of heightened volatility, is compared with traditional measures like standard deviation. The study utilizes a comprehensive dataset spanning 27 years (1986-2023) and employs both time series regression and machine learning methods. Results indicate SampEn's efficacy in predicting traditional volatility measures, with machine learning algorithms outperforming standard regression techniques during financial crises. The findings underscore SampEn's potential as a valuable tool for risk assessment and decision-making in the realm of oil price investments.


title: SLP-Net:An efficient lightweight network for segmentation of skin lesions

abstract: Prompt treatment for melanoma is crucial. To assist physicians in identifying lesion areas precisely in a quick manner, we propose a novel skin lesion segmentation technique namely SLP-Net, an ultra-lightweight segmentation network based on the spiking neural P(SNP) systems type mechanism. Most existing convolutional neural networks achieve high segmentation accuracy while neglecting the high hardware cost. SLP-Net, on the contrary, has a very small number of parameters and a high computation speed. We design a lightweight multi-scale feature extractor without the usual encoder-decoder structure. Rather than a decoder, a feature adaptation module is designed to replace it and implement multi-scale information decoding. Experiments at the ISIC2018 challenge demonstrate that the proposed model has the highest Acc and DSC among the state-of-the-art methods, while experiments on the PH2 dataset also demonstrate a favorable generalization ability. Finally, we compare the computational complexity as well as the computational speed of the models in experiments, where SLP-Net has the highest overall superiority


title: Depolarizing Reference Devices in Generalized Probabilistic Theories

abstract: QBism is an interpretation of quantum theory which views quantum mechanics as standard probability theory supplemented with a few extra normative constraints. The fundamental gambit is to represent states and measurements, as well as time evolution, with respect to an informationally complete reference device. From this point of view, the Born rule appears as a coherence condition on probability assignments across several different experiments which manifests as a deformation of the law of total probability (LTP). In this work, we fully characterize those reference devices for which this deformation takes a "simplest possible" (term-wise affine) form. Working in the framework of generalized probability theories (GPTs), we show that, given any reference measurement, a set of post-measurement reference states can always be chosen to give its probability rule this very form. The essential condition is that the corresponding measure-and-prepare channel be depolarizing. We also relate our construction to Szymusiak and S{\l}omczy\'nski's recently introduced notion of morphophoricity and re-examine critically a matrix-norm-based measure of LTP deformation in light of our results. What stands out for the QBist project from this analysis is that it is not only the pure form of the Born rule that must be understood normatively, but the constants within it as well. It is they that carry the details of quantum theory.


title: Model-Based Control with Sparse Neural Dynamics

abstract: Learning predictive models from observations using deep neural networks (DNNs) is a promising new approach to many real-world planning and control problems. However, common DNNs are too unstructured for effective planning, and current control methods typically rely on extensive sampling or local gradient descent. In this paper, we propose a new framework for integrated model learning and predictive control that is amenable to efficient optimization algorithms. Specifically, we start with a ReLU neural model of the system dynamics and, with minimal losses in prediction accuracy, we gradually sparsify it by removing redundant neurons. This discrete sparsification process is approximated as a continuous problem, enabling an end-to-end optimization of both the model architecture and the weight parameters. The sparsified model is subsequently used by a mixed-integer predictive controller, which represents the neuron activations as binary variables and employs efficient branch-and-bound algorithms. Our framework is applicable to a wide variety of DNNs, from simple multilayer perceptrons to complex graph neural dynamics. It can efficiently handle tasks involving complicated contact dynamics, such as object pushing, compositional object sorting, and manipulation of deformable objects. Numerical and hardware experiments show that, despite the aggressive sparsification, our framework can deliver better closed-loop performance than existing state-of-the-art methods.


title: Cut elimination for propositional cyclic proof systems with fixed-point operators

abstract: Infinitary and cyclic proof systems are proof systems for logical formulas with fixed-point operators or inductive definitions. A cyclic proof system is a restriction of the corresponding infinitary proof system. Hence, these proof systems are generally not the same, as in the cyclic system may be weaker than the infinitary system. For several logics, the infinitary proof systems are shown to be cut-free complete. However, cyclic proof systems are characterized with many unknown problems on the (cut-free) completeness or the cut-elimination property. In this study, we show that the provability of infinitary and cyclic proof systems are the same for some propositional logics with fixed-point operators or inductive definitions and that the cyclic proof systems are cut-free complete.


title: High-resolution spectroscopic study of extremely metal-poor stars in the Large Magellanic Cloud

abstract: We present detailed abundance results based on UVES high dispersion spectra for 7 very and extremely metal-poor stars in the Large Magellanic Cloud. We confirm that all 7 stars, two of which have [Fe/H] $\leq$ --3.0, are the most metal-poor stars discovered so far in the Magellanic Clouds. The element abundance ratios are generally consistent with Milky Way halo stars of similar [Fe/H] values. We find that 2 of the more metal-rich stars in our sample are enhanced in r-process elements. This result contrasts with the literature, where all nine metal-poor LMC stars with higher [Fe/H] values than our sample were found to be rich in r-process elements. The absence of r-process enrichment in stars with lower [Fe/H] values is consistent with a minimum delay timescale of $\sim$100 Myr for the neutron star binary merger process to generate substantial r-process enhancements in the LMC. We find that the occurrence rate of r-process enhancement (r-I or r-II) in our sample of very and extremely metal-poor stars is statistically indistinguishable from that found in the Milky Way's halo, although including stars from the literature sample hints at a larger r-II frequency the LMC. Overall, our results shed light on the earliest epochs of star formation in the LMC that may be applicable to other galaxies of LMC-like mass.


title: Bandit Sequential Posted Pricing via Half-Concavity

abstract: Sequential posted pricing auctions are popular because of their simplicity in practice and their tractability in theory. A usual assumption in their study is that the Bayesian prior distributions of the buyers are known to the seller, while in reality these priors can only be accessed from historical data. To overcome this assumption, we study sequential posted pricing in the bandit learning model, where the seller interacts with $n$ buyers over $T$ rounds: In each round the seller posts $n$ prices for the $n$ buyers and the first buyer with a valuation higher than the price takes the item. The only feedback that the seller receives in each round is the revenue. Our main results obtain nearly-optimal regret bounds for single-item sequential posted pricing in the bandit learning model. In particular, we achieve an $\tilde{O}(\mathsf{poly}(n)\sqrt{T})$ regret for buyers with (Myerson's) regular distributions and an $\tilde{O}(\mathsf{poly}(n)T^{{2}/{3}})$ regret for buyers with general distributions, both of which are tight in the number of rounds $T$. Our result for regular distributions was previously not known even for the single-buyer setting and relies on a new half-concavity property of the revenue function in the value space. For $n$ sequential buyers, our technique is to run a generalized single-buyer algorithm for all the buyers and to carefully bound the regret from the sub-optimal pricing of the suffix buyers.


title: Joint Trading and Scheduling among Coupled Carbon-Electricity-Heat-Gas Industrial Clusters

abstract: This paper presents a carbon-energy coupling management framework for an industrial park, where the carbon flow model accompanying multi-energy flows is adopted to track and suppress carbon emissions on the user side. To deal with the quadratic constraint of gas flows, a bound tightening algorithm for constraints relaxation is adopted. The synergies among the carbon capture, energy storage, power-to-gas further consume renewable energy and reduce carbon emissions. Aiming at carbon emissions disparities and supply-demand imbalances, this paper proposes a carbon trading ladder reward and punishment mechanism and an energy trading and scheduling method based on Lyapunov optimization and matching game to maximize the long-term benefits of each industrial cluster without knowing the prior information of random variables. Case studies show that our proposed trading method can reduce overall costs and carbon emissions while relieving energy pressure, which is important for Environmental, Social and Governance (ESG).


title: CMC Foliations and their conformal aspects

abstract: On a manifold we term a hypersurface foliation a slicing if it is the level set foliation of a slice function -- meaning some real valued function $f$ satisfying that $df$ is nowhere zero. On Riemannian manifolds we give a non-linear PDE on functions whose solutions are generic constant-mean-curvature (CMC) slice functions. Conversely, to any generic transversely-oriented constant-mean-curvature foliation the equation uniquely associates such a function. In one sense the equation is a scalar analogue of the Einstein equations. Given any slicing we show that, locally, one can conformally prescribe any smooth mean curvature function. We use this to show that, locally on a Riemannian manifold, a slicing is CMC for a conformally related metric. These results admit global versions assuming certain restrictions. Finally, given a conformally compact manifold we study the problem of normalising the defining function so that it is a CMC slice function for a compactifying metric. We show that two cases of this problem are formally solvable to all orders.


title: Join Sampling under Acyclic Degree Constraints and (Cyclic) Subgraph Sampling

abstract: Given a join with an acyclic set of degree constraints, we show how to draw a uniformly random sample from the join result in $O(\mathit{polymat}/ \max \{1, \mathrm{OUT} \})$ expected time after a preprocessing of $O(\mathrm{IN})$ expected time, where $\mathrm{IN}$, $\mathrm{OUT}$, and $\mathit{polymat}$ are the join's input size, output size, and polymatroid bound, respectively. This compares favorably with the state of the art (Deng et al.\ and Kim et al., both in PODS'23), which states that a uniformly random sample can be drawn in $\tilde{O}(\mathrm{AGM} / \max \{1, \mathrm{OUT}\})$ expected time after a preprocessing phase of $\tilde{O}(\mathrm{IN})$ expected time, where $\mathrm{AGM}$ is the join's AGM bound. We then utilize our techniques to tackle {\em directed subgraph sampling}. Let $G = (V, E)$ be a directed data graph where each vertex has an out-degree at most $\lambda$, and let $P$ be a directed pattern graph with $O(1)$ vertices. The objective is to uniformly sample an occurrence of $P$ in $G$. The problem can be modeled as join sampling with input size $\mathrm{IN} = \Theta(|E|)$ but, whenever $P$ contains cycles, the converted join has {\em cyclic} degree constraints. We show that it is always possible to throw away certain degree constraints such that (i) the remaining constraints are acyclic and (ii) the new join has asymptotically the same polymatroid bound $\mathit{polymat}$ as the old one. Combining this finding with our new join sampling solution yields an algorithm to sample from the original (cyclic) join (thereby yielding a uniformly random occurrence of $P$) in $O(\mathit{polymat}/ \max \{1, \mathrm{OUT}\})$ expected time after $O(|E|)$ expected-time preprocessing. We also prove similar results for {\em undirected subgraph sampling} and demonstrate how our techniques can be significantly simplified in that scenario.


title: Effect of Resonant Acoustic Powder Mixing on Delay Time of W-KClO4-BaCrO4 Mixtures

abstract: This study investigates the impact of resonant acoustic powder mixing on the delay time of the W-KClO4-BaCrO4 (WKB) mixture and its potential implications for powder and material synthesis. Through thermal analysis, an inverse linear relationship was found between thermal conductivity and delay time, allowing us to use thermal conductivity as a reliable proxy for the delay time. By comparing the thermal conductivity of WKB mixtures mixed manually and using acoustic powder mixer, we found that acoustic powder mixing resulted in minimal deviations in thermal conductivity, proving more uniform mixing. Furthermore, DSC analysis and Sestak-Berggren modeling demonstrated consistent reaction dynamics with a constant activation energy as the reaction progressed in samples mixed using acoustic waves. These findings underscore the critical role of uniform powder mixing in enhancing the thermodynamic quality of the WKB mixture and emphasize the importance of developing novel methods for powder and material synthesis.


title: An Algebraic Roadmap of Particle Theories, Part II: Theoretical checkpoints

abstract: An optimal algebraic model of particle physics has a number of checkpoints to pass. As a minimum, models should $\langle 1 \rangle$ conform to the Coleman-Mandula theorem (or establish a loophole), $\langle 2 \rangle$ evade familiar fermion doubling problems, $\langle 3 \rangle$ naturally explain the Standard Model's chirality, $\langle 4 \rangle$ exclude B-L gauge symmetry at low energy, and $\langle 5 \rangle$ explain the existence of three generations. We demonstrate how the model introduced in [1] passes checkpoints $\langle 1 \rangle, \langle 2 \rangle, \langle 3 \rangle, \langle 4 \rangle$, and has yet to cross $\langle 5 \rangle$. We close by elucidating an unexpected appearance of spacetime symmetries.


title: A note on Wigner-Yanase skew information-based uncertainty of quantum channels

abstract: The variance of quantum channels involving a mixed state gives a hybrid of classical and quantum uncertainties. We seek certain decomposition of variance into classical and quantum parts in terms of the Wigner-Yanase skew information. Generalizing the uncertainty relations for quantum observables to quantum channels, we introduce a new quantity with better quantum mechanical nature to describe the uncertainty relations for quantum channels. We derive several uncertainty relations for quantum channels via variances and the Wigner-Yanase skew information.


title: Airborne Ouzo: Evaporation-induced emulsification and phase separation dynamics of ternary droplets in acoustic levitation

abstract: We experimentally investigated the evaporation dynamics of acoustically levitated Ouzo droplets (a mixture of ethanol, water, and anise oil). Acoustic levitation has gained significant attention in various fields due to its potential to create a lab-in-a-drop. Although evaporation is a key process in nature and industry, many studies have focused on single and binary components, and ternary droplets in acoustic levitation have rarely been experimentally investigated. In this study, the evaporation-induced spontaneous emulsification (the Ouzo effect) and phase separation process at 40-90 vol% ethanol were visualized. We estimated the concentration change by evaporation of each component in the levitated ternary droplets based on the evaporation model to identify the experimental results. Our experimental results revealed four distinct stages of evaporation in levitated Ouzo droplets: (1) preferential evaporation of the volatile component (ethanol), (2) spontaneous emulsification (myriad micro-oil droplets generation), (3) phase separation forming a core-shell droplet, and (4) water evaporation completion resulting in remaining an oil droplet. Finally, we analyzed the emulsification process by a spacetime diagram. These findings suggest that acoustic levitation is suitable for physicochemical manipulation in mid-air.


title: Atomic electron transitions of hydrogen-like atoms induced by gravitational waves

abstract: As a realistic model of a quantum system of matter, this paper investigates the gravitational-wave effects on a hydrogen-like atom. By formulating the tetrad formalism of linearized gravity, we naturally incorporate the gravitational-wave effects through minimal coupling in the covariant Dirac equation. The atomic electron transition rates induced by the gravitational wave are calculated using the first-order perturbation theory, revealing a distinctive selection rule along with Fermi's golden rule. This rule can be elegantly understood in terms of gravitons as massless spin-2 particles. Our results suggest the existence of gravitons and may lead to a novel approach to probe Ultra-High-Frequency Gravitational Waves (UHF-GWs).


title: Repairing Schemes for Tamo-Barg Codes

abstract: In this paper, we explore a practical system setting where a rack-aware storage system consists of racks, each containing a few parity checks, referred to as a rack-aware system with locality. To minimize cross-rack bandwidth in this system, we organize the repair sets of locally repairable codes into racks and investigate the problem of repairing erasures in locally repairable codes beyond the code locality. We devise two repair schemes to reduce the repair bandwidth for Tamo-Barg codes under the rack-aware model by setting each repair set as a rack. We then establish a cut-set bound for locally repairable codes under the rack-aware model with locality. Using this bound we show that our second repair scheme is optimal. Furthermore, we consider the partial-repair problem for locally repairable codes under the rack-aware model with locality, and introduce both repair schemes and bounds for this scenario.


title: Multi-stages attention Breast cancer classification based on nonlinear spiking neural P neurons with autapses

abstract: Breast cancer(BC) is a prevalent type of malignant tumor in women. Early diagnosis and treatment are vital for enhancing the patients' survival rate. Downsampling in deep networks may lead to loss of information, so for compensating the detail and edge information and allowing convolutional neural networks to pay more attention to seek the lesion region, we propose a multi-stages attention architecture based on NSNP neurons with autapses. First, unlike the single-scale attention acquisition methods of existing methods, we set up spatial attention acquisition at each feature map scale of the convolutional network to obtain an fusion global information on attention guidance. Then we introduce a new type of NSNP variants called NSNP neurons with autapses. Specifically, NSNP systems are modularized as feature encoders, recoding the features extracted from convolutional neural network as well as the fusion of attention information and preserve the key characteristic elements in feature maps. This ensures the retention of valuable data while gradually transforming high-dimensional complicated info into low-dimensional ones. The proposed method is evaluated on the public dataset BreakHis at various magnifications and classification tasks. It achieves a classification accuracy of 96.32% at all magnification cases, outperforming state-of-the-art methods. Ablation studies are also performed, verifying the proposed model's efficacy. The source code is available at XhuBobYoung/Breast-cancer-Classification.


title: Strain-driven Charge Localisation and Spin Dynamics of Paramagnetic Defects in S-deficit 2H-MoS2 Nanocrystals

abstract: A microscopic control over the origin and dynamics of localised spin centres in lower dimensional solids turns out to be a key factor for next generation spintronics and quantum technologies. With the help of low temperature electron paramagnetic resonance (EPR) measurements, supported by the first-principles calculations within density functional theory (DFT) formulation, we found the origin of different high-spin paramagnetic intrinsic charge-centres, Mo3+(4d3) and Mo2+(4d4) present in the nano-crystalline sulfur deficit hexagonal molybdenum disulfide (2H-MoS_(2-x)), against the established notion of spin-1/2 , Mo5+ centres. A critical strain generated in the nano-structured 2H-MoS_(2-x) was found to be very crucial for spin-localization in this layered material. Indeed, computationally effective proposition of the PBE+U exchange-correlations within DFT including D3-dispersion corrections found to be more viable than expensive higher rung of exchange-correlation functionals, explored earlier. It is also found that the oxygen vacancy of the reduced oxide phase, embedded in 2H-MoS_(2-x) host lattice, has the longest relaxation times. Moreover, the temperature dependence of spin-lattice relaxation measurements reveals a direct process for interstitial spin centres and a Raman process for both sulfur and oxygen vacancy sites. We expect such observation would be a valuable pillar for better understanding of the next generation quantum technologies and device applications.


title: MedBench: A Large-Scale Chinese Benchmark for Evaluating Medical Large Language Models

abstract: The emergence of various medical large language models (LLMs) in the medical domain has highlighted the need for unified evaluation standards, as manual evaluation of LLMs proves to be time-consuming and labor-intensive. To address this issue, we introduce MedBench, a comprehensive benchmark for the Chinese medical domain, comprising 40,041 questions sourced from authentic examination exercises and medical reports of diverse branches of medicine. In particular, this benchmark is composed of four key components: the Chinese Medical Licensing Examination, the Resident Standardization Training Examination, the Doctor In-Charge Qualification Examination, and real-world clinic cases encompassing examinations, diagnoses, and treatments. MedBench replicates the educational progression and clinical practice experiences of doctors in Mainland China, thereby establishing itself as a credible benchmark for assessing the mastery of knowledge and reasoning abilities in medical language learning models. We perform extensive experiments and conduct an in-depth analysis from diverse perspectives, which culminate in the following findings: (1) Chinese medical LLMs underperform on this benchmark, highlighting the need for significant advances in clinical knowledge and diagnostic precision. (2) Several general-domain LLMs surprisingly possess considerable medical knowledge. These findings elucidate both the capabilities and limitations of LLMs within the context of MedBench, with the ultimate goal of aiding the medical research community.