title: Dynamically configured physics-informed neural network in topology optimization applications

abstract: Integration of machine learning (ML) into the topology optimization (TO) framework is attracting increasing attention, but data acquisition in data-driven models is prohibitive. Compared with popular ML methods, the physics-informed neural network (PINN) can avoid generating enormous amounts of data when solving forward problems and additionally provide better inference. To this end, a dynamically configured PINN-based topology optimization (DCPINN-TO) method is proposed. The DCPINN is composed of two subnetworks, namely the backbone neural network (NN) and the coefficient NN, where the coefficient NN has fewer trainable parameters. The designed architecture aims to dynamically configure trainable parameters; that is, an inexpensive NN is used to replace an expensive one at certain optimization cycles. Furthermore, an active sampling strategy is proposed to selectively sample collocations depending on the pseudo-densities at each optimization cycle. In this manner, the number of collocations will decrease with the optimization process but will hardly affect it. The Gaussian integral is used to calculate the strain energy of elements, which yields a byproduct of decoupling the mapping of the material at the collocations. Several examples with different resolutions validate the feasibility of the DCPINN-TO method, and multiload and multiconstraint problems are employed to illustrate its generalization. In addition, compared to finite element analysis-based TO (FEA-TO), the accuracy of the displacement prediction and optimization results indicate that the DCPINN-TO method is effective and efficient.


title: The behavioral intention to adopt Proptech services in Vietnam real estate market

abstract: One of the main stages for achieving success is the adoption of new technology by its users. Several studies show that Property technology is advantageous for real estate stakeholders. Hence, the purpose of this paper is to investigate the users' engagement behavior to adopt Property technology in the Vietnamese real estate market. To that end, a purposive sample of 142 participants was recruited to complete an online quantitative approach based survey. The survey consisted of a modified and previously validated measure of acceptance based on the extended demographic version of the unified theory of acceptance and use of technology), as well as usage scale items. The empirical findings confirm that participants were generally accepting of Property technology in the Vietnamese real estate market. The highest mean values were associated with the subscales of effort expectancy and performance expectancy, while we can easily identify the lowest mean value in the social influence subscale. The usage of Property technology was slightly more concerned with the gathering of information on properties and markets than transactions or portfolio management. This study provides an in depth understanding of Property technology for firms' managers and marketers. Online social interactions might be either harmful or fruitful for firms depending on the type of interaction and engagement behavior. This is especially true of property portals and social media forums that would help investors to connect, communicate and learn. Findings can help users to improve their strategies for digital marketing. By providing robust findings by addressing issues like omitted variables and endogeneity, the findings of this study are promising for developing new hypotheses and theoretical models in the context of the Vietnamese real estate market.


title: Transformer-based No-Reference Image Quality Assessment via Supervised Contrastive Learning

abstract: Image Quality Assessment (IQA) has long been a research hotspot in the field of image processing, especially No-Reference Image Quality Assessment (NR-IQA). Due to the powerful feature extraction ability, existing Convolution Neural Network (CNN) and Transformers based NR-IQA methods have achieved considerable progress. However, they still exhibit limited capability when facing unknown authentic distortion datasets. To further improve NR-IQA performance, in this paper, a novel supervised contrastive learning (SCL) and Transformer-based NR-IQA model SaTQA is proposed. We first train a model on a large-scale synthetic dataset by SCL (no image subjective score is required) to extract degradation features of images with various distortion types and levels. To further extract distortion information from images, we propose a backbone network incorporating the Multi-Stream Block (MSB) by combining the CNN inductive bias and Transformer long-term dependence modeling capability. Finally, we propose the Patch Attention Block (PAB) to obtain the final distorted image quality score by fusing the degradation features learned from contrastive learning with the perceptual distortion information extracted by the backbone network. Experimental results on seven standard IQA datasets show that SaTQA outperforms the state-of-the-art methods for both synthetic and authentic datasets. Code is available at https://github.com/I2-Multimedia-Lab/SaTQA


title: Depth formula for modules of finite reducing projective dimension

abstract: We prove that the depth formula holds for two finitely generated Tor-independent modules over Cohen-Macaulay local rings if one of the modules considered has finite reducing projective dimension (for example, if it has finite projective dimension, or the ring is a complete intersection). This generalizes a result of Bergh-Jorgensen which shows that the depth formula holds for two finitely generated Tor-independent modules over Cohen-Macaulay local rings if one of the modules considered has reducible complexity and certain additional conditions hold. Each module that has reducible complexity also has finite complexity and finite reducing projective dimension, but not necessarily vice versa. So a new advantage we have is that, unlike modules of reducible complexity, Betti numbers of modules of finite reducing projective dimension can grow exponentially.


title: Shape-dependent motility of polar inclusions in active baths

abstract: Collections of persistently moving active particles are an example of a nonequilibrium heat bath. One way to study the nature of nonequilibrium fluctuations in such systems is to follow the dynamics of an embedded probe particle. With this aim, we study the dynamics of an anisotropic inclusion embedded in a bath of active particles. By studying various statistical correlation functions of the dynamics, we show that the emergent motility of this inclusion depends on its shape as well as the properties of the active bath. We demonstrate that both the decorrelation time of the net force on the inclusion and the dwell time of bath particles in a geometrical trap on the inclusion have a non-monotonic dependence on its shape. We also find that the motility of the inclusion is optimal when the volume fraction of the active bath is close to the value for the onset of motility induced phase separation.


title: Families of KP solutions associated with tropical curves having nontrivial weights

abstract: In order to generalize a program by Agostini and others producing new KP solutions, we construct families of quasi-periodic KP solutions which are derived from degenerating Riemann surfaces associated with tropical curves having nontrivial weights. By taking the regularized tropical limits of these solutions, we obtain formulas of general KP solutions which are expressed by mixtures of solitons and Riemann theta functions.


title: DGNet: Dynamic Gradient-Guided Network for Water-Related Optics Image Enhancement

abstract: Underwater image enhancement (UIE) is a challenging task due to the complex degradation caused by underwater environments. To solve this issue, previous methods often idealize the degradation process, and neglect the impact of medium noise and object motion on the distribution of image features, limiting the generalization and adaptability of the model. Previous methods use the reference gradient that is constructed from original images and synthetic ground-truth images. This may cause the network performance to be influenced by some low-quality training data. Our approach utilizes predicted images to dynamically update pseudo-labels, adding a dynamic gradient to optimize the network's gradient space. This process improves image quality and avoids local optima. Moreover, we propose a Feature Restoration and Reconstruction module (FRR) based on a Channel Combination Inference (CCI) strategy and a Frequency Domain Smoothing module (FRS). These modules decouple other degradation features while reducing the impact of various types of noise on network performance. Experiments on multiple public datasets demonstrate the superiority of our method over existing state-of-the-art approaches, especially in achieving performance milestones: PSNR of 25.6dB and SSIM of 0.93 on the UIEB dataset. Its efficiency in terms of parameter size and inference time further attests to its broad practicality. The code will be made publicly available.


title: Alignment for Honesty

abstract: Recent research has made significant strides in applying alignment techniques to enhance the helpfulness and harmlessness of large language models (LLMs) in accordance with human intentions. In this paper, we argue for the importance of alignment for honesty, ensuring that LLMs proactively refuse to answer questions when they lack knowledge, while still not being overly conservative. However, a pivotal aspect of alignment for honesty involves discerning the limits of an LLM's knowledge, which is far from straightforward. This challenge demands comprehensive solutions in terms of metric development, benchmark creation, and training methodologies. In this paper, we address these challenges by first establishing a precise problem definition and defining ``honesty'' inspired by the Analects of Confucius. This serves as a cornerstone for developing metrics that effectively measure an LLM's honesty by quantifying its progress post-alignment. Furthermore, we introduce a flexible training framework which is further instantiated by several efficient fine-tuning techniques that emphasize honesty without sacrificing performance on other tasks. Our extensive experiments reveal that these aligned models show a marked increase in honesty, as indicated by our proposed metrics. We open-source a wealth of resources to facilitate future research at https://github.com/GAIR-NLP/alignment-for-honesty, including honesty-aligned models, training and evaluation datasets for honesty alignment, concept glossary, as well as all relevant source code.


title: Stein Coverage: a Variational Inference Approach to Distribution-matching Multisensor Deployment

abstract: This paper examines the spatial coverage optimization problem for multiple sensors in a known convex environment, where the coverage service of each sensor is heterogeneous and anisotropic. We introduce the Stein Coverage algorithm, a distribution-matching coverage approach that aims to place sensors at positions and orientations such that their collective coverage distribution is as close as possible to the event distribution. To select the most important representative points from the coverage event distribution, Stein Coverage utilizes the Stein Variational Gradient Descent (SVGD), a deterministic sampling method from the variational inference literature. An innovation in our work is the introduction of a repulsive force between the samples in the SVGD algorithm to spread the samples and avoid footprint overlap for the deployed sensors. After pinpointing the points of interest for deployment, Stein Coverage solves the multisensor assignment problem using a bipartite optimal matching process. Simulations demonstrate the advantages of the Stein Coverage method compared to conventional Voronoi partitioning multisensor deployment methods.


title: Non-radial Blow-up for a mass-critical fourth-order inhomogeneous nonlinear Schr\"odinger equation

abstract: We investigate the blow-up for fourth-order Schr\"odinger equation with a mas-critical focusing inhomogeneous nonliniearity. We prove the finite/infinite time blow-up of non-radial solutions with negative energy. Our result serves as a valuable complement to the existing literature, offering an improvement in our understanding of the subject matter.


title: RACER: Rational Artificial Intelligence Car-following-model Enhanced by Reality

abstract: This paper introduces RACER, the Rational Artificial Intelligence Car-following model Enhanced by Reality, a cutting-edge deep learning car-following model, that satisfies partial derivative constraints, designed to predict Adaptive Cruise Control (ACC) driving behavior while staying theoretically feasible. Unlike conventional models, RACER effectively integrates Rational Driving Constraints (RDCs), crucial tenets of actual driving, resulting in strikingly accurate and realistic predictions. Against established models like the Optimal Velocity Relative Velocity (OVRV), a car-following Neural Network (NN), and a car-following Physics-Informed Neural Network (PINN), RACER excels across key metrics, such as acceleration, velocity, and spacing. Notably, it displays a perfect adherence to the RDCs, registering zero violations, in stark contrast to other models. This study highlights the immense value of incorporating physical constraints within AI models, especially for augmenting safety measures in transportation. It also paves the way for future research to test these models against human driving data, with the potential to guide safer and more rational driving behavior. The versatility of the proposed model, including its potential to incorporate additional derivative constraints and broader architectural applications, enhances its appeal and broadens its impact within the scientific community.


title: Open-orbit induced low field extremely large magnetoresistance in graphene/h-BN superlattices

abstract: We report intriguing and hitherto overlooked low-field room temperature extremely large magnetoresistance (XMR) patterns in graphene/hexagonal boron nitride (h-BN) superlattices that emerge due to the existence of open orbits within each miniband. This finding is set against the backdrop of the experimental discovery of the Hofstadter butterfly in moir superlattices, which has sparked considerable interest in the fractal quantum Hall regime. To cope with the challenge of deciphering the low magnetic field dynamics of moir minibands, we utilize a novel semi-classical calculation method, grounded in zero-field Fermi contours, to predict the nontrivial behavior of the Landau-level spectrum. This is compared with fully quantum simulations, enabling an in-depth and contrasted analysis of transport measurements in high-quality graphene-hBN superlattices. Our results not only highlight the primary observation of the open-orbit induced XMR in this system but also shed new light on other intricate phenomena. These include the nuances of single miniband dynamics, evident through Lifshitz transitions, and the complex interplay of semiclassical and quantum effects between these minibands. Specifically, we document transport anomalies linked to trigonal warping, a semiclassical deviation from the expected linear characteristics of Landau levels, and magnetic breakdown phenomena indicative of quantum tunneling, all effects jointly contributing to the intricacies of a rich electronic landscape uncovered at low magnetic fields.


title: Extremal results on degree powers in some classes of graphs

abstract: Let $G$ be a simple graph of order $n$ with degree sequence $(d_1,d_2,\cdots,d_n)$. For an integer $p>1$, let $e_p(G)=\sum_{i=1}^n d^{p}_i$ and let $ex_p(n,H)$ be the maximum value of $e_p(G)$ among all graphs with $n$ vertices that do not contain $H$ as a subgraph (known as $H$-free graphs). Caro and Yuster proposed the problem of determining the exact value of $ex_2(n,C_4)$, where $C_4$ is the cycle of length $4$. In this paper, we show that if $G$ is a $C_4$-free graph having $n\geq 4$ vertices and $m\leq \lfloor 3(n-1)/2\rfloor$ edges and no isolated vertices, then $e_p(G)\leq e_p(F_n)$, with equality if and only if $G$ is the friendship graph $F_n$. This yields that for $n\geq 4$, $ex_p(n,\mathcal{C}^*)=e_p(F_n)$ and $F_n$ is the unique extremal graph, which is an improved complement of Caro and Yuster's result on $ex_p(n,\mathcal{C}^*)$, where $\mathcal{C}^*$ denotes the family of cycles of even lengths. We also determine the maximum value of $e_p(\cdot)$ among all minimally $t$-(edge)-connected graphs with small $t$ or among all $k$-degenerate graphs, and characterize the corresponding extremal graphs. A key tool in our approach is majorization.


title: Mixed Pseudo Labels for Semi-Supervised Object Detection

abstract: While the pseudo-label method has demonstrated considerable success in semi-supervised object detection tasks, this paper uncovers notable limitations within this approach. Specifically, the pseudo-label method tends to amplify the inherent strengths of the detector while accentuating its weaknesses, which is manifested in the missed detection of pseudo-labels, particularly for small and tail category objects. To overcome these challenges, this paper proposes Mixed Pseudo Labels (MixPL), consisting of Mixup and Mosaic for pseudo-labeled data, to mitigate the negative impact of missed detections and balance the model's learning across different object scales. Additionally, the model's detection performance on tail categories is improved by resampling labeled data with relevant instances. Notably, MixPL consistently improves the performance of various detectors and obtains new state-of-the-art results with Faster R-CNN, FCOS, and DINO on COCO-Standard and COCO-Full benchmarks. Furthermore, MixPL also exhibits good scalability on large models, improving DINO Swin-L by 2.5% mAP and achieving nontrivial new records (60.2% mAP) on the COCO val2017 benchmark without extra annotations.


title: Engineering of high-$Q$ states via collective mode coupling in chains of Mie resonators

abstract: Efficient trapping of light in nanostructures is essential for the development of optical devices that are based on the interaction between light and matter. In this work, we show theoretically and experimentally that one-dimensional arrays of subwavelength dielectric Mie-resonant particles can support collective resonances with increased $Q$-factors. We demonstrate that the increase of the $Q$-factor can be explained by interaction between the collective electric and magnetic dipole modes of the chain resulting in appearance of the inflection point at the band edge. The considered effect is studied experimentally in the chain of high-index ceramic cylinders in the microwave spectral range.


title: Frozen natural orbitals for the state-averaged driven similarity renormalization group

abstract: We present a reduced-cost implementation of the state-averaged driven similarity renormalization group (SA-DSRG) based on the frozen natural orbital (FNO) approach. The natural orbitals (NOs) are obtained by diagonalizing the one-body reduced density matrix from SA-DSRG second-order perturbation theory (SA-DSRG-PT2). Subsequently, the virtual NOs with occupation numbers (ONs) smaller than a user-defined threshold are excluded from the high-level electron correlation treatment beyond SA-DSRG-PT2. An additive second-order correction is applied to the SA-DSRG Hamiltonian to reintroduce the correlation effect from the discarded orbitals. The FNO SA-DSRG method is benchmarked on 35 small organic molecules in the QUEST database. When keeping 98-99% of the cumulative ONs, the mean absolute error in the vertical transition energies due to FNO is less than 0.01 eV. Using the same FNO threshold, we observe a speedup of 9 times the conventional SA-DSRG implementation for nickel carbonyl with a quadruple-$\zeta$ basis set. The FNO approach enables third-order SA-DSRG perturbation theory computations on chloroiron corrole [FeCl(C$_{19}$H$_{11}$N$_4$)] with more than 1000 basis functions.


title: Vision-language Assisted Attribute Learning

abstract: Attribute labeling at large scale is typically incomplete and partial, posing significant challenges to model optimization. Existing attribute learning methods often treat the missing labels as negative or simply ignore them all during training, either of which could hamper the model performance to a great extent. To overcome these limitations, in this paper we leverage the available vision-language knowledge to explicitly disclose the missing labels for enhancing model learning. Given an image, we predict the likelihood of each missing attribute label assisted by an off-the-shelf vision-language model, and randomly select to ignore those with high scores in training. Our strategy strikes a good balance between fully ignoring and negatifying the missing labels, as these high scores are found to be informative on revealing label ambiguity. Extensive experiments show that our proposed vision-language assisted loss can achieve state-of-the-art performance on the newly cleaned VAW dataset. Qualitative evaluation demonstrates the ability of the proposed method in predicting more complete attributes.


title: Regularized lattice Boltzmann method based maximum principle and energy stability preserving finite-difference scheme for the Allen-Cahn equation

abstract: The Allen-Cahn equation (ACE) inherently possesses two crucial properties: the maximum principle and the energy dissipation law. Preserving these two properties at the discrete level is also necessary in the numerical methods for the ACE. In this paper, unlike the traditional top-down macroscopic numerical schemes which discretize the ACE directly, we first propose a novel bottom-up mesoscopic regularized lattice Boltzmann method based macroscopic numerical scheme for d (=1, 2, 3)-dimensional ACE, where the DdQ(2d+1) [(2d+1) discrete velocities in d-dimensional space] lattice structure is adopted. In particular, the proposed macroscopic numerical scheme has a second-order accuracy in space, and can also be viewd as an implicit-explicit finite-difference scheme for the ACE, in which the nonlinear term is discretized semi-implicitly, the temporal derivative and dissipation term of the ACE are discretized by using the explicit Euler method and second-order central difference method, respectively. Then we also demonstrate that the proposed scheme can preserve the maximum bound principle and the original energy dissipation law at the discrete level under some conditions. Finally, some numerical experiments are conducted to validate our theoretical analysis.


title: Securing MIMO Wiretap Channel with Learning-Based Friendly Jamming under Imperfect CSI

abstract: Wireless communications are particularly vulnerable to eavesdropping attacks due to their broadcast nature. To effectively deal with eavesdroppers, existing security techniques usually require accurate channel state information (CSI), e.g., for friendly jamming (FJ), and/or additional computing resources at transceivers, e.g., cryptography-based solutions, which unfortunately may not be feasible in practice. This challenge is even more acute in low-end IoT devices. We thus introduce a novel deep learning-based FJ framework that can effectively defeat eavesdropping attacks with imperfect CSI and even without CSI of legitimate channels. In particular, we first develop an autoencoder-based communication architecture with FJ, namely AEFJ, to jointly maximize the secrecy rate and minimize the block error rate at the receiver without requiring perfect CSI of the legitimate channels. In addition, to deal with the case without CSI, we leverage the mutual information neural estimation (MINE) concept and design a MINE-based FJ scheme that can achieve comparable security performance to the conventional FJ methods that require perfect CSI. Extensive simulations in a multiple-input multiple-output (MIMO) system demonstrate that our proposed solution can effectively deal with eavesdropping attacks in various settings. Moreover, the proposed framework can seamlessly integrate MIMO security and detection tasks into a unified end-to-end learning process. This integrated approach can significantly maximize the throughput and minimize the block error rate, offering a good solution for enhancing communication security in wireless communication systems.


title: Inferring interaction networks from transcriptomic data: methods and applications

abstract: Transcriptomic data is a treasure-trove in modern molecular biology, as it offers a comprehensive viewpoint into the intricate nuances of gene expression dynamics underlying biological systems. This genetic information must be utilised to infer biomolecular interaction networks that can provide insights into the complex regulatory mechanisms underpinning the dynamic cellular processes. Gene regulatory networks and protein-protein interaction networks are two major classes of such networks. This chapter thoroughly investigates the wide range of methodologies used for distilling insightful revelations from transcriptomic data that include association based methods (based on correlation among expression vectors), probabilistic models (using Bayesian and Gaussian models), and interologous methods. We reviewed different approaches for evaluating the significance of interactions based on the network topology and biological functions of the interacting molecules, and discuss various strategies for the identification of functional modules. The chapter concludes with highlighting network based techniques of prioritising key genes, outlining the centrality based, diffusion based and subgraph based methods. The chapter provides a meticulous framework for investigating transcriptomic data to uncover assembly of complex molecular networks for their adaptable analyses across a broad spectrum of biological domains.


title: Photonic spin Hall effect in Haldane materials

abstract: The photonic spin Hall effect of light beams reflected from the surfaces of various two-dimensional hexagonal crystalline structures, considering their associated time-reversal $\mathcal{T}$ and inversion $\mathcal{I}$ symmetries, is investigated. Employing the Haldane model with tunable parameters as a generic model, we examine the longitudinal and transverse spin-separations of the reflected beam in both topological non-trivial and trivial systems. The study reveals that the sign switching of the PSHE in these materials is attributed to the non-trivial and trivial topology. By manipulating the interplay between spin-orbit coupling and external electric fields, we demonstrate topological phase transitions in buckled Xene monolayer materials through the photonic spin Hall effect. Different behaviors of the photonic spin Hall effect are observed in various topological phases within these materials. Additionally, we explore the reflected spin and valley-polarized spatial shifts in monolayer transition metal dichalcogenides. The photonic spin Hall effect in buckled Xene monolayer materials and transition metal dichalcogenides is highly influenced by the spin and valley degrees of freedom of charge carriers, offering a promising avenue to explore spintronics and valleytronics in these hexagonal materials. We propose that the photonic spin Hall effect in Haldane materials can serve as a metrological tool for optical parameter characterization and as a promising method for determining Chern numbers and topological phase transitions through direct optical weak measurement techniques.


title: Swarmalators on a ring with uncorrelated pinning

abstract: We present a case study of swarmalators (mobile oscillators) which move on a 1D ring and are subject to pinning. Previous work considered the special case where the pinning in space and the pinning in the phase dimension were correlated. Here we study the general case where the space and phase pinning are uncorrelated, both being chosen uniformly at random. This induces several new effects, such as pinned async, mixed states, and a first order phase transition. These phenomena may be found in real world swarmalators such as systems of vinegar eels, Janus matchsticks, electrorotated Quincke rollers or Japanese tree frogs.


abstract: Motivated by precision computations of neutrino decoupling at MeV temperatures, we show how QED corrections to the thermal neutrino interaction rate can be related to the electron-positron spectral function as well as an effective $\bar{\nu}\nu\gamma$ vertex. The spectral function is needed both in a timelike and in a spacelike domain, and for both of its physical polarization states (transverse and longitudinal with respect to spatial momentum). Incorporating an NLO evaluation of this spectral function, an estimate of the $\bar{\nu}\nu\gamma$ vertex, and HTL resummation of scatterings mediated by soft Bose-enhanced $t$-channel photons, we compute the interaction rate as a function of the neutrino momentum and flavour. Effects on the $ -(0...2)\%$ level are found, noticeably smaller than a previous estimate of a related quantity.


title: Hyper-Restormer: A General Hyperspectral Image Restoration Transformer for Remote Sensing Imaging

abstract: The deep learning model Transformer has achieved remarkable success in the hyperspectral image (HSI) restoration tasks by leveraging Spectral and Spatial Self-Attention (SA) mechanisms. However, applying these designs to remote sensing (RS) HSI restoration tasks, which involve far more spectrums than typical HSI (e.g., ICVL dataset with 31 bands), presents challenges due to the enormous computational complexity of using Spectral and Spatial SA mechanisms. To address this problem, we proposed Hyper-Restormer, a lightweight and effective Transformer-based architecture for RS HSI restoration. First, we introduce a novel Lightweight Spectral-Spatial (LSS) Transformer Block that utilizes both Spectral and Spatial SA to capture long-range dependencies of input features map. Additionally, we employ a novel Lightweight Locally-enhanced Feed-Forward Network (LLFF) to further enhance local context information. Then, LSS Transformer Blocks construct a Single-stage Lightweight Spectral-Spatial Transformer (SLSST) that cleverly utilizes the low-rank property of RS HSI to decompose the feature maps into basis and abundance components, enabling Spectral and Spatial SA with low computational cost. Finally, the proposed Hyper-Restormer cascades several SLSSTs in a stepwise manner to progressively enhance the quality of RS HSI restoration from coarse to fine. Extensive experiments were conducted on various RS HSI restoration tasks, including denoising, inpainting, and super-resolution, demonstrating that the proposed Hyper-Restormer outperforms other state-of-the-art methods.


title: Constraints on Brans-Dicke gravity from neutron star-black hole merger events using higher harmonics

abstract: In this paper, we derive a 90\% credible lower bound on the modified parameter of scalar-tensor theories as $\varphi_{-2}>-7.94\times10^{-4}$ by using dominant-mode correction. Specific to BD theory, we have the constraint $\omega_{\rm BD}>4.75$. Asymmetric binary systems usually have a significant mass ratio; in such cases, higher harmonic modes cannot be neglected. Our work considers higher harmonic corrections from scalar-tensor theories and provides a tighter constraint of $\varphi_{-2}>-7.59\times10^{-4}$. Transitioning to the BD theory, the constraint is $\omega_{\rm BD}>5.06$, with a 6.5\% improvement. We also consider a plausible NSBH event, GW190814, which is a highly unequal mass ratio source and exhibits strong evidence for higher-order multipoles. We obtain poorly converged results when using the dominant mode while getting a constraint of $\varphi_{-2}>-6.60\times10^{-4}$ on scalar-tensor theories when including the higher harmonic modes. This suggests that the difference between the dominant mode and higher modes has a significant impact on our analysis. Furthermore, treating this suspected event as an NSBH event, we find $\omega_{\rm BD}>6.12$ when including the higher harmonic modes. Combining GW200115 and GW190814 and including higher modes, the constraint is improved to $\omega_{\rm BD}>110.55$. This is currently the strongest constraint utilizing GWs, contingent upon GW190814 being an NSBH event. Additionally, we take into account a BD-like theory, known as screened modified gravity (SMG), and investigate the coupling constant constraints, both with and without higher-mode corrections, by using data from both GW200115 and GW190814.


title: Observational appearance and additional photon rings of the asymmetric thin-shell wormhole in Horndeski theory

abstract: In this paper, we study the observational appearance of the asymmetric thin-shell wormhole (ATW) in Horndeski theory by employing the ray-tracing method. We first calculate the effective potential and null geodesic of the ATW, and then we obtain the deflection angle of the photon in the ATW spacetime. Based on the impact parameter of the photon, the trajectory of the photon can be classified into three cases. Two typical emission models of the thin accretion disk are considered to analyze the observational appearance of the ATW. By comparing the observational appearances of the ATW and a black hole with the same mass parameter, we find additional features in the observational appearance of the ATW, such as the ``lensing band" and ``photon ring group".


title: Beyond 1D and oversimplified kinematics: A generic analytical framework for surrogate safety measures

abstract: This paper presents a generic analytical framework tailored for surrogate safety measures (SSMs) that is versatile across various highway geometries, capable of encompassing vehicle dynamics of differing dimensionality and fidelity, and suitable for dynamic, real-world environments. The framework incorporates a generic vehicle movement model, accommodating a spectrum of scenarios with varying degrees of complexity and dimensionality, facilitating the prediction of future vehicle trajectories. It establishes a generic mathematical criterion to denote potential collisions, characterized by the spatial overlap between a vehicle and any other entity. A collision risk is present if the collision criterion is met at any non-negative time point, with the minimum threshold representing the remaining time to collision. The framework's proficiency spans from conventional one-dimensional (1D) SSMs to extended multi-dimensional, high-fidelity SSMs. Its validity is corroborated through simulation experiments that assess the precision of the framework when linearization is performed on the vehicle movement model. The outcomes showcase remarkable accuracy in predicting vehicle trajectories and the time remaining before potential collisions occur. The necessity of higher-dimensional and higher-fidelity SSMs is highlighted through a comparison of conventional 1D SSMs and extended three-dimensional (3D) SSMs. The results showed that using 1D SSMs over 3D SSMs could be off by 300% for non-critical Time-to-Collision (TTC) values and about 20% for critical TTC values (below 1.5 seconds). Furthermore, the framework's practical application is demonstrated through a case study that actively evaluates all potential conflicts, underscoring its effectiveness in dynamic, real-world traffic situations.


title: Interpolation of derivatives and ultradifferentiable regularity

abstract: We review some interpolation inequalities for derivatives and results on ultradifferentiable regularity by lacunary estimates.


title: Transferring Modality-Aware Pedestrian Attentive Learning for Visible-Infrared Person Re-identification

abstract: Visible-infrared person re-identification (VI-ReID) aims to search the same pedestrian of interest across visible and infrared modalities. Existing models mainly focus on compensating for modality-specific information to reduce modality variation. However, these methods often lead to a higher computational overhead and may introduce interfering information when generating the corresponding images or features. To address this issue, it is critical to leverage pedestrian-attentive features and learn modality-complete and -consistent representation. In this paper, a novel Transferring Modality-Aware Pedestrian Attentive Learning (TMPA) model is proposed, focusing on the pedestrian regions to efficiently compensate for missing modality-specific features. Specifically, we propose a region-based data augmentation module PedMix to enhance pedestrian region coherence by mixing the corresponding regions from different modalities. A lightweight hybrid compensation module, i.e., the Modality Feature Transfer (MFT), is devised to integrate cross attention and convolution networks to fully explore the discriminative modality-complete features with minimal computational overhead. Extensive experiments conducted on the benchmark SYSU-MM01 and RegDB datasets demonstrated the effectiveness of our proposed TMPA model.


title: EdgePruner: Poisoned Edge Pruning in Graph Contrastive Learning

abstract: Graph Contrastive Learning (GCL) is unsupervised graph representation learning that can obtain useful representation of unknown nodes. The node representation can be utilized as features of downstream tasks. However, GCL is vulnerable to poisoning attacks as with existing learning models. A state-of-the-art defense cannot sufficiently negate adverse effects by poisoned graphs although such a defense introduces adversarial training in the GCL. To achieve further improvement, pruning adversarial edges is important. To the best of our knowledge, the feasibility remains unexplored in the GCL domain. In this paper, we propose a simple defense for GCL, EdgePruner. We focus on the fact that the state-of-the-art poisoning attack on GCL tends to mainly add adversarial edges to create poisoned graphs, which means that pruning edges is important to sanitize the graphs. Thus, EdgePruner prunes edges that contribute to minimizing the contrastive loss based on the node representation obtained after training on poisoned graphs by GCL. Furthermore, we focus on the fact that nodes with distinct features are connected by adversarial edges in poisoned graphs. Thus, we introduce feature similarity between neighboring nodes to help more appropriately determine adversarial edges. This similarity is helpful in further eliminating adverse effects from poisoned graphs on various datasets. Finally, EdgePruner outputs a graph that yields the minimum contrastive loss as the sanitized graph. Our results demonstrate that pruning adversarial edges is feasible on six datasets. EdgePruner can improve the accuracy of node classification under the attack by up to 5.55% compared with that of the state-of-the-art defense. Moreover, we show that EdgePruner is immune to an adaptive attack.


title: On the proximal point algorithms for solving the monotone inclusion problem

abstract: We consider finding a zero point of the maximally monotone operator $T$. First, instead of using the proximal point algorithm (PPA) for this purpose, we employ PPA to solve its Yosida regularization $T_{\lambda}$. Then, based on an $O(a_{k+1})$ ($a_{k+1}\geq \varepsilon>0$) resolvent index of $T$, it turns out that we can establish a convergence rate of $O (1/{\sqrt{\sum_{i=0}^{k}a_{i+1}^2}})$ for both the $\|T_{\lambda}(\cdot)\|$ and the gap function $\mathtt{Gap}(\cdot)$ in the non-ergodic sense, and $O(1/\sum_{i=0}^{k}a_{i+1})$ for $\mathtt{Gap}(\cdot)$ in the ergodic sense. Second, to enhance the convergence rate of the newly-proposed PPA, we introduce an accelerated variant called the Contracting PPA. By utilizing a resolvent index of $T$ bounded by $O(a_{k+1})$ ($a_{k+1}\geq \varepsilon>0$), we establish a convergence rate of $O(1/\sum_{i=0}^{k}a_{i+1})$ for both $\|T_{\lambda}(\cdot)\|$ and $\mathtt {Gap}(\cdot)$, considering the non-ergodic sense. Third, to mitigate the limitation that the Contracting PPA lacks a convergence guarantee, we propose two additional versions of the algorithm. These novel approaches not only ensure guaranteed convergence but also provide sublinear and linear convergence rates for both $\|T_{\lambda}(\cdot)\|$ and $\mathtt {Gap}(\cdot)$, respectively, in the non-ergodic sense.


title: Second-harmonic generation with a 440,000% W-1 conversion efficiency in a lithium niobate microcavity without periodic poling

abstract: Thin-film lithium niobate (TFLN) enables extremely high-efficiency second-order nonlinear optical effects due to large nonlinear coefficient d33 and strong optical field localization. Here, we first designed and fabricated a pulley-waveguide-coupled microring resonator with an intrinsic quality factor above 9.4 x10^5 on the reverse-polarized double-layer X-cut TFLN. In such a TFLN resonator without fine domain structures, second harmonic generation with an absolute (normalized) conversion efficiency of 30% (440,000% W-1), comparable to that in periodically poled lithium niobate (PPLN) microring resonators, was realized with a sub-microwatt continuous pump. This work reduces the dependence of high-efficiency nonlinear frequency conversion on PPLN microcavities that are difficult to prepare.


title: Noise Distribution Decomposition based Multi-Agent Distributional Reinforcement Learning

abstract: Generally, Reinforcement Learning (RL) agent updates its policy by repetitively interacting with the environment, contingent on the received rewards to observed states and undertaken actions. However, the environmental disturbance, commonly leading to noisy observations (e.g., rewards and states), could significantly shape the performance of agent. Furthermore, the learning performance of Multi-Agent Reinforcement Learning (MARL) is more susceptible to noise due to the interference among intelligent agents. Therefore, it becomes imperative to revolutionize the design of MARL, so as to capably ameliorate the annoying impact of noisy rewards. In this paper, we propose a novel decomposition-based multi-agent distributional RL method by approximating the globally shared noisy reward by a Gaussian mixture model (GMM) and decomposing it into the combination of individual distributional local rewards, with which each agent can be updated locally through distributional RL. Moreover, a diffusion model (DM) is leveraged for reward generation in order to mitigate the issue of costly interaction expenditure for learning distributions. Furthermore, the optimality of the distribution decomposition is theoretically validated, while the design of loss function is carefully calibrated to avoid the decomposition ambiguity. We also verify the effectiveness of the proposed method through extensive simulation experiments with noisy rewards. Besides, different risk-sensitive policies are evaluated in order to demonstrate the superiority of distributional RL in different MARL tasks.


title: A review of mechanistic learning in mathematical oncology

abstract: Mechanistic learning, the synergistic combination of knowledge-driven and data-driven modeling, is an emerging field. In particular, in mathematical oncology, the application of mathematical modeling to cancer biology and oncology, the use of mechanistic learning is growing. This review aims to capture the current state of the field and provide a perspective on how mechanistic learning may further progress in mathematical oncology. We highlight the synergistic potential of knowledge-driven mechanistic mathematical modeling and data-driven modeling, such as machine and deep learning. We point out similarities and differences regarding model complexity, data requirements, outputs generated, and interpretability of the algorithms and their results. Then, organizing combinations of knowledge- and data-driven modeling into four categories (sequential, parallel, intrinsic, and extrinsic mechanistic learning), we summarize a variety of approaches at the interface between purely data- and knowledge-driven models. Using examples predominantly from oncology, we discuss a range of techniques including physics-informed neural networks, surrogate model learning, and digital twins. We see that mechanistic learning, with its intentional leveraging of the strengths of both knowledge and data-driven modeling, can greatly impact the complex problems of oncology. Given the increasing ubiquity and impact of machine learning, it is critical to incorporate it into the study of mathematical oncology with mechanistic learning providing a path to that end. As the field of mechanistic learning advances, we aim for this review and proposed categorization framework to foster additional collaboration between the data- and knowledge-driven modeling fields. Further collaboration will help address difficult issues in oncology such as limited data availability, requirements of model transparency, and complex input data


title: Effect of shear flow on the transverse thermal conductivity of polymer melts

abstract: The effect of shear flows on the thermal conductivity of polymer melts is investigated using a reversed nonequilibrium molecular dynamics (RNEMD) method. We extended the original RNEMD method to simultaneously produce spatial gradients of temperature and flow velocity in a single direction. This method enables accurate measurement of the thermal conductivity in the direction transverse to shear flow. The Weissenberg number defined with the shear rate and the relaxation time of the polymer conformation can uniformly differentiate the occurrence of shear rate dependence of the thermal conductivity across different chain lengths. The stress-thermal rule (STR) (i.e., the linear relationship between anisotropic parts of the stress tensor and the thermal conductivity tensor) holds for entangled polymer melts even under shear flows but not for unentangled polymer melts. Furthermore, once entanglements form in polymer chains, the stress-thermal coefficient in the STR remains independent of the polymer chain length. These observations align with the theoretical foundation of the STR, which focuses on energy transmission along the network structure of entangled polymer chains [Brule, Rheol. Acta 28, 257 (1989)]. However, under driven shear flows, the stress-thermal coefficient is notably smaller than that measured in the literature for a quasi-quiescent state without external forces. Although the mechanism of the STR in shear flows has yet to be fully elucidated, our study confirmed the validity of the STR in shear flows. This allows us to use the STR as a constitutive equation for computational thermo-fluid dynamics of polymer melts, thus having broad engineering applications.


title: Dynamic Corrective Self-Distillation for Better Fine-Tuning of Pretrained Models

abstract: We tackle the challenging issue of aggressive fine-tuning encountered during the process of transfer learning of pre-trained language models (PLMs) with limited labeled downstream data. This problem primarily results in a decline in performance on the subsequent task. Inspired by the adaptive boosting method in traditional machine learning, we present an effective dynamic corrective self-distillation (DCS) approach to improve the fine-tuning of the PLMs. Our technique involves performing a self-distillation mechanism where, at each iteration, the student model actively adapts and corrects itself by dynamically adjusting the weights assigned to individual data points. This iterative self-correcting process significantly enhances the overall fine-tuning capability of PLMs, leading to improved performance and robustness. We conducted comprehensive evaluations using the GLUE benchmark demonstrating the efficacy of our method in enhancing the fine-tuning process for various PLMs across diverse downstream tasks.


title: Spatiotemporal visualization of a surface acoustic wave coupled to magnons across a submillimeter-long sample by pulsed laser interferometry

abstract: Surface acoustic waves (SAWs) coupled to magnons have attracted much attention because they allow for the long-range transport of magnetic information which cannot be achieved by magnon alone. We employed pulsed laser interferometry to visualize the entire spatiotemporal dynamics of a SAW that travels on a nickel (Ni) thin film and is coupled to magnons. It was possible to trace the coupling-induced amplitude reduction and phase shift that occurs as the SAW propagates over a distance of 0.4 mm. The observed changes are consistent with results obtained from conventional radio-frequency transmission measurements, which probe the total SAW absorption due to magnon--phonon coupling. This result verifies that our method can accurately capture the spatiotemporal dynamics of a SAW coupled to magnons across the entire length of the sample. Additionally, we validated our time-resolved profiles by comparing them with theoretical results that take the echo wave due to reflection into account. The impact of the echo wave is significant even when it has propagated over a distance on the order of millimeters. Our imaging results highlight the visualization of the long-range propagation of the SAW coupled to magnons and offer more information about the surface vibration profiles in such devices.


title: Stabilizing Soil Using Annealed Polyvinyl Alcohol as Long-lasting Binder

abstract: Agricultural production heavily exploits the soil, resulting in high erosion in cultivated land, which poses a threat to food security and environmental sustainability. To address this issue, we stabilize the soil using polyvinyl alcohol (PVA). PVA strongly adheres to the soil after mixing and annealing, enhancing the cohesive strength of the soil. The PVA-soil withstands the impact of water at 7 m/s, protecting it from rainfall-induced erosion. Furthermore, the water-retaining capability and drainage of PVA-soil can be adjusted based on its sizes. This customized PVA-soil provides optimal growing conditions for various plants in different climates. Our method contributes to improved soil management and conversion.


title: Bayesian model averaging for nuclear symmetry energy from effective proton-neutron chemical potential difference of neutron-rich nuclei

abstract: The data-driven Bayesian model averaging is a rigorous statistical approach to combining multiple models for a unified prediction. Compared with the individual model, it provides more reliable information, especially for problems involving apparent model dependence. In this work, within both the non-relativistic Skyrme energy density functional and the nonlinear relativistic mean field model, the effective proton-neutron chemical potential difference $\Delta \mu^*_{\rm{pn}}$ of neutron-rich nuclei is found to be strongly sensitive to the symmetry energy $E_{\rm{sym}}(\rho)$ around $2\rho_0/3$, with $\rho_0$ being the nuclear saturation density. Given discrepancies on the $\Delta \mu^*_{\rm{pn}}$-$E_{\rm{sym}}(2\rho_0/3)$ correlations between the two models, we carry out a Bayesian model averaging analysis based on Gaussian process emulators to extract the symmetry energy around $2\rho_0/3$ from the measured $\Delta \mu^*_{\rm{pn}}$ of 5 doubly magic nuclei $^{48}$Ca, $^{68}$Ni, $^{88}$Sr, $^{132}$Sn and $^{208}$Pb. Specifically, the $E_{\mathrm{sym}}(2\rho_0/3)$ is inferred to be $E_{\mathrm{sym}}(2\rho_0/3) = 25.6_{-1.3}^{+1.4}\,\mathrm{MeV}$ at $1\sigma$ confidence level. The obtained constraints on the $E_{\mathrm{sym}}(\rho)$ around $2\rho_0/3$ agree well with microscopic predictions and results from other isovector indicators.


title: Ahpatron: A New Budgeted Online Kernel Learning Machine with Tighter Mistake Bound

abstract: In this paper, we study the mistake bound of online kernel learning on a budget. We propose a new budgeted online kernel learning model, called Ahpatron, which significantly improves the mistake bound of previous work and resolves the open problem posed by Dekel, Shalev-Shwartz, and Singer (2005). We first present an aggressive variant of Perceptron, named AVP, a model without budget, which uses an active updating rule. Then we design a new budget maintenance mechanism, which removes a half of examples,and projects the removed examples onto a hypothesis space spanned by the remaining examples. Ahpatron adopts the above mechanism to approximate AVP. Theoretical analyses prove that Ahpatron has tighter mistake bounds, and experimental results show that Ahpatron outperforms the state-of-the-art algorithms on the same or a smaller budget.


title: In-situ real-time observation of photo-induced nanoscale azo-polymer motions using high-speed atomic force microscopy combined with an inverted optical microscope

abstract: High-speed atomic force microscopy (HS-AFM) is an indispensable technique in the biological field owing to its excellent imaging capability for the real-time observation of biomolecules with high spatial resolution. Furthermore, recent developments have established a tip-scan stand-alone HS-AFM that can be combined with an optical microscope, drastically improving its versatility for studying various complex phenomena. Although HS-AFM has mainly been used in biology, it has considerable potential to contribute to various research fields. One of the great candidates is a photoactive material, such as an azo-polymer, which plays a vital role in multiple optical applications because of its unique nanoscale motion under light irradiation. In this study, we demonstrate the in-situ real-time observation of nanoscale azo-polymer motion by combining tip-scan HS-AFM with an optical system, allowing HS-AFM observations precisely aligned with a tightly focused laser position. We successfully observed the dynamic evolution of unique morphologies in azo-polymer films, attributed to photoinduced nano-movements. Moreover, real-time topographic line profile analyses facilitated precise and quantitative investigations of morphological changes, which provided novel insights into the deformation mechanism. This significant demonstration would pave the way for the application of HS-AFM in wide research fields, from biology to material science and physical chemistry.


title: GNBG-Generated Test Suite for Box-Constrained Numerical Global Optimization

abstract: This document introduces a set of 24 box-constrained numerical global optimization problem instances, systematically constructed using the Generalized Numerical Benchmark Generator (GNBG). These instances cover a broad spectrum of problem features, including varying degrees of modality, ruggedness, symmetry, conditioning, variable interaction structures, basin linearity, and deceptiveness. Purposefully designed, this test suite offers varying difficulty levels and problem characteristics, facilitating rigorous evaluation and comparative analysis of optimization algorithms. By presenting these problems, we aim to provide researchers with a structured platform to assess the strengths and weaknesses of their algorithms against challenges with known, controlled characteristics. For reproducibility, the MATLAB source code for this test suite is publicly available.


title: HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts

abstract: By routing input tokens to only a few split experts, Sparse Mixture-of-Experts has enabled efficient training of large language models. Recent findings suggest that fixing the routers can achieve competitive performance by alleviating the collapsing problem, where all experts eventually learn similar representations. However, this strategy has two key limitations: (i) the policy derived from random routers might be sub-optimal, and (ii) it requires extensive resources during training and evaluation, leading to limited efficiency gains. This work introduces \HyperRout, which dynamically generates the router's parameters through a fixed hypernetwork and trainable embeddings to achieve a balance between training the routers and freezing them to learn an improved routing policy. Extensive experiments across a wide range of tasks demonstrate the superior performance and efficiency gains of \HyperRouter compared to existing routing methods. Our implementation is publicly available at {\url{{https://github.com/giangdip2410/HyperRouter}}}.


title: Debiasing Sequential Recommenders through Distributionally Robust Optimization over System Exposure

abstract: Sequential recommendation (SR) models are typically trained on user-item interactions which are affected by the system exposure bias, leading to the user preference learned from the biased SR model not being fully consistent with the true user preference. Exposure bias refers to the fact that user interactions are dependent upon the partial items exposed to the user. Existing debiasing methods do not make full use of the system exposure data and suffer from sub-optimal recommendation performance and high variance. In this paper, we propose to debias sequential recommenders through Distributionally Robust Optimization (DRO) over system exposure data. The key idea is to utilize DRO to optimize the worst-case error over an uncertainty set to safeguard the model against distributional discrepancy caused by the exposure bias. The main challenge to apply DRO for exposure debiasing in SR lies in how to construct the uncertainty set and avoid the overestimation of user preference on biased samples. Moreover, how to evaluate the debiasing effect on biased test set is also an open question. To this end, we first introduce an exposure simulator trained upon the system exposure data to calculate the exposure distribution, which is then regarded as the nominal distribution to construct the uncertainty set of DRO. Then, we introduce a penalty to items with high exposure probability to avoid the overestimation of user preference for biased samples. Finally, we design a debiased self-normalized inverse propensity score (SNIPS) evaluator for evaluating the debiasing effect on the biased offline test set. We conduct extensive experiments on two real-world datasets to verify the effectiveness of the proposed methods. Experimental results demonstrate the superior exposure debiasing performance of proposed methods. Codes and data are available at \url{https://github.com/nancheng58/DebiasedSR_DRO}.


title: Prediction and control of two-dimensional decaying turbulence using generative adversarial networks

abstract: With the recent rapid developments in machine learning (ML), several attempts have been made to apply ML methods to various fluid dynamics problems. However, the feasibility of ML for predicting turbulence dynamics has not yet been explored in detail. In this study, PredictionNet, a data-driven ML framework based on generative adversarial networks (GANs), was developed to predict two-dimensional (2D) decaying turbulence. The developed prediction model accurately predicted turbulent fields at a finite lead time of up to half the Eulerian integral time scale. In addition to the high accuracy in pointwise metrics, various turbulence statistics, such as the probability density function, spatial correlation function, and enstrophy spectrum, were accurately captured by the employed GAN. Scale decomposition was used to interpret the predictability depending on the spatial scale, and the role of latent variables in the discriminator network was investigated. The good performance of the GAN in predicting small-scale turbulence is attributed to the scale-selection capability of the latent variable. Results also revealed that the recursive applications of the prediction model yielded better predictions than single predictions for large lead times. Furthermore, by utilizing PredictionNet as a surrogate model, a control model named ControlNet was developed to identify disturbance fields that drive the time evolution of the flow field in the direction that optimises the specified objective function. Therefore, an illustrative example in which the evolution of 2D turbulence can be predicted within a finite time horizon and controlled using a GAN-based deep neural network is presented.


title: Broadband near-ultraviolet dual comb spectroscopy

abstract: The highly energetic photons of ultraviolet light drive electronic and rovibronic transitions in all molecular species. This radiation is thus a prime tool for strongly selective spectroscopic fingerprinting and real-time environmental monitoring if broad spectral coverage, short acquisition times and high spectral resolution is achieved - requirements that are in mutual competition in traditional applications. As a novel approach with intrinsic potency in all three aspects, here we introduce ultraviolet dual comb spectroscopy using two broadband ultraviolet frequency combs centered at 871 THz and covering a spectral bandwidth of 35.7 THz. Within a 100 us acquisition time window, we obtain rotational state-resolved absorption spectra of formaldehyde, a prototype molecule with high relevance for laser spectroscopy and environmental sciences. This is the first realization of broadband dual comb spectroscopy in the ultraviolet spectral region and a pioneering tool to allow for real-time monitoring of rovibronic transitions.

categories: physics.optics physics.atom-ph physics.chem-ph physics.ins-det


title: Open-Pose 3D Zero-Shot Learning: Benchmark and Challenges

abstract: With the explosive 3D data growth, the urgency of utilizing zero-shot learning to facilitate data labeling becomes evident. Recently, methods transferring language or language-image pre-training models like Contrastive Language-Image Pre-training (CLIP) to 3D vision have made significant progress in the 3D zero-shot classification task. These methods primarily focus on 3D object classification with an aligned pose; such a setting is, however, rather restrictive, which overlooks the recognition of 3D objects with open poses typically encountered in real-world scenarios, such as an overturned chair or a lying teddy bear. To this end, we propose a more realistic and challenging scenario named open-pose 3D zero-shot classification, focusing on the recognition of 3D objects regardless of their orientation. First, we revisit the current research on 3D zero-shot classification, and propose two benchmark datasets specifically designed for the open-pose setting. We empirically validate many of the most popular methods in the proposed open-pose benchmark. Our investigations reveal that most current 3D zero-shot classification models suffer from poor performance, indicating a substantial exploration room towards the new direction. Furthermore, we study a concise pipeline with an iterative angle refinement mechanism that automatically optimizes one ideal angle to classify these open-pose 3D objects. In particular, to make validation more compelling and not just limited to existing CLIP-based methods, we also pioneer the exploration of knowledge transfer based on Diffusion models. While the proposed solutions can serve as a new benchmark for open-pose 3D zero-shot classification, we discuss the complexities and challenges of this scenario that remain for further research development. The code is available publicly at https://github.com/weiguangzhao/Diff-OP3D.


title: Patch-MI: Enhancing Model Inversion Attacks via Patch-Based Reconstruction

abstract: Model inversion (MI) attacks aim to reveal sensitive information in training datasets by solely accessing model weights. Generative MI attacks, a prominent strand in this field, utilize auxiliary datasets to recreate target data attributes, restricting the images to remain photo-realistic, but their success often depends on the similarity between auxiliary and target datasets. If the distributions are dissimilar, existing MI attack attempts frequently fail, yielding unrealistic or target-unrelated results. In response to these challenges, we introduce a groundbreaking approach named Patch-MI, inspired by jigsaw puzzle assembly. To this end, we build upon a new probabilistic interpretation of MI attacks, employing a generative adversarial network (GAN)-like framework with a patch-based discriminator. This approach allows the synthesis of images that are similar to the target dataset distribution, even in cases of dissimilar auxiliary dataset distribution. Moreover, we artfully employ a random transformation block, a sophisticated maneuver that crafts generalized images, thus enhancing the efficacy of the target classifier. Our numerical and graphical findings demonstrate that Patch-MI surpasses existing generative MI methods in terms of accuracy, marking significant advancements while preserving comparable statistical dataset quality. For reproducibility of our results, we make our source code publicly available in https://github.com/jonggyujang0123/Patch-Attack.


title: Probabilistic Lookahead Strong Branching via a Stochastic Abstract Branching Model

abstract: Strong Branching (SB) is a cornerstone of all modern branching rules used in the Branch-and-Bound (BnB) algorithm, which is at the center of Mixed-Integer Programming solvers. In its full form, SB evaluates all variables to branch on and then selects the one producing the best relaxation, leading to small trees, but high runtimes. State-of-the-art branching rules therefore use SB with working limits to achieve both small enough trees and short run times. So far, these working limits have been established empirically. In this paper, we introduce a theoretical approach to guide how much SB to use at each node within the BnB. We first define an abstract stochastic tree model of the BnB algorithm where the geometric mean dual gains of all variables follow a given probability distribution. This model allows us to relate expected dual gains to tree sizes and explicitly compare the cost of sampling an additional SB candidate with the reward in expected tree size reduction. We then leverage the insight from the abstract model to design a new stopping criterion for SB, which fits a distribution to the dual gains and, at each node, dynamically continues or interrupts SB. This algorithm, which we refer to as Probabilistic Lookahead Strong Branching, improves both the tree size and runtime over MIPLIB instances, providing evidence that the method not only changes the amount of SB, but allocates it better.


title: Rectified deep neural networks overcome the curse of dimensionality when approximating solutions of McKean--Vlasov stochastic differential equations

abstract: In this paper we prove that rectified deep neural networks do not suffer from the curse of dimensionality when approximating McKean--Vlasov SDEs in the sense that the number of parameters in the deep neural networks only grows polynomially in the space dimension $d$ of the SDE and the reciprocal of the accuracy $\epsilon$.


title: The Complexity of Envy-Free Graph Cutting

abstract: We consider the problem of fairly dividing a set of heterogeneous divisible resources among agents with different preferences. We focus on the setting where the resources correspond to the edges of a connected graph, every agent must be assigned a connected piece of this graph, and the fairness notion considered is the classical envy freeness. The problem is NP-complete, and we analyze its complexity with respect to two natural complexity measures: the number of agents and the number of edges in the graph. While the problem remains NP-hard even for instances with 2 agents, we provide a dichotomy characterizing the complexity of the problem when the number of agents is constant based on structural properties of the graph. For the latter case, we design a polynomial-time algorithm when the graph has a constant number of edges.


title: Large Foundation Models for Power Systems

abstract: Foundation models, such as Large Language Models (LLMs), can respond to a wide range of format-free queries without any task-specific data collection or model training, creating various research and application opportunities for the modeling and operation of large-scale power systems. In this paper, we outline how such large foundation model such as GPT-4 are developed, and discuss how they can be leveraged in challenging power and energy system tasks. We first investigate the potential of existing foundation models by validating their performance on four representative tasks across power system domains, including the optimal power flow (OPF), electric vehicle (EV) scheduling, knowledge retrieval for power engineering technical reports, and situation awareness. Our results indicate strong capabilities of such foundation models on boosting the efficiency and reliability of power system operational pipelines. We also provide suggestions and projections on future deployment of foundation models in power system applications.


title: Local rigidity of actions of isometries on compact real analytic Riemannian manifolds

abstract: In this article, we consider analytic perturbations of isometries of an analytic Riemannian manifold M. We prove that, under some conditions, a finitely presented group of such small enough perturbations is analytically conjugate on M to the same group of isometry it is a perturbation of. Our result relies on a "Diophantine-like" condition, relating the actions of the isometry group and the eigenvalues of the Laplace-Beltrami operator. Our result generalizes Arnold-Herman's theorem about diffemorphisms of the circle that are small perturbations of rotations.


title: Rethinking Compression: Reduced Order Modelling of Latent Features in Large Language Models

abstract: Due to the substantial scale of Large Language Models (LLMs), the direct application of conventional compression methodologies proves impractical. The computational demands associated with even minimal gradient updates present challenges, particularly on consumer-grade hardware. This paper introduces an innovative approach for the parametric and practical compression of LLMs based on reduced order modelling, which entails low-rank decomposition within the feature space and re-parameterization in the weight space. Notably, this compression technique operates in a layer-wise manner, obviating the need for a GPU device and enabling the compression of billion-scale models within stringent constraints of both memory and time. Our method represents a significant advancement in model compression by leveraging matrix decomposition, demonstrating superior efficacy compared to the prevailing state-of-the-art structured pruning method.


title: Low-energy limit of N-photon amplitudes in a constant field

abstract: While the QED photon amplitudes at full momentum so far have been calculated only up to the six-photon level, in the low-energy limit there are explicit formulas for all helicity components even at the N-photon level, obtained by Martin et al. in 2002. Here we use the worldline formalism to extend that result to the N-photon amplitudes in a generic constant field. For both scalar and spinor QED, we obtain compact representations for the low-energy limits of these amplitudes involving only simple algebra and a single global proper-time integral with trigonometric integrand.


title: Edge Wasserstein Distance Loss for Oriented Object Detection

abstract: Regression loss design is an essential topic for oriented object detection. Due to the periodicity of the angle and the ambiguity of width and height definition, traditional L1-distance loss and its variants have been suffered from the metric discontinuity and the square-like problem. As a solution, the distribution based methods show significant advantages by representing oriented boxes as distributions. Differing from exploited the Gaussian distribution to get analytical form of distance measure, we propose a novel oriented regression loss, Wasserstein Distance(EWD) loss, to alleviate the square-like problem. Specifically, for the oriented box(OBox) representation, we choose a specially-designed distribution whose probability density function is only nonzero over the edges. On this basis, we develop Wasserstein distance as the measure. Besides, based on the edge representation of OBox, the EWD loss can be generalized to quadrilateral and polynomial regression scenarios. Experiments on multiple popular datasets and different detectors show the effectiveness of the proposed method.


title: Improving Factual Error Correction by Learning to Inject Factual Errors

abstract: Factual error correction (FEC) aims to revise factual errors in false claims with minimal editing, making them faithful to the provided evidence. This task is crucial for alleviating the hallucination problem encountered by large language models. Given the lack of paired data (i.e., false claims and their corresponding correct claims), existing methods typically adopt the mask-then-correct paradigm. This paradigm relies solely on unpaired false claims and correct claims, thus being referred to as distantly supervised methods. These methods require a masker to explicitly identify factual errors within false claims before revising with a corrector. However, the absence of paired data to train the masker makes accurately pinpointing factual errors within claims challenging. To mitigate this, we propose to improve FEC by Learning to Inject Factual Errors (LIFE), a three-step distantly supervised method: mask-corrupt-correct. Specifically, we first train a corruptor using the mask-then-corrupt procedure, allowing it to deliberately introduce factual errors into correct text. The corruptor is then applied to correct claims, generating a substantial amount of paired data. After that, we filter out low-quality data, and use the remaining data to train a corrector. Notably, our corrector does not require a masker, thus circumventing the bottleneck associated with explicit factual error identification. Our experiments on a public dataset verify the effectiveness of LIFE in two key aspects: Firstly, it outperforms the previous best-performing distantly supervised method by a notable margin of 10.59 points in SARI Final (19.3% improvement). Secondly, even compared to ChatGPT prompted with in-context examples, LIFE achieves a superiority of 7.16 points in SARI Final.


title: A feasible smoothing accelerated projected gradient method for nonsmooth convex optimization

abstract: Smoothing accelerated gradient methods achieve faster convergence rates than that of the subgradient method for some nonsmooth convex optimization problems. However, Nesterov's extrapolation may require gradients at infeasible points, and thus they cannot be applied to some structural optimization problems. We introduce a variant of smoothing accelerated projected gradient methods where every variable is feasible. The $O(k^{-1}\log k)$ convergence rate is obtained using the Lyapunov function. We conduct a numerical experiment on the robust compliance optimization of a truss structure.


title: Mask as Supervision: Leveraging Unified Mask Information for Unsupervised 3D Pose Estimation

abstract: Automatic estimation of 3D human pose from monocular RGB images is a challenging and unsolved problem in computer vision. In a supervised manner, approaches heavily rely on laborious annotations and present hampered generalization ability due to the limited diversity of 3D pose datasets. To address these challenges, we propose a unified framework that leverages mask as supervision for unsupervised 3D pose estimation. With general unsupervised segmentation algorithms, the proposed model employs skeleton and physique representations that exploit accurate pose information from coarse to fine. Compared with previous unsupervised approaches, we organize the human skeleton in a fully unsupervised way which enables the processing of annotation-free data and provides ready-to-use estimation results. Comprehensive experiments demonstrate our state-of-the-art pose estimation performance on Human3.6M and MPI-INF-3DHP datasets. Further experiments on in-the-wild datasets also illustrate the capability to access more data to boost our model. Code will be available at https://github.com/Charrrrrlie/Mask-as-Supervision.


title: Adjustable Robust Transformer for High Myopia Screening in Optical Coherence Tomography

abstract: Myopia is a manifestation of visual impairment caused by an excessively elongated eyeball. Image data is critical material for studying high myopia and pathological myopia. Measurements of spherical equivalent and axial length are the gold standards for identifying high myopia, but the available image data for matching them is scarce. In addition, the criteria for defining high myopia vary from study to study, and therefore the inclusion of samples in automated screening efforts requires an appropriate assessment of interpretability. In this work, we propose a model called adjustable robust transformer (ARTran) for high myopia screening of optical coherence tomography (OCT) data. Based on vision transformer, we propose anisotropic patch embedding (APE) to capture more discriminative features of high myopia. To make the model effective under variable screening conditions, we propose an adjustable class embedding (ACE) to replace the fixed class token, which changes the output to adapt to different conditions. Considering the confusion of the data at high myopia and low myopia threshold, we introduce the label noise learning strategy and propose a shifted subspace transition matrix (SST) to enhance the robustness of the model. Besides, combining the two structures proposed above, the model can provide evidence for uncertainty evaluation. The experimental results demonstrate the effectiveness and reliability of the proposed method. Code is available at: https://github.com/maxiao0234/ARTran.


title: Field-induced superconductivity mediated by odd-parity multipole fluctuation

abstract: Field-induced superconductivity has long presented a counterintuitive phenomenon and a pivotal challenge in condensed matter physics. In this Letter, we introduce a mechanism for achieving field-induced superconductivity wherein the sublattice degree of freedom and the Coulomb interaction are tightly entwined. Our multipole-resolved analysis elucidates that lifting the fluctuation degeneracy results in an unconventional Cooper pairing channel, thereby realizing field-induced superconductivity. This research substantively augments the exploration of the latent potential of strongly correlated electron systems with sublattice degrees of freedom.


title: Extending Families of Disjoint Hypercyclic Operators

abstract: In the present note, we solve two open questions posed by Salas in [H. Salas, The strong disjoint blow-up/collapse property, J. Funct. Spaces Appl., 2013, Article ID 146517, 6 pages] about disjoint hypercyclic operators. First, we show that given any family $T_1, \dots, T_N$ of disjoint hypercyclic operators, one can always select an operator $T$ such that the extended family $T_1, \dots, T_N, T$ of operators remains disjoint hypercyclic. In fact, we prove that the set of operators $T$ which can extend the family of disjoint hypercyclic operators is dense in the strong operator topology in the algebra of bounded operators. Second, we show the existence of two disjoint weakly mixing operators that fail to possess a dense d-hypercyclic manifold. Thus, these operators satisfy the Disjoint Blow-up/Collapse property but fails to satisfy the Strong Disjoint Blow-up/Collapse property, a notion which was introduced by Salas as a sufficient condition for having a dense linear manifold of disjoint hypercyclic vectors.


title: Communication Cost Reduction for Subgraph Counting under Local Differential Privacy via Hash Functions

abstract: We suggest the use of hash functions to cut down the communication costs when counting subgraphs under edge local differential privacy. While various algorithms exist for computing graph statistics, including the count of subgraphs, under the edge local differential privacy, many suffer with high communication costs, making them less efficient for large graphs. Though data compression is a typical approach in differential privacy, its application in local differential privacy requires a form of compression that every node can reproduce. In our study, we introduce linear congruence hashing. With a sampling rate of $s$, our method can cut communication costs by a factor of $s^2$, albeit at the cost of increasing variance in the published graph statistic by a factor of $s$. The experimental results indicate that, when matched for communication costs, our method achieves a reduction in the $\ell_2$-error for triangle counts by up to 1000 times compared to the performance of leading algorithms.


title: Relational Quantum Mechanics with Cross-Perspective Links Postulate: an Internally Inconsistent Scheme

abstract: We discuss the status of relative facts - the central concept of Relational Quantum Mechanics (RQM) - in the context of the new amendment to RQM called cross-perspective links postulate. The new axiom states that by a proper measurement one learns the value of the relative outcome/fact earlier obtained by another observer-system. We discuss a Wigner-Friend-type scenario in which, without cross-perspective links postulate, relative facts have no predictive or causal power, whereas including cross-perspective links makes them effectively hidden variables, which causally determine outcomes of specific measurements. However, cross-perspective links axiom invalidates the other axiom of RQM, the one which states that in a Wigner-Friend scenario, RQM assigns an entangled state to the Friend and System after the unitary transformation of their interaction, despite the appearance of the relative fact for the Friend. This quantum mechanical state according to RQM properly describes the situation for Wigner. From this we show that RQM with cross-perspective links axiom is an internally inconsistent hidden variable theory and therefore cannot be treated as an interpretation of quantum mechanics in any sense.


title: Celestial two-point functions and rectified dictionary

abstract: A naive celestial dictionary causes massless two-point functions to take the delta-function forms in the celestial conformal field theory (CCFT). We rectify the dictionary, involving the shadow transformation so that the two-point functions follow the standard power-law. In this new definition, we can smoothly take the massless limit of the massive dictionary. We also compute a three-point function using the new dictionary and discuss the OPE in CCFT.


title: Axion Cloud Decay due to the Axion-photon Conversion with Multi-pole Background Magnetic Fields

abstract: We consider axion cloud decay due to the axion-photon conversion with multi-pole background magnetic fields. We focus on the $\ell=m=1$ and $n=2$ mode for the axion field configuration since it has the largest growth rate associated with superradiant instability. Under the existence of a background multi-pole magnetic field, the axion field can be converted into the electromagnetic field through the axion-photon coupling. Then the decay rate due to the dissipation of the converted photons is calculated in a successive approximation. We found that the decay rate is significantly dependent on the azimuthal quantum number characterizing the background magnetic field, and can be comparable to or larger than the growth rate of the superradiant instability.


title: LSTM-CNN Network for Audio Signature Analysis in Noisy Environments

abstract: There are multiple applications to automatically count people and specify their gender at work, exhibitions, malls, sales, and industrial usage. Although current speech detection methods are supposed to operate well, in most situations, in addition to genders, the number of current speakers is unknown and the classification methods are not suitable due to many possible classes. In this study, we focus on a long-short-term memory convolutional neural network (LSTM-CNN) to extract time and / or frequency-dependent features of the sound data to estimate the number / gender of simultaneous active speakers at each frame in noisy environments. Considering the maximum number of speakers as 10, we have utilized 19000 audio samples with diverse combinations of males, females, and background noise in public cities, industrial situations, malls, exhibitions, workplaces, and nature for learning purposes. This proof of concept shows promising performance with training/validation MSE values of about 0.019/0.017 in detecting count and gender.


title: Layered Randomized Quantization for Communication-Efficient and Privacy-Preserving Distributed Learning

abstract: Next-generation wireless networks, such as edge intelligence and wireless distributed learning, face two critical challenges: communication efficiency and privacy protection. In this work, our focus is on addressing these issues in a distributed learning framework. We consider a new approach that simultaneously achieves communication efficiency and privacy protection by exploiting the privacy advantage offered by quantization. Specifically, we use a quantization scheme called \textbf{Gau}ssian \textbf{L}ayered \textbf{R}andomized \textbf{Q}uantization (Gau-LRQ) that compresses the raw model gradients using a layer multishift coupler. By adjusting the parameters of Gau-LRQ, we shape the quantization error to follow the expected Gaussian distribution, thus ensuring client-level differential privacy (CLDP). We demonstrate the effectiveness of our proposed Gau-LRQ in the distributed stochastic gradient descent (SGD) framework and theoretically quantify the trade-offs between communication, privacy, and convergence performance. We further improve the convergence performance by enabling dynamic private budget and quantization bit allocation. We achieve this by using an optimization formula that minimizes convergence error subject to the privacy budget constraint. We evaluate our approach on multiple datasets, including MNIST, CIFAR-10, and CIFAR-100, and show that our proposed method outperforms the baselines in terms of learning performance under various privacy constraints. Moreover, we observe that dynamic privacy allocation yields additional accuracy improvements for the models compared to the fixed scheme.


title: MaxQ: Multi-Axis Query for N:M Sparsity Network

abstract: N:M sparsity has received increasing attention due to its remarkable performance and latency trade-off compared with structured and unstructured sparsity. However, existing N:M sparsity methods do not differentiate the relative importance of weights among blocks and leave important weights underappreciated. Besides, they directly apply N:M sparsity to the whole network, which will cause severe information loss. Thus, they are still sub-optimal. In this paper, we propose an efficient and effective Multi-Axis Query methodology, dubbed as MaxQ, to rectify these problems. During the training, MaxQ employs a dynamic approach to generate soft N:M masks, considering the weight importance across multiple axes. This method enhances the weights with more importance and ensures more effective updates. Meanwhile, a sparsity strategy that gradually increases the percentage of N:M weight blocks is applied, which allows the network to heal from the pruning-induced damage progressively. During the runtime, the N:M soft masks can be precomputed as constants and folded into weights without causing any distortion to the sparse pattern and incurring additional computational overhead. Comprehensive experiments demonstrate that MaxQ achieves consistent improvements across diverse CNN architectures in various computer vision tasks, including image classification, object detection and instance segmentation. For ResNet50 with 1:16 sparse pattern, MaxQ can achieve 74.6\% top-1 accuracy on ImageNet and improve by over 2.8\% over the state-of-the-art. Codes and checkpoints are available at \url{https://github.com/JingyangXiang/MaxQ}.


title: ThinkBot: Embodied Instruction Following with Thought Chain Reasoning

abstract: Embodied Instruction Following (EIF) requires agents to complete human instruction by interacting objects in complicated surrounding environments. Conventional methods directly consider the sparse human instruction to generate action plans for agents, which usually fail to achieve human goals because of the instruction incoherence in action descriptions. On the contrary, we propose ThinkBot that reasons the thought chain in human instruction to recover the missing action descriptions, so that the agent can successfully complete human goals by following the coherent instruction. Specifically, we first design an instruction completer based on large language models to recover the missing actions with interacted objects between consecutive human instruction, where the perceived surrounding environments and the completed sub-goals are considered for instruction completion. Based on the partially observed scene semantic maps, we present an object localizer to infer the position of interacted objects for agents to achieve complex human goals. Extensive experiments in the simulated environment show that our ThinkBot outperforms the state-of-the-art EIF methods by a sizable margin in both success rate and execution efficiency.


title: Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation

abstract: Reconstructing human-object interaction in 3D from a single RGB image is a challenging task and existing data driven methods do not generalize beyond the objects present in the carefully curated 3D interaction datasets. Capturing large-scale real data to learn strong interaction and 3D shape priors is very expensive due to the combinatorial nature of human-object interactions. In this paper, we propose ProciGen (Procedural interaction Generation), a method to procedurally generate datasets with both, plausible interaction and diverse object variation. We generate 1M+ human-object interaction pairs in 3D and leverage this large-scale data to train our HDM (Hierarchical Diffusion Model), a novel method to reconstruct interacting human and unseen objects, without any templates. Our HDM is an image-conditioned diffusion model that learns both realistic interaction and highly accurate human and object shapes. Experiments show that our HDM trained with ProciGen significantly outperforms prior methods that requires template meshes and that our dataset allows training methods with strong generalization ability to unseen object instances. Our code and data are released.


title: Efficient Cross-Domain Federated Learning by MixStyle Approximation

abstract: With the advent of interconnected and sensor-equipped edge devices, Federated Learning (FL) has gained significant attention, enabling decentralized learning while maintaining data privacy. However, FL faces two challenges in real-world tasks: expensive data labeling and domain shift between source and target samples. In this paper, we introduce a privacy-preserving, resource-efficient FL concept for client adaptation in hardware-constrained environments. Our approach includes server model pre-training on source data and subsequent fine-tuning on target data via low-end clients. The local client adaptation process is streamlined by probabilistic mixing of instance-level feature statistics approximated from source and target domain data. The adapted parameters are transferred back to the central server and globally aggregated. Preliminary results indicate that our method reduces computational and transmission costs while maintaining competitive performance on downstream tasks.


title: Towards a Framework for a New Research Ecosystem

abstract: A major gap exists between the conceptual suggestion of how much a nation should invest in science, innovation, and technology, and the practical implementation of what is done. We identify 4 critical challenges that must be address in order to develop an environment conducive to collaboration across organizations and governments, while also preserving commercial rewards for investors and innovators, in order to move towards a new Research Ecosystem.


title: DiffuVST: Narrating Fictional Scenes with Global-History-Guided Denoising Models

abstract: Recent advances in image and video creation, especially AI-based image synthesis, have led to the production of numerous visual scenes that exhibit a high level of abstractness and diversity. Consequently, Visual Storytelling (VST), a task that involves generating meaningful and coherent narratives from a collection of images, has become even more challenging and is increasingly desired beyond real-world imagery. While existing VST techniques, which typically use autoregressive decoders, have made significant progress, they suffer from low inference speed and are not well-suited for synthetic scenes. To this end, we propose a novel diffusion-based system DiffuVST, which models the generation of a series of visual descriptions as a single conditional denoising process. The stochastic and non-autoregressive nature of DiffuVST at inference time allows it to generate highly diverse narratives more efficiently. In addition, DiffuVST features a unique design with bi-directional text history guidance and multimodal adapter modules, which effectively improve inter-sentence coherence and image-to-text fidelity. Extensive experiments on the story generation task covering four fictional visual-story datasets demonstrate the superiority of DiffuVST over traditional autoregressive models in terms of both text quality and inference speed.


title: Focus on Hiders: Exploring Hidden Threats for Enhancing Adversarial Training

abstract: Adversarial training is often formulated as a min-max problem, however, concentrating only on the worst adversarial examples causes alternating repetitive confusion of the model, i.e., previously defended or correctly classified samples are not defensible or accurately classifiable in subsequent adversarial training. We characterize such non-ignorable samples as "hiders", which reveal the hidden high-risk regions within the secure area obtained through adversarial training and prevent the model from finding the real worst cases. We demand the model to prevent hiders when defending against adversarial examples for improving accuracy and robustness simultaneously. By rethinking and redefining the min-max optimization problem for adversarial training, we propose a generalized adversarial training algorithm called Hider-Focused Adversarial Training (HFAT). HFAT introduces the iterative evolution optimization strategy to simplify the optimization problem and employs an auxiliary model to reveal hiders, effectively combining the optimization directions of standard adversarial training and prevention hiders. Furthermore, we introduce an adaptive weighting mechanism that facilitates the model in adaptively adjusting its focus between adversarial examples and hiders during different training periods. We demonstrate the effectiveness of our method based on extensive experiments, and ensure that HFAT can provide higher robustness and accuracy.


title: Sensitivity of Cosmological Parameter Estimation to Nonlinear Prescription from Cosmic Shear

abstract: Several ongoing and upcoming large scale structure surveys aim to explore the nonlinear regime of structure formation with high precision. Making reliable cosmological inferences from these observations necessitates precise theoretical modeling of the mildly nonlinear regime. In this work we explore how the choice of nonlinear prescription would impact parameter estimation from cosmic shear measurements for a Euclid-like survey. Specifically, we employ two different nonlinear prescriptions of Haloft and the Effective Field Theory of the Large Scale Structure and compare their measurements for the three different cosmological scenarios of $\Lambda$CDM, $w$CDM and $(w_0,w_a)$CDM. We also investigate the impact of different nonlinear cutoff schemes on parameter estimation. We find that the predicted errors on most parameters shrink considerably as smaller scales are included in the analysis, with the amount depending on the nonlinear prescription and the cutoff scheme used. We use predictions from the Halofit model to analyze the mock data from DarkSky $N$-body simulations and quantify the parameter bias introduced in the measurements due to the choice of nonlinear prescription. We observe that $\sigma_8$ and $n_{\rm{s}}$ have the largest measurement bias induced by inaccuracies of the Halofit model.


title: Context Matters: Data-Efficient Augmentation of Large Language Models for Scientific Applications

abstract: In this paper, we explore the challenges inherent to Large Language Models (LLMs) like GPT-4, particularly their propensity for hallucinations, logic mistakes, and incorrect conclusions when tasked with answering complex questions. The capacity of LLMs to present erroneous answers in a coherent and semantically rigorous manner further complicates the detection of factual inaccuracies. This issue is especially pronounced in fields that require specialized expertise. Our work delves into these challenges, aiming to enhance the understanding and mitigation of such errors, thereby contributing to the improvement of LLM accuracy and reliability in scientific and other specialized domains. Our findings reveal a non-linear relationship between the context's relevancy and the answers' measured quality. In addition, we demonstrate that with the correct calibration, it is possible to automate the grading procedure -- a finding suggesting that, at least to some degree, the LLMs can be used to self-examine the quality of their own performance. Finally, we describe an experimental platform that can be seen as a proof-of-concept of the techniques described in this work.