title: AUPIMO: Redefining Visual Anomaly Detection Benchmarks with High Speed and Low Tolerance

abstract: Recent advances in visual anomaly detection research have seen AUROC and AUPRO scores on public benchmark datasets such as MVTec and VisA converge towards perfect recall, giving the impression that these benchmarks are near-solved. However, high AUROC and AUPRO scores do not always reflect qualitative performance, which limits the validity of these metrics in real-world applications. We argue that the artificial ceiling imposed by the lack of an adequate evaluation metric restrains progression of the field, and it is crucial that we revisit the evaluation metrics used to rate our algorithms. In response, we introduce Per-IMage Overlap (PIMO), a novel metric that addresses the shortcomings of AUROC and AUPRO. PIMO retains the recall-based nature of the existing metrics but introduces two distinctions: the assignment of curves (and respective area under the curve) is per-image, and its X-axis relies solely on normal images. Measuring recall per image simplifies instance score indexing and is more robust to noisy annotations. As we show, it also accelerates computation and enables the usage of statistical tests to compare models. By imposing low tolerance for false positives on normal images, PIMO provides an enhanced model validation procedure and highlights performance variations across datasets. Our experiments demonstrate that PIMO offers practical advantages and nuanced performance insights that redefine anomaly detection benchmarks -- notably challenging the perception that MVTec AD and VisA datasets have been solved by contemporary models. Available on GitHub: https://github.com/jpcbertoldo/aupimo.


title: Surveying the Giant HII Regions of the Milky Way with SOFIA: VI. NGC 3603

abstract: We present our sixth set of results from our mid-infrared imaging survey of Milky Way Giant HII regions with our detailed analysis of NGC 3603, the most luminous GHII region in the Galaxy. We used imaging data from the FORCAST instrument on the Stratospheric Observatory For Infrared Astronomy (SOFIA) at 20 and 37 microns which mapped the central ~8.5'x8.5' infrared-emitting area of NGC 3603 at a spatial resolution of <~3". Utilizing these SOFIA data in conjunction with multi-wavelength observations from the near-infrared to radio, including Spitzer-IRAC and Herschel-PACS archival data, we investigate the physical nature of individual infrared sources and sub-components within NGC 3603. For individual compact sources we used the multi-wavelength photometry data to construct spectral energy distributions (SEDs) and fit them with massive young stellar object (MYSO) SED models, and find 14 sources that are likely to be MYSOs. We also detect dust emission from the 3 massive proplyd candidates, as well as from the disk and outflow of the evolved blue supergiant, Sher 25. Utilizing multi-wavelength data, we derived luminosity-to-mass ratio and virial parameters for the star-forming clumps within NGC 3603, estimating their relative ages and finding that NGC 3603 is an older GHII region overall, compared to our previously studied GHII regions. We discuss how NGC 3603, which we categorize as a 'cavity-type' GHII region, exhibits a more modest number of MYSOs and molecular clumps when compared to the 'distributed-type' GHII regions that share similar Lyman continuum photon rates.


title: Generation of complete graph states in a spin-$1/2$ Heisenberg chain with a globally optimized magnetic field

abstract: Graph states possess significant practical value in measurement-based quantum computation, with complete graph states that exhibit exceptional performance in quantum metrology. In this work, we introduce a method for generating multiparticle complete graph states using a spin-$1/2$ Heisenberg $XX$ chain subjected to a time-varying magnetic field, which applies to a wide range of systems. Our scheme relies exclusively on nearest-neighbor interactions between atoms, with real-time magnetic field formation facilitated by quantum optimal control theory. We focus specifically on neutral-atom systems, finding that multiparticle complete graph states with $N=3\sim6$ can be achieved in less than $0.25~\mu{\rm s}$, utilizing a hopping amplitude of ${J}/{(2\pi)} = -2.443~{\rm MHz}$. This assumes an initial state provided by an equal-weight superposition of all spin states that are encoded by the dipolar interacting Rydberg states. Additionally, we thoroughly address various experimental imperfections and showcase the robustness of our approach against atomic vibrations, fluctuations in pulse amplitude, and spontaneous emission of Rydberg states. Considering the common occurrence of disturbances in experimental setups of neutral-atom systems, our one-step strategy for achieving such graph states emerges as a more empirically viable alternative to techniques based on controlled-Z gates.


title: Representation Learning of Multivariate Time Series using Attention and Adversarial Training

abstract: A critical factor in trustworthy machine learning is to develop robust representations of the training data. Only under this guarantee methods are legitimate to artificially generate data, for example, to counteract imbalanced datasets or provide counterfactual explanations for blackbox decision-making systems. In recent years, Generative Adversarial Networks (GANs) have shown considerable results in forming stable representations and generating realistic data. While many applications focus on generating image data, less effort has been made in generating time series data, especially multivariate signals. In this work, a Transformer-based autoencoder is proposed that is regularized using an adversarial training scheme to generate artificial multivariate time series signals. The representation is evaluated using t-SNE visualizations, Dynamic Time Warping (DTW) and Entropy scores. Our results indicate that the generated signals exhibit higher similarity to an exemplary dataset than using a convolutional network approach.


title: Hierarchical Clustering in ${\Lambda}$CDM Cosmologies via Persistence Energy

abstract: In this research, we investigate the structural evolution of the cosmic web, employing advanced methodologies from Topological Data Analysis. Our approach involves leveraging LITE, an innovative method from recent literature that embeds persistence diagrams into elements of vector spaces. Utilizing this methodology, we analyze three quintessential cosmic structures: clusters, filaments, and voids. A central discovery is the correlation between \textit{Persistence Energy} and redshift values, linking persistent homology with cosmic evolution and providing insights into the dynamics of cosmic structures.


title: Revisiting Zero-Shot Abstractive Summarization in the Era of Large Language Models from the Perspective of Position Bias

abstract: We characterize and study zero-shot abstractive summarization in Large Language Models (LLMs) by measuring position bias, which we propose as a general formulation of the more restrictive lead bias phenomenon studied previously in the literature. Position bias captures the tendency of a model unfairly prioritizing information from certain parts of the input text over others, leading to undesirable behavior. Through numerous experiments on four diverse real-world datasets, we study position bias in multiple LLM models such as GPT 3.5-Turbo, Llama-2, and Dolly-v2, as well as state-of-the-art pretrained encoder-decoder abstractive summarization models such as Pegasus and BART. Our findings lead to novel insights and discussion on performance and position bias of models for zero-shot summarization tasks.


title: GPS-SSL: Guided Positive Sampling to Inject Prior Into Self-Supervised Learning

abstract: We propose Guided Positive Sampling Self-Supervised Learning (GPS-SSL), a general method to inject a priori knowledge into Self-Supervised Learning (SSL) positive samples selection. Current SSL methods leverage Data-Augmentations (DA) for generating positive samples and incorporate prior knowledge - an incorrect, or too weak DA will drastically reduce the quality of the learned representation. GPS-SSL proposes instead to design a metric space where Euclidean distances become a meaningful proxy for semantic relationship. In that space, it is now possible to generate positive samples from nearest neighbor sampling. Any prior knowledge can now be embedded into that metric space independently from the employed DA. From its simplicity, GPS-SSL is applicable to any SSL method, e.g. SimCLR or BYOL. A key benefit of GPS-SSL is in reducing the pressure in tailoring strong DAs. For example GPS-SSL reaches 85.58% on Cifar10 with weak DA while the baseline only reaches 37.51%. We therefore move a step forward towards the goal of making SSL less reliant on DA. We also show that even when using strong DAs, GPS-SSL outperforms the baselines on under-studied domains. We evaluate GPS-SSL along with multiple baseline SSL methods on numerous downstream datasets from different domains when the models use strong or minimal data augmentations. We hope that GPS-SSL will open new avenues in studying how to inject a priori knowledge into SSL in a principled manner.


title: DApps Ecosystems: Mapping the Network Structure of Smart Contract Interactions

abstract: In recent years, decentralized applications (dApps) built on blockchain platforms such as Ethereum and coded in languages such as Solidity, have gained attention for their potential to disrupt traditional centralized systems. Despite their rapid adoption, limited research has been conducted to understand the underlying code structure of these applications. In particular, each dApp is composed of multiple smart contracts, each containing a number of functions that can be called to trigger a specific event, e.g., a token transfer. In this paper, we reconstruct and analyse the network of contracts and functions calls within the dApp, which is helpful to unveil vulnerabilities that can be exploited by malicious attackers. We show how decentralization is architecturally implemented, identifying common development patterns and anomalies that could influence the system's robustness and efficiency. We find a consistent network structure characterized by modular, self-sufficient contracts and a complex web of function interactions, indicating common coding practices across the blockchain community. Critically, a small number of key functions within each dApp play a pivotal role in maintaining network connectivity, making them potential targets for cyber attacks and highlighting the need for robust security measures.


title: Breaking the Cosmological Principle into pieces: a prelude to the intrinsically homogeneous and isotropic spacetimes

abstract: In this manuscript, we show that three fundamental building blocks are supporting the Cosmological Principle. The first of them states that there is a special frame in the universe where the spatial geometry is intrinsically homogeneous and isotropic. The second demands the existence of a fiducial observer to whom the Hubble parameter is isotropic. The last piece states that matter and radiation behave as a perfect fluid. We show that these three hypotheses give us the Friedmann-Lema\^itre-Robertson-Walker (FLRW) spacetimes, the central pillar of the standard model of Cosmology. We keep with the first of them and start to investigate the so-called intrinsically homogeneous and isotropic spacetimes. They emerge after the decoupling of the CMB with the geometric frame of reference. Furthermore, a ``$\Lambda$CDM-like" effective theory arises naturally in those backgrounds, together with some new density parameters relating to the local inhomogeneities, the internal energy density, and the local and global magnitudes of the Hubble anisotropy. All those properties make this class of inhomogeneous models, which roughly speaking, keeps "1/3" of the Cosmological Principle, worth investigating in applications to Cosmology, for it can accommodate the same ingredients of the standard model, as a geometric frame and a free-falling isotropic cosmic background radiation, and reduce to the latter when some observable parameters vanish.


title: On Time-Indexing as Inductive Bias in Deep RL for Sequential Manipulation Tasks

abstract: While solving complex manipulation tasks, manipulation policies often need to learn a set of diverse skills to accomplish these tasks. The set of skills is often quite multimodal - each one may have a quite distinct distribution of actions and states. Standard deep policy-learning algorithms often model policies as deep neural networks with a single output head (deterministic or stochastic). This structure requires the network to learn to switch between modes internally, which can lead to lower sample efficiency and poor performance. In this paper we explore a simple structure which is conducive to skill learning required for so many of the manipulation tasks. Specifically, we propose a policy architecture that sequentially executes different action heads for fixed durations, enabling the learning of primitive skills such as reaching and grasping. Our empirical evaluation on the Metaworld tasks reveals that this simple structure outperforms standard policy learning methods, highlighting its potential for improved skill acquisition.


title: Minimal Model for Chirally Induced Spin Selectivity: Spin-orbit coupling, tunneling and decoherence

abstract: Chirally Induced Spin Selectivity (CISS) is a transport phenomenon observed in both linear and non-linear regimes, where the spin-orbit coupling (SOC) acts as the key driver and electron tunneling serves as the dominant mechanism for charge transfer. Despite SOC's inherent time-reversal symmetry (TRS) preservation, conventional reciprocity relations limit spin polarization and the differential treatment of spin species. In experimental systems, an additional factor, spin-independent decoherence, disrupts TRS and reciprocity. We introduce decoherence using the Buttiker voltage probe within the scattering matrix framework. Our results reveal the importance of under-the-barrier decoherence as an order-of-magnitude polarization enhancement mechanism. Polarization arises by the disruption of spin precession around the spin-orbit magnetic field with a new spin component along the field direction. The alignment of polarization depends on interference effects produced by the voltage probe. We discuss the connection of our model to a more realistic decoherence mechanism in molecular systems.


title: How does Observational Learning Impact Crowdfunding Outcomes for Backers, Project Creators and Platforms?

abstract: Reward-based crowdfunding platforms are becoming increasingly popular to finance projects proposing innovative products, e.g., Kickstarter. One important challenge of this form of financing is the uncertainty in the quality of projects. To mitigate the negative effects of this uncertainty for backers, platforms share information regarding the decisions of earlier backers visiting the project campaign pages. This allows backers not only to rely on their expertise to identify project qualities but also to learn from the decisions of their fellow backers who might be more informed. Current studies on observational learning (OL) in crowdfunding mainly focus on predicting the success chances of projects, and there is a lack of understanding of how OL affects crowdfunding dynamics for backers, project creators and platforms. This paper aims to fill this gap by using a theoretical OL model involving two projects competing for funding from backers who may have differentiated expertness in identifying project quality. By introducing various performance measures for backers, creators and platforms and comparing these measures under OL to the case without learning, we provide a thorough analysis of how OL impacts crowdfunding outcomes. We find that information sharing and OL always benefit backers, especially when the early backers are experts. Regarding the impact of OL on creators and platforms, our analysis reveals two understudied but important aspects: the tightness of the competition for projects according to the availability of funding, and the quality difference among the proposed projects. Additionally, we investigate how OL affects the quality decisions of creators and show that OL increases the incentive for high-quality products, especially in situations where funding is scarce.


title: Mean-Field Assisted Deep Boltzmann Learning with Probabilistic Computers

abstract: Despite their appeal as physics-inspired, energy-based and generative nature, general Boltzmann Machines (BM) are considered intractable to train. This belief led to simplified models of BMs with restricted intralayer connections or layer-by-layer training of deep BMs. Recent developments in domain-specific hardware -- specifically probabilistic computers (p-computer) with probabilistic bits (p-bit) -- may change established wisdom on the tractability of deep BMs. In this paper, we show that deep and unrestricted BMs can be trained using p-computers generating hundreds of billions of Markov Chain Monte Carlo (MCMC) samples per second, on sparse networks developed originally for use in D-Wave's annealers. To maximize the efficiency of learning the p-computer, we introduce two families of Mean-Field Theory assisted learning algorithms, or xMFTs (x = Naive and Hierarchical). The xMFTs are used to estimate the averages and correlations during the positive phase of the contrastive divergence (CD) algorithm and our custom-designed p-computer is used to estimate the averages and correlations in the negative phase. A custom Field-Programmable-Gate Array (FPGA) emulation of the p-computer architecture takes up to 45 billion flips per second, allowing the implementation of CD-$n$ where $n$ can be of the order of millions, unlike RBMs where $n$ is typically 1 or 2. Experiments on the full MNIST dataset with the combined algorithm show that the positive phase can be efficiently computed by xMFTs without much degradation when the negative phase is computed by the p-computer. Our algorithm can be used in other scalable Ising machines and its variants can be used to train BMs, previously thought to be intractable.


title: Generating Rhythm Game Music with Jukebox

abstract: Music has always been thought of as a "human" endeavor -- when praising a piece of music, we emphasize the composer's creativity and the emotions the music invokes. Because music also heavily relies on patterns and repetition in the form of recurring melodic themes and chord progressions, artificial intelligence has increasingly been able to replicate music in a human-like fashion. This research investigated the capabilities of Jukebox, an open-source commercially available neural network, to accurately replicate two genres of music often found in rhythm games, artcore and orchestral. A Google Colab notebook provided the computational resources necessary to sample and extend a total of sixteen piano arrangements of both genres. A survey containing selected samples was distributed to a local youth orchestra to gauge people's perceptions of the musicality of AI and human-generated music. Even though humans preferred human-generated music, Jukebox's slightly high rating showed that it was somewhat capable at mimicking the styles of both genres. Despite limitations of Jukebox only using raw audio and a relatively small sample size, it shows promise for the future of AI as a collaborative tool in music production.


title: A Corrected Score Function Framework for Modelling Circadian Gene Expression

abstract: Many biological processes display oscillatory behavior based on an approximately 24 hour internal timing system specific to each individual. One process of particular interest is gene expression, for which several circadian transcriptomic studies have identified associations between gene expression during a 24 hour period and an individual's health. A challenge with analyzing data from these studies is that each individual's internal timing system is offset relative to the 24 hour day-night cycle, where day-night cycle time is recorded for each collected sample. Laboratory procedures can accurately determine each individual's offset and determine the internal time of sample collection. However, these laboratory procedures are labor-intensive and expensive. In this paper, we propose a corrected score function framework to obtain a regression model of gene expression given internal time when the offset of each individual is too burdensome to determine. A feature of this framework is that it does not require the probability distribution generating offsets to be symmetric with a mean of zero. Simulation studies validate the use of this corrected score function framework for cosinor regression, which is prevalent in circadian transcriptomic studies. Illustrations with three real circadian transcriptomic data sets further demonstrate that the proposed framework consistently mitigates bias relative to using a score function that does not account for this offset.


title: Can increasing the size and flexibility of a molecule reduce decoherence?

abstract: Coherent superposition of electronic states, created by ionizing a molecule, can initiate ultrafast dynamics of the electron density. Correlation between nuclear and electron motions, however, typically dissipates the electronic coherence in only a few femtoseconds, especially in larger and more flexible molecules. We, therefore, use ab initio semiclassical dynamics to study decoherence in a sequence of organic molecules of increasing size and find, surprisingly, that extending the carbon skeleton in propynal analogs slows down decoherence and extends the duration of charge migration. To elucidate this observation, we decompose the overall decoherence into contributions from individual vibrational modes and show that: (1) The initial decay of electronic coherence is caused by high- and intermediate-frequency vibrations via momentum separation of nuclear wavepackets evolving on different electronic surfaces. (2) At later times, the coherence disappears completely due to the increasing position separation in the low-frequency modes. (3) In agreement with another study, we observe that only normal modes preserving the molecule's symmetry induce decoherence. All together, we justify the enhanced charge migration by a combination of increased hole-mixing and the disappearance of decoherence contributions from specific vibrational modes CO stretching in butynal and various H rockings in pentynal.


title: On the Particle Acceleration Mechanisms in a Double Radio Relic Galaxy Cluster, Abell 1240

abstract: We present a 368 ks deep Chandra observation of Abell~1240, a binary merging galaxy cluster at a redshift of 0.195 with two Brightest Cluster Galaxies (BCGs) may have passed each other 0.3 Gyr ago. Building upon previous investigations involving GMRT, VLA, and LOFAR data, our study focuses on two prominent extended radio relics at the north-west (NW) and south-east (SE) of the cluster core. By leveraging the high-resolution Chandra imaging, we have identified two distinct surface brightness edges at $\sim$ 1 Mpc and 1.2 Mpc NW and SE of the cluster center, respectively, coinciding with the outer edges of both relics. Our temperature measurements hint the edges to be shock front edges. The Mach numbers, derived from the gas density jumps, yield $\cal{M}_{\rm SE}$ = 1.49$^{+0.22}_{-0.24}$ for the South Eastern shock and $\cal{M}_{\rm NW}$ = 1.41$^{+0.17}_{-0.19}$ for the North Western shock. Our estimated Mach numbers are remarkably smaller compared to those derived from radio observations ($\cal{M}_{\rm SE}$ = 2.3 and $\cal{M}_{\rm NW}$ = 2.4), highlighting the prevalence of a re-acceleration scenario over direct acceleration of electrons from the thermal pool. Furthermore, we compare the observed temperature profiles across both shocks with that of predictions from collisional vs. collisionless models. Both shocks favor the Coulomb collisional model, but we could not rule out a purely collisionless model due to pre-shock temperature uncertainties.


title: Close to Human-Level Agreement: Tracing Journeys of Violent Speech in Incel Posts with GPT-4-Enhanced Annotations

abstract: This study investigates the prevalence of violent language on incels.is. It evaluates GPT models (GPT-3.5 and GPT-4) for content analysis in social sciences, focusing on the impact of varying prompts and batch sizes on coding quality for the detection of violent speech. We scraped over 6.9M posts from incels.is and categorized a random sample into non-violent, explicitly violent, and implicitly violent content. Two human coders annotated 3,028 posts, which we used to tune and evaluate GPT-3.5 and GPT-4 models across different prompts and batch sizes regarding coding reliability. The best-performing GPT-4 model annotated an additional 30,000 posts for further analysis. Our findings indicate an overall increase in violent speech overtime on incels.is, both at the community and individual level, particularly among more engaged users. While directed violent language decreases, non-directed violent language increases, and self-harm content shows a decline, especially after 2.5 years of user activity. We find substantial agreement between both human coders (K = .65), while the best GPT-4 model yields good agreement with both human coders (K = 0.54 for Human A and K = 0.62 for Human B). Weighted and macro F1 scores further support this alignment. Overall, this research provides practical means for accurately identifying violent language at a large scale that can aid content moderation and facilitate next-step research into the causal mechanism and potential mitigations of violent expression and radicalization in communities like incels.is.


title: Strong and Highly Switchable Soft Sticky Adhesives

abstract: Many biological systems can form strong adhesion to various materials with complex shapes. The adhesion is further switchable between strongly adhering and completely non-adhering in a simple and fast manner. By contrast, no engineering system has yet achieved the same robust adherence and switching. This limitation severely hinders the advancement of several emerging technologies including biomimetic robots, assembly-based manufacturing, precision medicine, wearable and implantable devices, as well as on-demand material dismantling and recycling for sustainability. Here we present a design approach for strong and highly switchable adhesion by synergizing the surface stickiness, bulk energy dissipation, and stimuli-responsive polymer chains in a thermo-switchable soft sticky adhesive. The adhesive has a high adhesion strength of about 80 kPa with diverse materials at room temperature. The adhesion is highly switchable to near-vanishing (about 0.6 kPa) at an elevated temperature due to the thermo-responsive surface polymer chain retraction. This adhesion switching is reversible and repeatable for many cycles, enabling selective pick-and-release of objects with various materials, shapes, sizes, and weights. The switching time is around 10 s with an adhesive layer of 1 mm, governed by thermal conduction through the adhesive, faster than or comparable to most state-of-the-art methods. The adhesive is self-healing, and can be recycled, dried, stored, reswollen, and reused with nearly intact adhesion and switching properties. The synergistic design combining strong adhesion and stimuli-responsive switching can be potentially extended to various polymer systems, and further enhanced by optimized surface architectures.


title: Naked Singularity Censoring with Anisotropic Apparent Horizon

abstract: Employing the Einstein-scalar field system, we demonstrate an approach for proving high co-dimensional nonlinear instability of naked-singularity solutions as constructed by Christodoulou in [18]. We further investigate the censorship of Christodoulou's naked singularity and show that a tiny anisotropic perturbation arising from the outgoing characteristic initial data would lead to the emergence of an anisotropic apparent horizon, which covers and censors the naked singularity. Our approach advances the hyperbolic short-pulse method by not requiring the aid of additional large parameters, by permitting the use of initial perturbations for the shear tensor and the derivative of scalar field to be with finite $BV$ and $C^0$ norms, and by allowing the initial perturbation to be arbitrarily small in scale-critical norms. New elliptic arguments based on non-perturbative methods are also developed.


title: Shadowing in the protoplanetary disk of ZZ Tau IRS with HST

abstract: An inner component misaligned from an outer component in a protoplanetary disk can result in the former casting shadows on the latter. We present a new instance of shadowing on the outer disk around a very low mass star, ZZ~Tau~IRS. Through the analysis of near-infrared (NIR) archival data at $\lambda=1.6$~$\mu$m acquired with the Wide Field Camera 3 on the Hubble Space Telescope, we identified brightness asymmetries in the top and bottom halves of the highly inclined outer disk, separated by a dark lane. The brighter sides in the top and bottom halves are on the opposite sides, which we attributed to shadows cast by a misaligned inner disk. Radiative transfer modeling of the system with a misaligned angle of 15~deg between the inner and outer disks well reproduced the observations. Additionally, we found an elevated brightness temperature of $^{12}$CO~(3-2) at $r\sim30$~au on the brighter side in NIR wavelengths in the top half disk, which can be explained by the shadowing effect too. While the origin of the misaligned inner disk remains unclear, future monitoring observations to search for temporal variations in brightness asymmetries will likely provide useful clues.


title: Parabolic bifurcation loci in the spaces of rational functions

abstract: We give a geometric description of the parabolic bifurcation locus in the space $\operatorname{Rat}_d$ of all rational functions on $\mathbb{P}^1$ of degree $d>1$, generalizing the study by Morton and Vivaldi in the case of monic polynomials. The results are new even for quadratic rational functions.


title: Fiber criteria for flatness and homomorphisms of flat affine group schemes

abstract: A very useful result concerning flatness in Algebraic Geometry is EGA's ``fiber'' criterion. We propose similar fiber criteria to verify flatness of a module while avoiding ``finiteness'' assumptions. Motivated by a Tannakian viewpoint (where the category of representations comes to the front), we derive applications to the theory of affine and flat group schemes.


title: Spinor-helicity representations of (A)dS$_4$ particles of any mass

abstract: The spinor-helicity representations of massive and (partially-)massless particles in four dimensional (Anti-) de Sitter spacetime are studied within the framework of the dual pair correspondence. We show that the dual groups (aka "little groups") of the AdS and dS groups are respectively $O(2N)$ and $O^*(2N)$. For $N=1$, the generator of the dual algebra $\mathfrak{so}(2)\cong \mathfrak{so}^*(2) \cong \mathfrak{u}(1)$ corresponds to the helicity operator, and the spinor-helicity representation describes massless particles in (A)dS$_4$. For $N=2$, the dual algebra is composed of two ideals, $\mathfrak{s}$ and $\mathfrak{m}_\Lambda$. The former ideal $\mathfrak{s}\cong \mathfrak{so}(3)$ fixes the spin of the particle, while the mass is determined by the latter ideal $\mathfrak{m}_\Lambda$, which is isomorphic to $\mathfrak{so}(2,1)$, $\mathfrak{iso}(2)$ or $\mathfrak{so}(3)$ depending on the cosmological constant being positive, zero or negative. In the case of a positive cosmological constant, namely dS$_4$, the spinor-helicity representation contains all massive particles corresponding to the principal series representations and the partially-massless particles corresponding to the discrete series representations leaving out only the light massive particles corresponding to the complementary series representations. The zero and negative cosmological constant cases, which had been addressed in earlier references, are also discussed briefly. Finally, we consider the multilinear form of helicity spinors invariant under (A)dS group, which can be served for the (A)dS counterpart of the scattering amplitude, and discuss technical differences and difficulties of the (A)dS cases compared to the flat spacetime case.


title: Two-Stage Surrogate Modeling for Data-Driven Design Optimization with Application to Composite Microstructure Generation

abstract: This paper introduces a novel two-stage machine learning-based surrogate modeling framework to address inverse problems in scientific and engineering fields. In the first stage of the proposed framework, a machine learning model termed the "learner" identifies a limited set of candidates within the input design space whose predicted outputs closely align with desired outcomes. Subsequently, in the second stage, a separate surrogate model, functioning as an "evaluator," is employed to assess the reduced candidate space generated in the first stage. This evaluation process eliminates inaccurate and uncertain solutions, guided by a user-defined coverage level. The framework's distinctive contribution is the integration of conformal inference, providing a versatile and efficient approach that can be widely applicable. To demonstrate the effectiveness of the proposed framework compared to conventional single-stage inverse problems, we conduct several benchmark tests and investigate an engineering application focused on the micromechanical modeling of fiber-reinforced composites. The results affirm the superiority of our proposed framework, as it consistently produces more reliable solutions. Therefore, the introduced framework offers a unique perspective on fostering interactions between machine learning-based surrogate models in real-world applications.


title: Self-Contrast: Better Reflection Through Inconsistent Solving Perspectives

abstract: The reflection capacity of Large Language Model (LLM) has garnered extensive attention. A post-hoc prompting strategy, e.g., reflexion and self-refine, refines LLM's response based on self-evaluated or external feedback. However, recent research indicates without external feedback, LLM's intrinsic reflection is unstable. Our investigation unveils that the key bottleneck is the quality of the self-evaluated feedback. We find LLMs often exhibit overconfidence or high randomness when self-evaluate, offering stubborn or inconsistent feedback, which causes poor reflection. To remedy this, we advocate Self-Contrast: It adaptively explores diverse solving perspectives tailored to the request, contrasts the differences, and summarizes these discrepancies into a checklist which could be used to re-examine and eliminate discrepancies. Our method endows LLM with diverse perspectives to alleviate stubborn biases. Moreover, their discrepancies indicate potential errors or inherent uncertainties that LLM often overlooks. Reflecting upon these can catalyze more accurate and stable reflection. Experiments conducted on a series of reasoning and translation tasks with different LLMs serve to underscore the effectiveness and generality of our strategy.


title: Numerical semistability of projective toric varieties

abstract: Let $X \to \mathbb P^N$ be a smooth linearly normal projective variety. It was proved by Paul that the $K$-energy of $(X, {\omega_{FS}}|_{X})$ restricted to the Bergman metrics is bounded from below if and only if the pair of (rescaled) Chow/Hurwitz forms of $X$ is numerically semistable. In this paper, we provide a necessary and sufficient condition for a given smooth toric variety $X_P$ to be numerically semistable with respect to $\mathcal O_{X_P}(i)$ for a positive integer $i$. Applying this result to a smooth polarized toric variety $(X_P, L_P)$, we prove that $(X_P, L_P)$ is asymptotically numerically semistable if and only if it is K-semistable for toric degenerations.


title: Decentralized Multi-Task Online Convex Optimization Under Random Link Failures

abstract: Decentralized optimization methods often entail information exchange between neighbors. Transmission failures can happen due to network congestion, hardware/software issues, communication outage, and other factors. In this paper, we investigate the random link failure problem in decentralized multi-task online convex optimization, where agents have individual decisions that are coupled with each other via pairwise constraints. Although widely used in constrained optimization, conventional saddle-point algorithms are not directly applicable here because of random packet dropping. To address this issue, we develop a robust decentralized saddle-point algorithm against random link failures with heterogeneous probabilities by replacing the missing decisions of neighbors with their latest received values. Then, by judiciously bounding the accumulated deviation stemming from this replacement, we first establish that our algorithm achieves $\mathcal{O}(\sqrt{T})$ regret and $\mathcal{O}(T^\frac{3}{4})$ constraint violations for the full information scenario, where the complete information on the local cost function is revealed to each agent at the end of each time slot. These two bounds match, in order sense, the performance bounds of algorithms with perfect communications. Further, we extend our algorithm and analysis to the two-point bandit feedback scenario, where only the values of the local cost function at two random points are disclosed to each agent sequentially. Performance bounds of the same orders as the full information case are derived. Finally, we corroborate the efficacy of the proposed algorithms and the analytical results through numerical simulations.


title: Fast & Fair: Efficient Second-Order Robust Optimization for Fairness in Machine Learning

abstract: This project explores adversarial training techniques to develop fairer Deep Neural Networks (DNNs) to mitigate the inherent bias they are known to exhibit. DNNs are susceptible to inheriting bias with respect to sensitive attributes such as race and gender, which can lead to life-altering outcomes (e.g., demographic bias in facial recognition software used to arrest a suspect). We propose a robust optimization problem, which we demonstrate can improve fairness in several datasets, both synthetic and real-world, using an affine linear model. Leveraging second order information, we are able to find a solution to our optimization problem more efficiently than a purely first order method.


title: SwitchTab: Switched Autoencoders Are Effective Tabular Learners

abstract: Self-supervised representation learning methods have achieved significant success in computer vision and natural language processing, where data samples exhibit explicit spatial or semantic dependencies. However, applying these methods to tabular data is challenging due to the less pronounced dependencies among data samples. In this paper, we address this limitation by introducing SwitchTab, a novel self-supervised method specifically designed to capture latent dependencies in tabular data. SwitchTab leverages an asymmetric encoder-decoder framework to decouple mutual and salient features among data pairs, resulting in more representative embeddings. These embeddings, in turn, contribute to better decision boundaries and lead to improved results in downstream tasks. To validate the effectiveness of SwitchTab, we conduct extensive experiments across various domains involving tabular data. The results showcase superior performance in end-to-end prediction tasks with fine-tuning. Moreover, we demonstrate that pre-trained salient embeddings can be utilized as plug-and-play features to enhance the performance of various traditional classification methods (e.g., Logistic Regression, XGBoost, etc.). Lastly, we highlight the capability of SwitchTab to create explainable representations through visualization of decoupled mutual and salient features in the latent space.


title: Enhancing Zero-Shot Multi-Speaker TTS with Negated Speaker Representations

abstract: Zero-shot multi-speaker TTS aims to synthesize speech with the voice of a chosen target speaker without any fine-tuning. Prevailing methods, however, encounter limitations at adapting to new speakers of out-of-domain settings, primarily due to inadequate speaker disentanglement and content leakage. To overcome these constraints, we propose an innovative negation feature learning paradigm that models decoupled speaker attributes as deviations from the complete audio representation by utilizing the subtraction operation. By eliminating superfluous content information from the speaker representation, our negation scheme not only mitigates content leakage, thereby enhancing synthesis robustness, but also improves speaker fidelity. In addition, to facilitate the learning of diverse speaker attributes, we leverage multi-stream Transformers, which retain multiple hypotheses and instigate a training paradigm akin to ensemble learning. To unify these hypotheses and realize the final speaker representation, we employ attention pooling. Finally, in light of the imperative to generate target text utterances in the desired voice, we adopt adaptive layer normalizations to effectively fuse the previously generated speaker representation with the target text representations, as opposed to mere concatenation of the text and audio modalities. Extensive experiments and validations substantiate the efficacy of our proposed approach in preserving and harnessing speaker-specific attributes vis-`a-vis alternative baseline models.


title: Improving Diffusion-Based Image Synthesis with Context Prediction

abstract: Diffusion models are a new class of generative models, and have dramatically promoted image generation with unprecedented quality and diversity. Existing diffusion models mainly try to reconstruct input image from a corrupted one with a pixel-wise or feature-wise constraint along spatial axes. However, such point-based reconstruction may fail to make each predicted pixel/feature fully preserve its neighborhood context, impairing diffusion-based image synthesis. As a powerful source of automatic supervisory signal, context has been well studied for learning representations. Inspired by this, we for the first time propose ConPreDiff to improve diffusion-based image synthesis with context prediction. We explicitly reinforce each point to predict its neighborhood context (i.e., multi-stride features/tokens/pixels) with a context decoder at the end of diffusion denoising blocks in training stage, and remove the decoder for inference. In this way, each point can better reconstruct itself by preserving its semantic connections with neighborhood context. This new paradigm of ConPreDiff can generalize to arbitrary discrete and continuous diffusion backbones without introducing extra parameters in sampling procedure. Extensive experiments are conducted on unconditional image generation, text-to-image generation and image inpainting tasks. Our ConPreDiff consistently outperforms previous methods and achieves a new SOTA text-to-image generation results on MS-COCO, with a zero-shot FID score of 6.21.


title: DeepOnet Based Preconditioning Strategies For Solving Parametric Linear Systems of Equations

abstract: We introduce a new class of hybrid preconditioners for solving parametric linear systems of equations. The proposed preconditioners are constructed by hybridizing the deep operator network, namely DeepONet, with standard iterative methods. Exploiting the spectral bias, DeepONet-based components are harnessed to address low-frequency error components, while conventional iterative methods are employed to mitigate high-frequency error components. Our preconditioning framework comprises two distinct hybridization approaches: direct preconditioning (DP) and trunk basis (TB) approaches. In the DP approach, DeepONet is used to approximate an action of an inverse operator to a vector during each preconditioning step. In contrast, the TB approach extracts basis functions from the trained DeepONet to construct a map to a smaller subspace, in which the low-frequency component of the error can be effectively eliminated. Our numerical results demonstrate that utilizing the TB approach enhances the convergence of Krylov methods by a large margin compared to standard non-hybrid preconditioning strategies. Moreover, the proposed hybrid preconditioners exhibit robustness across a wide range of model parameters and problem resolutions.


title: The origin of High-velocity stars considering the impact of the Large Magellanic Cloud

abstract: Utilizing astrometric parameters sourced from \textit{Gaia} Data Release 3 and radial velocities obtained from various spectroscopic surveys, we identify 519 high-velocity stars (HiVels) with a total velocity in the Galactocentric restframe greater than 70\% of their local escape velocity under the {\tt\string Gala} {\tt\string MilkyWayPotential}. Our analysis reveals that the majority of these HiVels are metal-poor late-type giants, and we show 9 HiVels that are unbound candidates to the Galaxy with escape probabilities of 50\%. To investigate the origins of these HiVels, we classify them into four categories and consider the impact of the Large Magellanic Cloud (LMC) potential on their backward-integration trajectories. Specifically, we find that one of the HiVels can track back to the Galactic Center, and three HiVels may originate from the Sagittarius dwarf spheroidal galaxy (Sgr dSph). Furthermore, some HiVels appear to be ejected from the Galactic disk, while others formed within the Milky Way or have an extragalactic origin. Given that the LMC has a significant impact on the orbits of Sgr dSph, we examine the reported HiVels that originate from the Sgr dSph, with a few of them passing within the half-light radius of the Sgr dSph.


title: Truncated string state space approach and its application to nonintegrable spin-$\frac{1}{2}$ Heisenberg chain

abstract: By circumventing the difficulty of obtaining exact string state solutions to Bethe ansatz equations, we devise a truncated string state space approach for investigating spin dynamics in a nonintegrable spin-$\frac{1}{2}$ Heisenberg chain subjected to a staggered field at various magnetizations. The obtained dynamical spectra reveal a series of elastic peaks at integer multiples of the ordering wave vector $Q$, indicating the presence of multi-$Q$ Bethe string states within the ground state. The spectrum exhibits a separation between different string continua as the strength of the staggered field increases at low magnetization, reflecting the confinement of the Bethe strings. This approach provides a unified string-state-based framework for understanding spin dynamics in low-dimensional nonintegrable Heisenberg models, which has a successful application to observations across various phases of the quasi-one-dimensional antiferromagnet $\rm YbAlO_3$.


title: From Function to Distribution Modeling: A PAC-Generative Approach to Offline Optimization

abstract: This paper considers the problem of offline optimization, where the objective function is unknown except for a collection of ``offline" data examples. While recent years have seen a flurry of work on applying various machine learning techniques to the offline optimization problem, the majority of these work focused on learning a surrogate of the unknown objective function and then applying existing optimization algorithms. While the idea of modeling the unknown objective function is intuitive and appealing, from the learning point of view it also makes it very difficult to tune the objective of the learner according to the objective of optimization. Instead of learning and then optimizing the unknown objective function, in this paper we take on a less intuitive but more direct view that optimization can be thought of as a process of sampling from a generative model. To learn an effective generative model from the offline data examples, we consider the standard technique of ``re-weighting", and our main technical contribution is a probably approximately correct (PAC) lower bound on the natural optimization objective, which allows us to jointly learn a weight function and a score-based generative model. The robustly competitive performance of the proposed approach is demonstrated via empirical studies using the standard offline optimization benchmarks.


title: Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticket

abstract: Spiking Neural Networks (SNNs), known for their biologically plausible architecture, face the challenge of limited performance. The self-attention mechanism, which is the cornerstone of the high-performance Transformer and also a biologically inspired structure, is absent in existing SNNs. To this end, we explore the potential of leveraging both self-attention capability and biological properties of SNNs, and propose a novel Spiking Self-Attention (SSA) and Spiking Transformer (Spikformer). The SSA mechanism eliminates the need for softmax and captures the sparse visual feature employing spike-based Query, Key, and Value. This sparse computation without multiplication makes SSA efficient and energy-saving. Further, we develop a Spiking Convolutional Stem (SCS) with supplementary convolutional layers to enhance the architecture of Spikformer. The Spikformer enhanced with the SCS is referred to as Spikformer V2. To train larger and deeper Spikformer V2, we introduce a pioneering exploration of Self-Supervised Learning (SSL) within the SNN. Specifically, we pre-train Spikformer V2 with masking and reconstruction style inspired by the mainstream self-supervised Transformer, and then finetune the Spikformer V2 on the image classification on ImageNet. Extensive experiments show that Spikformer V2 outperforms other previous surrogate training and ANN2SNN methods. An 8-layer Spikformer V2 achieves an accuracy of 80.38% using 4 time steps, and after SSL, a 172M 16-layer Spikformer V2 reaches an accuracy of 81.10% with just 1 time step. To the best of our knowledge, this is the first time that the SNN achieves 80+% accuracy on ImageNet. The code will be available at Spikformer V2.


title: InterMat: Accelerating Band Offset Prediction in Semiconductor Interfaces with DFT and Deep Learning

abstract: We introduce a computational framework (InterMat) to predict band offsets of semiconductor interfaces using density functional theory (DFT) and graph neural networks (GNN). As a first step, we benchmark OptB88vdW generalized gradient approximation (GGA) work functions and electron affinities for surfaces against experimental data with accuracies of 0.29 eV and 0.39 eV, respectively. Similarly, we evaluate band offset values using independent unit (IU) and alternate slab junction (ASJ) models leading to accuracies of 0.45 eV and 0.22 eV, respectively. We use bulk band structure calculations with the TBmBJ meta-GGA functional to correct for band gap underestimation when predicting conduction band properties. During ASJ structure generation, we use Zur algorithm along with a unified GNN force-field to tackle the conformation challenges of interface design. At present, we have 607 surface work functions calculated with DFT, from which we can compute 183921 IU band offsets as well as 593 directly calculated ASJ band offsets. Finally, as the space of all possible heterojunctions is too large to simulate with DFT, we develop generalized GNN models to quickly predict bulk band edges with an accuracy of 0.26 eV. We show how these models can be used to predict relevant quantities including ionization potentials, electron affinities, and IU-based band offsets. We establish simple rules using the above models to pre-screen potential semiconductor devices from a vast pool of nearly 1.4 trillion candidate interfaces. InterMat is available at website: https://github.com/usnistgov/intermat


title: The Near-optimal Performance of Quantum Error Correction Codes

abstract: The Knill-Laflamme (KL) conditions distinguish exact quantum error correction codes, and it has played a critical role in the discovery of state-of-the-art codes. However, the family of exact codes is a very restrictive one and does not necessarily contain the best-performing codes. Therefore, it is desirable to develop a generalized and quantitative performance metric. In this Letter, we derive the near-optimal channel fidelity, a concise and optimization-free metric for arbitrary codes and noise. The metric provides a narrow two-sided bound to the optimal code performance, and it can be evaluated with exactly the same input required by the KL conditions. We demonstrate the numerical advantage of the near-optimal channel fidelity through multiple qubit code and oscillator code examples. Compared to conventional optimization-based approaches, the reduced computational cost enables us to simulate systems with previously inaccessible sizes, such as oscillators encoding hundreds of average excitations. Moreover, we analytically derive the near-optimal performance for the thermodynamic code and the Gottesman-Kitaev-Preskill (GKP) code. In particular, the GKP code's performance under excitation loss improves monotonically with its energy and converges to an asymptotic limit at infinite energy, which is distinct from other oscillator codes.


title: On Complexity of Stability Analysis in Higher-order Ecological Networks through Tensor Decompositions

abstract: Complex ecological networks are often characterized by intricate interactions that extend beyond pairwise relationships. Understanding the stability of higher-order ecological networks is salient for species coexistence, biodiversity, and community persistence. In this article, we present complexity analyses for determining the linear stability of higher-order ecological networks through tensor decompositions. We are interested in the higher-order generalized Lotka-Volterra model, which captures high-order interactions using tensors of varying orders. To efficiently compute Jacobian matrices and thus determine stability in large ecological networks, we exploit various tensor decompositions, including higher-order singular value decomposition, Canonical Polyadic decomposition, and tensor train decomposition, accompanied by in-depth computational and memory complexity analyses. We demonstrate the effectiveness of our framework with numerical examples.


title: A convergence result for a local planning problem for mean field games and rigorous proof of a Freidlin-Ventchel-type Large Deviations Principle for the $1+1$ KPZ equation

abstract: We prove the convergence of a viscous approximation to an one dimensional local mean field type planning problem with singular initial and terminal measures. Then we use this result to give a rigorous proof to a Freidlin-Ventchel-type Large Deviations Principle for the height of the $1+1$ KPZ equation.


title: Formation of collisional ring galaxies in Milgromian dynamics

abstract: Ring galaxies are rare in the Universe. A head-on or off-centre collision between an intruder galaxy and a disc galaxy leads to a collisional ring galaxy (CRG) when the intruder-to-target mass ratio (ITMR) is over 0.1 in Newtonian dynamics. Within the framework of Milgromian dynamics, the strong equivalence principle is violated due to the presence of an external field. When two galaxies collide towards each other, the dynamical mass of the phantom dark halo in a galaxy is suppressed by the external field induced by the other galaxy. As a consequence of such suppression, the gravitational perturbation for the target galaxy introduced by a collision is weakened. In this case, a minor collision may not be capable of generating a CRG. In this work, we address this issue and perform a series of numerical simulations of collisions by tuning the values of ITMR. We find that the critical ITMR is 0.5 in MOND, which is much larger than that in Newtonian dynamics. The observed massive ring galaxies, such as Arp 147, can be effectively interpreted by CRGs in MOND. This interpretation does not necessitate the presence of dark matter halos for either the target or intruder galaxies. Moreover, for a larger inclination angle or a larger impact parameter, the off-centred ring structure is fainter. The larger critical ITMR indicates that it is harder to form a CRG in Milgrom's Modified Newtonian Dynamics (MOND). To account for the observed ring structures of the NGC 922-like galaxies in MOND, it is necessary to invoke other scenarios than a dry minor collision.


title: Intrinsic insulating transport characteristics in low-carrier density EuCd2As2 films

abstract: Searching for an ideal magnetic Weyl semimetal hosting only a single pair of Weyl points has been a focal point for systematic clarification of its unique magnetotransport derived from the interplay between topology and magnetization. Among the candidates, triangular-lattice antiferromagnet EuCd$_2$As$_2$ has been attracting special attention due to the prediction of the ideal Weyl semimetal phase in the ferromagnetic state, however, transport properties of low-carrier density samples have remained elusive. Here we report molecular beam epitaxy growth of EuCd$_2$As$_2$ films, achieving low-hole density in the range of $10^{15}$-$10^{16}$ cm$^{-3}$ at low temperature. Transport measurements of such low-carrier density films reveal an insulating behavior with an activation gap of about 200 meV, which persists even in the field-induced ferromagnetic state. Our work provides an important experimental clue that EuCd$_2$As$_2$ is intrinsically insulating, contrary to the previous prediction.


title: Solving a Delay Differential Equation through Fourier Transform

abstract: In this study, we introduce and explore a delay differential equation that lends itself to explicit solutions in the Fourier-transformed space. Through the careful alignment of the initial function, we can construct a highly accurate solution to the equation. These findings open new avenues for understanding delay systems, demonstrating the efficacy of Fourier transform techniques in capturing transient oscillatory dynamics.


title: Pseudospin Symmetry: Microscopic origin of the ground-state inversion in neutron-rich odd-A Cu isotopes

abstract: The role of the pseudospin symmetry in the inversion of the ground-state spin in Cu isotopes is investigated within the covariant density functional theory (CDFT). The density functional PC-PK1 gives a good agreement with the observed ground-state properties of the odd-A $^{69-79}$Cu. In particular, the inversion of the ground-state spin at $A=75$ is reproduced nicely, which can be explained by the level crossing between the proton pseudospin partners $\pi 2p_{3/2}$ and $\pi 1f_{5/2}$. It is found that the pseudospin symmetry plays a dominant role in the evolution of the energy splittings between the pseudospin partners. By comparing with the results of the nonrelativistic DFTs, our studies suggest that the pseudospin symmetry is essential to the shell evolution around this region.


title: Examining the Challenges in Archiving Instagram

abstract: To prevent the spread of disinformation on Instagram, we need to study the accounts and content of disinformation actors. However, due to their malicious nature, Instagram often bans accounts that are responsible for spreading disinformation, making these accounts inaccessible from the live web. The only way we can study the content of banned accounts is through public web archives such as the Internet Archive. However, there are many issues present with archiving Instagram pages. Specifically, we focused on the issue that many Wayback Machine Instagram mementos redirect to the Instagram login page. In this study, we determined that mementos of Instagram account pages on the Wayback Machine began redirecting to the Instagram login page in August 2019. We also found that Instagram mementos on Archive.today, Arquivo.pt, and Perma.cc are also not well archived in terms of quantity and quality. Moreover, we were unsuccessful in all our attempts to archive Katy Perry's Instagram account page on Archive.today, Arquivo.pt, and Conifer. Although in the minority, replayable Instagram mementos exist in public archives and contain valuable data for studying disinformation on Instagram. With that in mind, we developed a Python script to web scrape Instagram mementos. As of August 2023, the Python script can scrape Wayback Machine archives of Instagram account pages between November 7, 2012 and June 8, 2018.


title: Travelers: A scalable fair ordering BFT system

abstract: Many blockchain platform are subject to maximal value extraction (MEV), and users on the platform are losing money while sending transactions because the transaction order can be manipulated to extract value from them. Consensus protocols have been augmented with different notion of fair ordering in order to counter the problem. Out of all practical protocols, the most efficient BFT consensus requires $O(nTL + n^2T)$ communication complexity, where $n$ is number node, $T$ is number of transactions and $L$ is average transaction size. In this work, we propose a new system of BFT fair ordering protocols, Travelers, that substantially reduce the communication complexity. The proposed system of protocols satisfy a new notion of fair ordering, called probabilistic fair ordering, which is an extension to some existing notions of fairness. The new notion allows a small probability of error $\epsilon$, that adversary can insert some transactions at any location in a block, but for the remaining $1-\epsilon$ the a modified version of ordering linearizability holds. Our mechanism neither require a dissemination network nor direct submissions to all consensus nodes. The key innovation comes from a routing protocol, that is both flexible and efficient. We construct a protocol with $O(c\log({n})TL + n^2)$ communication complexity with $\epsilon = 1/n^c$ for some system parameter $c\ge 1$.


title: Spy-Watermark: Robust Invisible Watermarking for Backdoor Attack

abstract: Backdoor attack aims to deceive a victim model when facing backdoor instances while maintaining its performance on benign data. Current methods use manual patterns or special perturbations as triggers, while they often overlook the robustness against data corruption, making backdoor attacks easy to defend in practice. To address this issue, we propose a novel backdoor attack method named Spy-Watermark, which remains effective when facing data collapse and backdoor defense. Therein, we introduce a learnable watermark embedded in the latent domain of images, serving as the trigger. Then, we search for a watermark that can withstand collapse during image decoding, cooperating with several anti-collapse operations to further enhance the resilience of our trigger against data corruption. Extensive experiments are conducted on CIFAR10, GTSRB, and ImageNet datasets, demonstrating that Spy-Watermark overtakes ten state-of-the-art methods in terms of robustness and stealthiness.


title: DiffusionEdge: Diffusion Probabilistic Model for Crisp Edge Detection

abstract: Limited by the encoder-decoder architecture, learning-based edge detectors usually have difficulty predicting edge maps that satisfy both correctness and crispness. With the recent success of the diffusion probabilistic model (DPM), we found it is especially suitable for accurate and crisp edge detection since the denoising process is directly applied to the original image size. Therefore, we propose the first diffusion model for the task of general edge detection, which we call DiffusionEdge. To avoid expensive computational resources while retaining the final performance, we apply DPM in the latent space and enable the classic cross-entropy loss which is uncertainty-aware in pixel level to directly optimize the parameters in latent space in a distillation manner. We also adopt a decoupled architecture to speed up the denoising process and propose a corresponding adaptive Fourier filter to adjust the latent features of specific frequencies. With all the technical designs, DiffusionEdge can be stably trained with limited resources, predicting crisp and accurate edge maps with much fewer augmentation strategies. Extensive experiments on four edge detection benchmarks demonstrate the superiority of DiffusionEdge both in correctness and crispness. On the NYUDv2 dataset, compared to the second best, we increase the ODS, OIS (without post-processing) and AC by 30.2%, 28.1% and 65.1%, respectively. Code: https://github.com/GuHuangAI/DiffusionEdge.


title: Automated Test Production -- Systematic Literature Review

abstract: Identifying the main contributions related to the Automated Test Production (ATP) of Computer Programs and providing an overview about models, methodologies and tools used for this purpose is the aim of this Systematic Literature Review (SLR). The results will enable a comprehensive analysis and insight to evaluate their applicability. A previously produced Systematic Literature Mapping (SLM) contributed to the formulation of the ``Research Questions'' and parameters for the definition of the qualitative analysis protocol of this review.


title: Text2MDT: Extracting Medical Decision Trees from Medical Texts

abstract: Knowledge of the medical decision process, which can be modeled as medical decision trees (MDTs), is critical to build clinical decision support systems. However, the current MDT construction methods rely heavily on time-consuming and laborious manual annotation. In this work, we propose a novel task, Text2MDT, to explore the automatic extraction of MDTs from medical texts such as medical guidelines and textbooks. We normalize the form of the MDT and create an annotated Text-to-MDT dataset in Chinese with the participation of medical experts. We investigate two different methods for the Text2MDT tasks: (a) an end-to-end framework which only relies on a GPT style large language models (LLM) instruction tuning to generate all the node information and tree structures. (b) The pipeline framework which decomposes the Text2MDT task to three subtasks. Experiments on our Text2MDT dataset demonstrate that: (a) the end-to-end method basd on LLMs (7B parameters or larger) show promising results, and successfully outperform the pipeline methods. (b) The chain-of-thought (COT) prompting method \cite{Wei2022ChainOT} can improve the performance of the fine-tuned LLMs on the Text2MDT test set. (c) the lightweight pipelined method based on encoder-based pretrained models can perform comparably with LLMs with model complexity two magnititudes smaller. Our Text2MDT dataset is open-sourced at \url{https://tianchi.aliyun.com/dataset/95414}, and the source codes are open-sourced at \url{https://github.com/michael-wzhu/text2dt}.


title: Efficient Information Geometry Approach for Massive MIMO-OFDM Channel Estimation

abstract: We investigate the channel estimation for massive multiple-input multiple-output orthogonal frequency division multiplexing (MIMO-OFDM) systems. We revisit the information geometry approach (IGA) for massive MIMO-OFDM channel estimation. By using the constant magnitude property of the entries of the measurement matrix, we find that the second-order natural parameters of the distributions on all the auxiliary manifolds are equivalent to each other, and the first-order natural parameters are asymptotically equivalent to each other at the fixed point. Motivated by these results, we simplify the process of IGA and propose an efficient IGA (EIGA) for massive MIMO-OFDM channel estimation, which allows efficient implementation with fast Fourier transformation (FFT). We then establish a sufficient condition of its convergence and accordingly find a range of the damping factor for the convergence. We show that this range of damping factor is sufficiently wide by using the specific properties of the measurement matrices. Further, we prove that at the fixed point, the a posteriori mean obtained by EIGA is asymptotically optimal. Simulations confirm that EIGA can achieve the optimal performance with low complexity in a limited number of iterations.


title: Infinite transition solutions for an Allen-Cahn equation

abstract: We give another proof of a theorem of Rabinowitz and Stredulinsky obtaining infinite transition solutions for an Allen--Cahn equation. Rabinowitz and Stredulinsky have constructed infinite transition solutions as locally minimal solutions, but it is still an interesting question to establish these solutions by other method. Our result may attract the interest of constructing solutions with the shape of locally minimal solutions of Rabinowitz and Stredulinsky for problems defined on descrete group.


title: Simplified Information Geometry Approach for Massive MIMO-OFDM Channel Estimation -- Part II: Convergence Analysis

abstract: In Part II of this two-part paper, we prove the convergence of the simplified information geometry approach (SIGA) proposed in Part I. For a general Bayesian inference problem, we first show that the iteration of the common second-order natural parameter (SONP) is separated from that of the common first-order natural parameter (FONP). Hence, the convergence of the common SONP can be checked independently. We show that with the initialization satisfying a specific but large range, the common SONP is convergent regardless of the value of the damping factor. For the common FONP, we establish a sufficient condition of its convergence and prove that the convergence of the common FONP relies on the spectral radius of a particular matrix related to the damping factor. We give the range of the damping factor that guarantees the convergence in the worst case. Further, we determine the range of the damping factor for massive MIMO-OFDM channel estimation by using the specific properties of the measurement matrices. Simulation results are provided to confirm the theoretical results.


title: Understanding LLMs: A Comprehensive Overview from Training to Inference

abstract: The introduction of ChatGPT has led to a significant increase in the utilization of Large Language Models (LLMs) for addressing downstream tasks. There's an increasing focus on cost-efficient training and deployment within this context. Low-cost training and deployment of LLMs represent the future development trend. This paper reviews the evolution of large language model training techniques and inference deployment technologies aligned with this emerging trend. The discussion on training includes various aspects, including data preprocessing, training architecture, pre-training tasks, parallel training, and relevant content related to model fine-tuning. On the inference side, the paper covers topics such as model compression, parallel computation, memory scheduling, and structural optimization. It also explores LLMs' utilization and provides insights into their future development.


title: Analytic relations assessing the impact of precursor knowledge and key mission parameters on direct imaging survey yield

abstract: The Habitable Worlds Observatory will attempt to image Earth-sized planets in Habitable Zone orbits around nearby Sun-like stars. In this work we explore approximate analytic yield calculations for a future flagship direct imaging mission for a survey sample of uniformly distributed set of identical Sun-like stars. We consider the dependence of this exoplanet detection yield on factors such as eta_Earth, telescope diameter, total on-sky time, orbital phase and separation, inner working angle, flux contrast, desired signal-to-noise ratio, spectral resolution, and other factors. We consider the impact on yield and survey efficiency in the absence of and with precursor knowledge of the Earth-size analog exoplanets. In particular, for precursor knowledge we assume the exoplanet orbital phase at the time of observation can be optimized so as to only image the Earth-size analog exoplanet when it is outside the inner working angle. We find that the yield of flagship direct imaging missions such as Habitable Worlds Observatory will be inner-working angle limited for the estimated exoplanet yields, and will not be impacted by precursor knowledge given our assumptions presented herein. However, we find that the survey efficiency will be enhanced by precursor knowledge. We benchmark our analytic approximations against detailed simulations for coronagraphs and starshades carried out for the HabEx and LUVOIR missions concept studies, and find consistent conclusions. Our analytic relations thus provide quick estimates and derivatives of the impact of key mission parameter choices on exo-Earth yield when considering design trades that can supplement existing computational simulations.


title: A Bregman Proximal Stochastic Gradient Method with Extrapolation for Nonconvex Nonsmooth Problems

abstract: In this paper, we explore a specific optimization problem that involves the combination of a differentiable nonconvex function and a nondifferentiable function. The differentiable component lacks a global Lipschitz continuous gradient, posing challenges for optimization. To address this issue and accelerate the convergence, we propose a Bregman proximal stochastic gradient method with extrapolation (BPSGE), which only requires smooth adaptivity of the differentiable part. Under the variance reduction framework, we not only analyze the subsequential and global convergence of the proposed algorithm under certain conditions, but also analyze the sublinear convergence rate of the subsequence, and the complexity of the algorithm, revealing that the BPSGE algorithm requires at most O(epsilon\^\,(-2)) iterations in expectation to attain an epsilon-stationary point. To validate the effectiveness of our proposed algorithm, we conduct numerical experiments on three real-world applications: graph regularized nonnegative matrix factorization (NMF), matrix factorization with weakly-convex regularization, and NMF with nonconvex sparsity constraints. These experiments demonstrate that BPSGE is faster than the baselines without extrapolation.


title: Efficient Cloud-edge Collaborative Inference for Object Re-identification

abstract: Current object re-identification (ReID) system follows the centralized processing paradigm, i.e., all computations are conducted in the cloud server and edge devices are only used to capture and send images. As the number of videos experiences a rapid escalation, this paradigm has become impractical due to the finite computational resources. In such a scenario, the ReID system should be converted to fit in the cloud-edge collaborative processing paradigm, which is crucial to boost the scalability and practicality of ReID systems. However, current relevant work lacks research on this issue, making it challenging for ReID methods to be adapted effectively. Therefore, we pioneer a cloud-edge collaborative inference framework for ReID systems and particularly propose a distribution-aware correlation modeling network (DaCM) to make the desired image return to the cloud server as soon as possible via learning to model the spatial-temporal correlations among instances. DaCM embeds the spatial-temporal correlations implicitly included in the timestamps into a graph structure, and it can be applied in the cloud to regulate the size of the upload window and on the edge device to adjust the sequence of images, respectively. Traditional ReID methods can be combined with DaCM seamlessly, enabling their application within our proposed edge-cloud collaborative framework. Extensive experiments demonstrate that our method obviously reduces transmission overhead and significantly improves performance. We will release our code and model.


title: Impact of Green Marketing Strategy on Brand Awareness: Business, Management, and Human Resources Aspects

abstract: Given the move towards industrialization in societies, the increase in dynamism and competition among companies to capture market share, raising concerns about the environment, government, and international regulations and obligations, increased consumer awareness, pressure from nature-loving groups, etc., organizations have become more attentive to issues related to environmental management. Over time, concepts such as green marketing have permeated marketing literature, making environmental considerations one of the most important activities of companies. To this end, this research examines the impact of green marketing strategy on brand awareness (case study: food exporting companies). The population of this research consists of 345 employees and managers of companies like Kalleh, Solico, Pemina, Sorbon, Mac, Pol, and Castle, from which 182 individuals were randomly selected as the sample using Cochran's formula. This research is practical, and the required data have been collected through a survey and a questionnaire. The research results indicate that (1) green marketing strategy significantly affects brand awareness. (2) Green products have a significant positive effect on brand awareness. (3) Green promotions have a significant positive effect on brand awareness. (4) Green distribution has a significant positive effect on brand awareness. (5) Green pricing has a significant positive effect on brand awareness.


title: Signal Detection for Ultra-Massive MIMO: An Information Geometry Approach

abstract: In this paper, we propose an information geometry approach (IGA) for signal detection (SD) in ultra-massive multiple-input multiple-output (MIMO) systems. We formulate the signal detection as obtaining the marginals of the a posteriori probability distribution of the transmitted symbol vector. Then, a maximization of the a posteriori marginals (MPM) for signal detection can be performed. With the information geometry theory, we calculate the approximations of the a posteriori marginals. It is formulated as an iterative m-projection process between submanifolds with different constraints. We then apply the central-limit-theorem (CLT) to simplify the calculation of the m-projection since the direct calculation of the m-projection is of exponential-complexity. With the CLT, we obtain an approximate solution of the m-projection, which is asymptotically accurate. Simulation results demonstrate that the proposed IGA-SD emerges as a promising and efficient method to implement the signal detector in ultra-massive MIMO systems.


title: Multi-modal vision-language model for generalizable annotation-free pathological lesions localization and clinical diagnosis

abstract: Defining pathologies automatically from medical images aids the understanding of the emergence and progression of diseases, and such an ability is crucial in clinical diagnostics. However, existing deep learning models heavily rely on expert annotations and lack generalization capabilities in open clinical environments. In this study, we present a generalizable vision-language pre-training model for Annotation-Free pathological lesions Localization (AFLoc). The core strength of AFLoc lies in its extensive multi-level semantic structure-based contrastive learning, which comprehensively aligns multi-granularity medical concepts from reports with abundant image features, to adapt to the diverse expressions of pathologies and unseen pathologies without the reliance on image annotations from experts. We demonstrate the proof of concept on CXR images, with extensive experimental validation across 4 distinct external datasets, encompassing 11 types of chest pathologies. The results demonstrate that AFLoc surpasses state-of-the-art methods in pathological lesions localization and disease classification, and even outperforms the human benchmark in locating 5 different pathologies. Additionally, we further verify its generalization ability by applying it to retinal fundus images. Our approach showcases AFoc versatilities and underscores its suitability for clinical diagnoses in complex clinical environments.


title: Quasinormal modes, greybody factors and thermodynamics of four dimensional AdS black holes in Critical Gravity

abstract: In the present work, considering critical gravity as a gravity model, an electrically charged topological Anti-de Sitter black hole with a matter source characterized by a nonlinear electrodynamics framework is obtained. This configuration is defined by an integration constant, three key structural constants, and a constant that represents the topology of the event horizon. Additionally, based on the Wald formalism, we probe that this configuration enjoys non-trivial thermodynamic quantities, establishing the corresponding first law of black hole thermodynamics, as well as local stability under thermal and electrical fluctuations. Additionally, via the Gibbs free energy we note that the topology of the base manifold allows us to compare this charged configuration with respect to the thermal AdS space-time, allowing us to obtain a first-order phase transition. The quasinormal modes and the greybody factor are also calculated by considering the spherical situation. We found that the quasinormal modes exhibit a straightforward change for variations of one of the structural constants.


title: CTC Blank Triggered Dynamic Layer-Skipping for Efficient CTC-based Speech Recognition

abstract: Deploying end-to-end speech recognition models with limited computing resources remains challenging, despite their impressive performance. Given the gradual increase in model size and the wide range of model applications, selectively executing model components for different inputs to improve the inference efficiency is of great interest. In this paper, we propose a dynamic layer-skipping method that leverages the CTC blank output from intermediate layers to trigger the skipping of the last few encoder layers for frames with high blank probabilities. Furthermore, we factorize the CTC output distribution and perform knowledge distillation on intermediate layers to reduce computation and improve recognition accuracy. Experimental results show that by utilizing the CTC blank, the encoder layer depth can be adjusted dynamically, resulting in 29% acceleration of the CTC model inference with minor performance degradation.


title: Covid19 Vaccine Acceptance and Deprivation in US Counties

abstract: This report explores the central question of how socioeconomic status affects Covid19 vaccination rates in the United States, using existing open-source data. In general, a negative correlation exists between Area Deprivation Index (ADI) of a county and first dose, primary series and booster vaccination rates. Higher area deprivation correlated with polled vaccine hesitancy and lower search interest in vaccine interest, intention to vaccinate or concern about safety of vaccination. Positive correlations between ADI and certain mental health search trends were noted. No clear correlation between deprivation index and accessibility to vaccination sites were observed. In a small data sample, county level housing assistance policies and public information campaigns were noted to positively influence vaccine follow through rates. Finally, random forest, linear regression and KNN models were explored to validate the use of the above features for vaccine acceptance prediction.


title: Random Effect Restricted Mean Survival Time Model

abstract: The restricted mean survival time (RMST) model has been garnering attention as a way to provide a clinically intuitive measure: the mean survival time. RMST models, which use methods based on pseudo time-to-event values and inverse probability censoring weighting, can adjust covariates. However, no approach has yet been introduced that considers random effects for clusters. In this paper, we propose a new random-effect RMST. We present two methods of analysis that consider variable effects by i) using a generalized mixed model with pseudo-values and ii) integrating the estimated results from the inverse probability censoring weighting estimating equations for each cluster. We evaluate our proposed methods through computer simulations. In addition, we analyze the effect of a mother's age at birth on under-five deaths in India using states as clusters.


title: Forecasting Bitcoin Volatility: A Comparative Analysis of Volatility Approaches

abstract: This paper conducts an extensive analysis of Bitcoin return series, with a primary focus on three volatility metrics: historical volatility (calculated as the sample standard deviation), forecasted volatility (derived from GARCH-type models), and implied volatility (computed from the emerging Bitcoin options market). These measures of volatility serve as indicators of market expectations for conditional volatility and are compared to elucidate their differences and similarities. The central finding of this study underscores a notably high expected level of volatility, both on a daily and annual basis, across all the methodologies employed. However, it's crucial to emphasize the potential challenges stemming from suboptimal liquidity in the Bitcoin options market. These liquidity constraints may lead to discrepancies in the computed values of implied volatility, particularly in scenarios involving extreme moneyness or maturity. This analysis provides valuable insights into Bitcoin's volatility landscape, shedding light on the unique characteristics and dynamics of this cryptocurrency within the context of financial markets.


title: Some Gr\"onwall inequalities for a class of discretizations of time fractional equations on nonuniform meshes

abstract: We consider the completely positive discretizations of fractional ordinary differential equations (FODEs) on nonuniform meshes. Making use of the resolvents for nonuniform meshes, we first establish comparison principles for the discretizations. Then we prove some discrete Gr\"onwall inequalities using the comparison principles and careful analysis of the solutions to the time continuous FODEs. Our results do not have any restrictions on the step size ratio. The Gr\"onwall inequalities for dissipative equations can be used to obtain the uniform-in-time error control and decay estimates of the numerical solutions. The Gr\"onwall inequalities are then applied to subdiffusion problems and the time fractional Allen-Cahn equations for illustration.


title: Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Model

abstract: Heuristics are widely used for dealing with complex search and optimization problems. However, manual design of heuristics can be often very labour extensive and requires rich working experience and knowledge. This paper proposes Evolution of Heuristic (EoH), a novel evolutionary paradigm that leverages both Large Language Models (LLMs) and Evolutionary Computation (EC) methods for Automatic Heuristic Design (AHD). EoH represents the ideas of heuristics in natural language, termed thoughts. They are then translated into executable codes by LLMs. The evolution of both thoughts and codes in an evolutionary search framework makes it very effective and efficient for generating high-performance heuristics. Experiments on three widely studied combinatorial optimization benchmark problems demonstrate that EoH outperforms commonly used handcrafted heuristics and other recent AHD methods including FunSearch. Particularly, the heuristic produced by EoH with a low computational budget (in terms of the number of queries to LLMs) significantly outperforms widely-used human hand-crafted baseline algorithms for the online bin packing problem.


title: Encoder-Decoder Based Long Short-Term Memory (LSTM) Model for Video Captioning

abstract: This work demonstrates the implementation and use of an encoder-decoder model to perform a many-to-many mapping of video data to text captions. The many-to-many mapping occurs via an input temporal sequence of video frames to an output sequence of words to form a caption sentence. Data preprocessing, model construction, and model training are discussed. Caption correctness is evaluated using 2-gram BLEU scores across the different splits of the dataset. Specific examples of output captions were shown to demonstrate model generality over the video temporal dimension. Predicted captions were shown to generalize over video action, even in instances where the video scene changed dramatically. Model architecture changes are discussed to improve sentence grammar and correctness.


title: Transversal and Paving Positroids

abstract: In this paper, we study positroids and its overlap with two classes of matroids: transversal and paving matroids. We exhibit a new class of fundamental transversal matroids and classify the Le-diagram for rank two transversal positroids. We also establish a combinatorial description for paving positroids in terms of Le-diagrams.


title: Less Conservative Robust Reference Governors and Their Applications

abstract: The applications of reference governors to systems with unmeasured set-bounded disturbances can lead to conservative solutions. This conservatism can be reduced by estimating the disturbance from output measurements and canceling it in the nominal control law. In this paper, a reference governor based on such an approach is considered and time-varying, disturbance and state estimation errors bounding sets are derived. Consequently, the traditional implementation of a reference governor, which exploits a constraint admissible positively-invariant set of constant commands and initial states, is replaced by one which utilizes a time-dependent sequence of similar sets (which are not necessary nested). Examples are reported which include two applications to longitudinal control of aircraft that illustrate handling of elevator uncertainty and wing icing.


title: A quasi-dynamic one-equation model with joint constraints of kinetic energy and helicity fluxes for large eddy simulation of rotating turbulence

abstract: For settling the problem with rotating turbulence modelling, a quasi-dynamic one-equation subgrid-scale (SGS) model is proposed in this paper. Considering the key role of the joint cascade of kinetic energy and helicity in rotating turbulence, the new SGS model is constrained by the fluxes of kinetic energy and helicity. Specifically, the new theory of dual channels of helicity flux is taken into account. The modelling of the unclosed quantities is achieved by adopting a quasi-dynamic process that eliminates the need for test filtering compared to the classic dynamic process, and the model coefficients are dynamically obtained through the SGS kinetic energy transport equation and considering the joint constraints of kinetic energy and helicity fluxes. As a result, the model demonstrates a high correlation with DNS data in a priori tests. We refer to this new model as the quasi-dynamic joint-constraint model (QCM), which is introduced for both incompressible and compressible flows. To assess the effectiveness of the QCM, numerical experiments are conducted for three typical cases: incompressible streamwise rotating channel flow, transonic streamwise rotating annular pipe flow, and hypersonic transition flow at Mach 6 over a rotating cone. The results suggest that the QCM has the potential to significantly improve the prediction of rotational flows that are strongly influenced by helicity. Additionally, the new model demonstrates excellent capability in handling the transition process.


title: Production of Higgs Boson in ultra-peripheral heavy ion collisions with two-photon processes

abstract: We calculated the production of the Higgs boson (H) by two-photon interaction with the equivalent photon approximation in nucleus-nucleus collision, proton-nucleus collision, and proton-proton collision. The numerical results show that the experimental study of the Higgs boson in ultra-peripheral collisions is feasible at the energies of the relativistic heavy ion collider (RHIC) and the large hadron collider (LHC).


title: $q$-de Rham complexes of higher level

abstract: In this article, we construct two kinds of de Rham-like complexes which compute the cohomology of complete crystals on higher-level $q$-crystalline site, which was introduced in the previous article of the author. One complex is the $q$-analog of the higher de Rham complex constructed by Miyatani, and another complex is the $q$-analog of the jet complex constructed by Le Stum-Quir\'os. The complexes we constructed can also be regarded as the higher-level analogs of the $q$-de Rham complex.


title: Neural Collapse for Cross-entropy Class-Imbalanced Learning with Unconstrained ReLU Feature Model

abstract: The current paradigm of training deep neural networks for classification tasks includes minimizing the empirical risk that pushes the training loss value towards zero, even after the training error has been vanished. In this terminal phase of training, it has been observed that the last-layer features collapse to their class-means and these class-means converge to the vertices of a simplex Equiangular Tight Frame (ETF). This phenomenon is termed as Neural Collapse (NC). To theoretically understand this phenomenon, recent works employ a simplified unconstrained feature model to prove that NC emerges at the global solutions of the training problem. However, when the training dataset is class-imbalanced, some NC properties will no longer be true. For example, the class-means geometry will skew away from the simplex ETF when the loss converges. In this paper, we generalize NC to imbalanced regime for cross-entropy loss under the unconstrained ReLU feature model. We prove that, while the within-class features collapse property still holds in this setting, the class-means will converge to a structure consisting of orthogonal vectors with different lengths. Furthermore, we find that the classifier weights are aligned to the scaled and centered class-means with scaling factors depend on the number of training samples of each class, which generalizes NC in the class-balanced setting. We empirically prove our results through experiments on practical architectures and dataset.


title: Seamless Digital Engineering: A Grand Challenge Driven by Needs

abstract: Digital Engineering currently relies on costly and often bespoke integration of disparate software products to assemble the authoritative source of truth of the system-of-interest. Tools not originally designed to work together become an acknowledged system-of-systems, with their own separate feature roadmaps, deprecation, and support timelines. The resulting brittleness and conglomeration of disparate interfaces in the Digital Engineering Ecosystem of an organization drains resources and impairs efficiency and efficacy. If Model-Based Systems Engineering were applied to this problem, a complete system architecture model would be defined, and a purpose-built computing system-of-systems would be constructed to satisfy stakeholder needs. We have decades of research in computer science, cybersecurity, software and systems engineering, and human-computer interaction from which to draw that informs the design of a Seamless Digital Engineering tooling system, but it would require starting from a clean slate while carefully adopting existing standards. In this paper, this problem space and solution space are characterized, defining and identifying Seamless Digital Engineering as a grand challenge in Digital Engineering research.


title: Noncompact $n$-dimensional Einstein spaces as attractors for the Einstein flow

abstract: We prove that along with the Einstein flow, any small perturbations of an $n(n \geq 4)$-dimensional, non-compact negative Einstein space with some "non-positive Weyl tensor" lead to a unique and global solution, and the solution will be attracted to a noncompact Einstein space that is close to the background one. The $n=3$ case has been addressed in [30], while in dimension $n \geq 4$, as we know, negative Einstein metrics in general have non-trivial moduli spaces. This fact is reflected on the structure of Einstein equations, which further indicates no decay for the spatial Weyl tensor. Furthermore, it is suggested in the proof that the mechanic preventing the metric from flowing back to the original Einstein metric lies in the non-decaying character of spatial Weyl tensor. In contrary to the compact case considered in Andersson-Moncrief [4], our proof is independent of the theory of infinitesimal Einstein deformations. Instead, we take advantage of the inherent geometric structures of Einstein equations and develop an approach of energy estimates for a hyperbolic system of Maxwell type.


title: Controlling the occurrence sequence of reaction modules through biochemical relaxation oscillators

abstract: Embedding sequential computations in biochemical environments is challenging because the computations are carried out by chemical reactions, which are inherently disordered. In this paper we apply modular design to specific calculations through chemical reactions and provide a design scheme of biochemical oscillator models in order to generate periodical species for the order regulation of these reaction modules. We take the case of arbitrary multi-module regulation into consideration, analyze the main errors in the regulation process under \textit{mass-action kinetics} and demonstrate our design scheme under existing synthetic biochemical oscillator models.


title: U-Trustworthy Models.Reliability, Competence, and Confidence in Decision-Making

abstract: With growing concerns regarding bias and discrimination in predictive models, the AI community has increasingly focused on assessing AI system trustworthiness. Conventionally, trustworthy AI literature relies on the probabilistic framework and calibration as prerequisites for trustworthiness. In this work, we depart from this viewpoint by proposing a novel trust framework inspired by the philosophy literature on trust. We present a precise mathematical definition of trustworthiness, termed $\mathcal{U}$-trustworthiness, specifically tailored for a subset of tasks aimed at maximizing a utility function. We argue that a model's $\mathcal{U}$-trustworthiness is contingent upon its ability to maximize Bayes utility within this task subset. Our first set of results challenges the probabilistic framework by demonstrating its potential to favor less trustworthy models and introduce the risk of misleading trustworthiness assessments. Within the context of $\mathcal{U}$-trustworthiness, we prove that properly-ranked models are inherently $\mathcal{U}$-trustworthy. Furthermore, we advocate for the adoption of the AUC metric as the preferred measure of trustworthiness. By offering both theoretical guarantees and experimental validation, AUC enables robust evaluation of trustworthiness, thereby enhancing model selection and hyperparameter tuning to yield more trustworthy outcomes.