title: Ultrafast (10 GHz) mid-IR modulator based on ultra-fast electrical switching of the light-matter coupling

abstract: We demonstrate a free-space amplitude modulator for mid-infrared radiation (lambda=9.6 um) that operates at room temperature up to at least 20 GHz (above the -3dB cutoff frequency measured at 8.2 GHz). The device relies on the ultra-fast transition between weak and strong-coupling regimes induced by the variation of the applied bias voltage. Such transition induces a modulation of the device reflectivity. It is made of a semiconductor heterostructure enclosed in a judiciously designed array of metal-metal optical resonators, that - all-together - behave as an electrically tunable surface. At negative bias, it operates in the weak light-matter coupling regime. Upon application of an appropriate positive bias, the quantum wells populate with electrons and the device transitions to the strong-coupling regime. The modulator transmission keeps linear with input RF power in the 0dBm - 9dBm range. The increase of optical powers up to 25 mW exhibit a weak beginning saturation a little bit below.


title: Towards full instanton trans-series in Hofstadter's butterfly

abstract: The trans-series completion of perturbative series of a wide class of quantum mechanical systems can be determined by combining the resurgence program and extra input coming from exact WKB analysis. In this paper, we reexamine the Harper-Hofstadter model and its spectrum, Hofstadter's butterfly, in light of recent developments. We demonstrate the connection between the perturbative energy series of the Harper-Hofstadter model and the vev of $1/2$-BPS Wilson loop of 5d SYM and clarify the differences between their non-perturbative corrections. Taking insights from the cosine potential model, we construct the full energy trans-series for flux $\phi=2\pi/Q$ and provide numerical evidence with remarkably high precision. Finally, we revisit the problem of self-similarity of the butterfly and discuss the possibility of a completed version of the Rammal-Wilkinson formula.

categories: hep-th cond-mat.mes-hall math-ph math.MP


title: CompassDB: Pioneering High-Performance Key-Value Store with Perfect Hash

abstract: Modern mainstream persistent key-value storage engines utilize Log-Structured Merge tree (LSM-tree) based designs, optimizing read/write performance by leveraging sequential disk I/O. However, the advent of SSDs, with their significant improvements in bandwidth and IOPS, shifts the bottleneck from I/O to CPU. The high compaction cost and large read/write amplification associated with LSM trees have become critical bottlenecks. In this paper, we introduce CompassDB, which utilizes a Two-tier Perfect Hash Table (TPH) design to significantly decrease read/write amplification and compaction costs. CompassDB utilizes a perfect hash algorithm for its in-memory index, resulting in an average index cost of about 6 bytes per key-value pair. This compact index reduces the lookup time complexity from $O(log N)$ to $O(1)$ and decreases the overall cost. Consequently, it allows for the storage of more key-value pairs for reads or provides additional memory for the memtable for writes. This results in substantial improvements in both throughput and latency. Our evaluation using the YCSB benchmark tool shows that CompassDB increases throughput by 2.5x to 4x compared to RocksDB, and by 5x to 17x compared to PebblesDB across six typical workloads. Additionally, CompassDB significantly reduces average and 99th percentile read/write latency, achieving a 50% to 85% reduction in comparison to RocksDB.


title: Natural Language but Omitted? On the Ineffectiveness of Large Language Models' privacy policy from End-users' Perspective

abstract: LLMs driven products were increasingly prevalent in our daily lives, With a natural language based interaction style, people may potentially leak their personal private information. Thus, privacy policy and user agreement played an important role in regulating and alerting people. However, there lacked the work examining the reading of LLM's privacy policy. Thus, we conducted the first user study to let participants read the privacy policy and user agreement with two different styles (a cursory and detailed style). We found users lack important information upon cursory reading and even detailed reading. Besides, their privacy concerns was not solved even upon detailed reading. We provided four design implications based on the findings.


title: Cauchy matrix approach to novel extended semi-discrete KP-type systems

abstract: Two novel extended semi-discrete KP-type systems, namely partial differential-difference systems with one continuous and two discrete variables, are investigated. Introducing an arbitrary function into the Cauchy matrix function or the plane wave factor allows the implementation of extended integrable systems within the Cauchy matrix approach. We introduce the bilinear D\delta2KP system, the extended D\delta2pKP, D\delta2pmKP, and D\delta2SKP systems, all of which are based on the Cauchy matrix approach. This results in a diversity of solutions for these extended systems as contrasted to the usual multiple soliton solutions.


title: A Lung Nodule Dataset with Histopathology-based Cancer Type Annotation

abstract: Recently, Computer-Aided Diagnosis (CAD) systems have emerged as indispensable tools in clinical diagnostic workflows, significantly alleviating the burden on radiologists. Nevertheless, despite their integration into clinical settings, CAD systems encounter limitations. Specifically, while CAD systems can achieve high performance in the detection of lung nodules, they face challenges in accurately predicting multiple cancer types. This limitation can be attributed to the scarcity of publicly available datasets annotated with expert-level cancer type information. This research aims to bridge this gap by providing publicly accessible datasets and reliable tools for medical diagnosis, facilitating a finer categorization of different types of lung diseases so as to offer precise treatment recommendations. To achieve this objective, we curated a diverse dataset of lung Computed Tomography (CT) images, comprising 330 annotated nodules (nodules are labeled as bounding boxes) from 95 distinct patients. The quality of the dataset was evaluated using a variety of classical classification and detection models, and these promising results demonstrate that the dataset has a feasible application and further facilitate intelligent auxiliary diagnosis.


title: UVIT Survey of AGN host Galaxies -- I: Star Formation Scenarios

abstract: Circumnuclear star formation (SF) is generally seen in galaxies hosting active galactic nuclei (AGN); however, the connection between the AGN activity and SF in them is less well understood. To explore this connection on scales of a few tens of parsec to a few tens of kiloparsec and larger, we carried out an investigation of SF in seven Seyfert type AGN and one LINER galaxy, using observations with the Ultra-Violet Imaging Telescope (UVIT) on board {\it AstroSat} in the near ultra-Violet (NUV; 2000-3000 \AA) and far ultra-Violet (FUV; 2000-3000 \AA) bands. A total of 1742 star-forming regions were identified, having size scales of 0.010 to 63.642 kpc$^2$. Considering all the galaxies, we found a positive correlation between their total surface density of SF ($\Sigma_{SFR}$) and extinction. For five galaxies, namely NGC 1365, NGC 4051, NGC 4321, NGC 5033 and NGC 6814, we found a gradual decrease of both extinction and $\Sigma_{SFR}$ from the centre to the outer regions. Four sources are found to lie in the main sequence (MS) of star-forming galaxies, and the other four are away from MS. We found the ratio of the star formation rate (SFR) in the nuclear region to the total SFR to be positively correlated with the Eddington ratio. This points to the influence of AGN on enhancing the SF characteristics of the hosts. However, the impact is dominant only in the central nuclear region with no significant effect on the larger scales probed in this work.


title: Searching for the Signature of Fast Radio Burst by Swift/XRT X-ray Afterglow Light Curve

abstract: A new type of cosmological transient, dubbed fast radio bursts (FRBs), was recently discovered. The source of FRBs is still unknown. One possible scenario of an FRB is the collapse of a spinning supra-massive neutron star. Zhang (2014) suggests that the collapse can happen shortly (hundreds to thousands of seconds) after the birth of supra-massive neutron stars. The signatures can be visible in X-ray afterglows of long and short gamma-ray bursts (GRBs). For instance, a sudden drop (decay index steeper than -3 to -9) from a shallow decay (decay index shallower than -1) in the X-ray afterglow flux can indicate the event. We selected the X-ray afterglow light curves with a steep decay after the shallow decay phase from the Swift/XRT GRB catalog. We analyzed when the decay index changed suddenly by fitting these light curves to double power-law functions and compared it with the onset of FRBs. We found none of our GRB samples match the onset of FRBs.


title: Excitation energies from state-specific ensemble density functionals with density-driven correlations

abstract: We present an effective ensemble density functional approximation, which we call GX24 as it is suitable for both ground (G) and excited state (X) energy prediction. This functional is derived from first principles based on a novel approximation for density-driven correlations. We show that GX24 exploits recent advances in ensemble density functional theory to resolve major paradigmatic failures (double excitations, charge transfer) of standard time-dependent density functional approximations. It thus represents a major step toward accurate modelling of neutral and charged excitations in a unified fashion.


title: Unstability problem of real analytic maps

abstract: As well-known, the $C^\infty$ stability of proper $C^\infty$ maps is characterized by the infinitesimal $C^\infty$ stability. In the present paper we study the counterpart in real analytic context. In particular, we show that the infinitesimal $C^\omega$ stability does not imply $C^\omega$ stability; for instance, a Whitney umbrella $\mathbb{R}^2 \to \mathbb{R}^3$ is not $C^\omega$ stable. A main tool for the proof is a relative version of Whitney's Analytic Approximation Theorem which is shown by using H. Cartan's Theorems A and B.


title: Delay Infectivity and Delay Recovery SIR model

abstract: We have derived the governing equations for an SIR model with delay terms in both the infectivity and recovery of the disease. The equations are derived by modelling the dynamics as a continuous time random walk, where individuals move between the classic SIR compartments. With an appropriate choice of distributions for the infectivity and recovery processes delay terms are introduced into the governing equations in a manner that ensures the physicality of the model. This provides novel insight into the underlying dynamics of an SIR model with time delays. The SIR model with delay infectivity and recovery allows for a more diverse range of dynamical behaviours. The model accounts for an incubation effect without the need to introduce new compartments.


title: Token-Weighted RNN-T for Learning from Flawed Data

abstract: ASR models are commonly trained with the cross-entropy criterion to increase the probability of a target token sequence. While optimizing the probability of all tokens in the target sequence is sensible, one may want to de-emphasize tokens that reflect transcription errors. In this work, we propose a novel token-weighted RNN-T criterion that augments the RNN-T objective with token-specific weights. The new objective is used for mitigating accuracy loss from transcriptions errors in the training data, which naturally appear in two settings: pseudo-labeling and human annotation errors. Experiments results show that using our method for semi-supervised learning with pseudo-labels leads to a consistent accuracy improvement, up to 38% relative. We also analyze the accuracy degradation resulting from different levels of WER in the reference transcription, and show that token-weighted RNN-T is suitable for overcoming this degradation, recovering 64%-99% of the accuracy loss.


title: Composing Distributed Computations Through Task and Kernel Fusion

abstract: We introduce Diffuse, a system that dynamically performs task and kernel fusion in distributed, task-based runtime systems. The key component of Diffuse is an intermediate representation of distributed computation that enables the necessary analyses for the fusion of distributed tasks to be performed in a scalable manner. We pair task fusion with a JIT compiler to fuse together the kernels within fused tasks. We show empirically that Diffuse's intermediate representation is general enough to be a target for two real-world, task-based libraries (cuNumeric and Legate Sparse), letting Diffuse find optimization opportunities across function and library boundaries. Diffuse accelerates unmodified applications developed by composing task-based libraries by 1.86x on average (geo-mean), and by between 0.93x--10.7x on up to 128 GPUs. Diffuse also finds optimization opportunities missed by the original application developers, enabling high-level Python programs to match or exceed the performance of an explicitly parallel MPI library.


title: The aspherical explosions of the 03fg-like Type Ia supernovae 2021zny and 2022ilv revealed by polarimetry

abstract: A peculiar subtype of Type Ia supernovae (SNe), 03fg-like (super-Chandrasekhar) SNe, show different observational properties from prototypical Type Ia SNe, typically having high luminosity at the light-curve peak, low expansion velocities, and strong carbon features. The origin of this class of Type Ia SNe has been actively debated. Recent nebular-phase infrared observations of the 03fg-like Type Ia SN 2022pul using the James Webb Space Telescope revealed large-scale asymmetries in the ejecta and the presence of the strong [Ne II] line at 12.81 $\mu$m, suggesting a violent merger of two white dwarfs as its origin. Polarimetry is another powerful tool to study overall ejecta asymmetries of spatially-unresolved SNe. Here, we aim to check the universality of the violent merger scenario as the origin of the 03fg-like Type Ia SNe, by studying their explosion geometries using polarimetry. In this letter, we present imaging-polarimetric observations of the two 03fg-like Type Ia SNe 2021zny and 2022ilv. SNe 2021zny and 2022ilv show high intrinsic polarization ($\sim1$ % -$\sim2$ %), which might be composed of multiple components with different polarization angles. This indicates that they have complex aspherical structures in their ejecta, supporting the violent merger scenario for their origin. Our observations provide the first clear evidence from polarimetry for such aspherical structures.


title: Automatic Tracing in Task-Based Runtime Systems

abstract: Implicitly parallel task-based runtime systems often perform dynamic analysis to discover dependencies in and extract parallelism from sequential programs. Dependence analysis becomes expensive as task granularity drops below a threshold. Tracing techniques have been developed where programmers annotate repeated program fragments (traces) issued by the application, and the runtime system memoizes the dependence analysis for those fragments, greatly reducing overhead when the fragments are executed again. However, manual trace annotation can be brittle and not easily applicable to complex programs built through the composition of independent components. We introduce Apophenia, a system that automatically traces the dependence analysis of task-based runtime systems, removing the burden of manual annotations from programmers and enabling new and complex programs to be traced. Apophenia identifies traces dynamically through a series of dynamic string analyses, which find repeated program fragments in the stream of tasks issued to the runtime system. We show that Apophenia is able to come between 0.92x--1.03x the performance of manually traced programs, and is able to effectively trace previously untraced programs to yield speedups of between 0.91x--2.82x on the Perlmutter and Eos supercomputers.


title: In Situ In Transit Hybrid Analysis with Catalyst-ADIOS2

abstract: In this short paper, we present an innovative approach to limit the required bandwidth when transferring data during in transit analysis. This approach is called hybrid because it combines existing in situ and in transit solutions. It leverages the stable ABI of Catalyst version 2 and the Catalyst-ADIOS2 implementation to seamlessly switch from in situ, in transit and hybrid analysis without modifying the numerical simulation code. The typical use case is to perform data reduction in situ then generate a visualization in transit on the reduced data. This approach makes the numerical simulation workflows very flexible depending on the size of the data, the available computing resources or the analysis type. Our experiment with this hybrid approach, reducing data before sending it, demonstrated large cost reductions for some visualization pipelines compared to in situ and in transit solutions. The implementation is available under an open source permissive license to be usable broadly in any scientific community.


title: The Surprising Effectiveness of Multimodal Large Language Models for Video Moment Retrieval

abstract: Recent studies have shown promising results in utilizing multimodal large language models (MLLMs) for computer vision tasks such as object detection and semantic segmentation. However, many challenging video tasks remain under-explored. Video-language tasks necessitate spatial and temporal comprehension and require significant compute. Therefore, prior works have developed complex, highly specialized architectures or leveraged additional input signals such as video transcripts to best encode contextual and temporal information, which limits their generality and can be impractical. One particularly challenging task is video moment retrieval, which requires precise temporal and contextual grounding. This work demonstrates the surprising effectiveness of leveraging image-text pretrained MLLMs for moment retrieval. We introduce Mr. BLIP (Mr. as in Moment Retrieval), a multimodal, single-stage model that requires no expensive video-language pretraining, no additional input signal (e.g., no transcript or audio), and has a simpler and more versatile design than prior state-of-the-art methods. We achieve a new state-of-the-art in moment retrieval on the widely used benchmarks Charades-STA, QVHighlights, and ActivityNet Captions and illustrate our method's versatility with a new state-of-the-art in temporal action localization on ActivityNet. Notably, we attain over 9% (absolute) higher Recall (at 0.5 and 0.7 IoU) on the challenging long-video multi-moment QVHighlights benchmark. Our code is publicly available.


title: Knowledge Graph Enhanced Retrieval-Augmented Generation for Failure Mode and Effects Analysis

abstract: Failure mode and effects analysis (FMEA) is a critical tool for mitigating potential failures, particular during ramp-up phases of new products. However, its effectiveness is often limited by the missing reasoning capabilities of the FMEA tools, which are usually tabular structured. Meanwhile, large language models (LLMs) offer novel prospects for fine-tuning on custom datasets for reasoning within FMEA contexts. However, LLMs face challenges in tasks that require factual knowledge, a gap that retrieval-augmented generation (RAG) approaches aim to fill. RAG retrieves information from a non-parametric data store and uses a language model to generate responses. Building on this idea, we propose to advance the non-parametric data store with a knowledge graph (KG). By enhancing the RAG framework with a KG, our objective is to leverage analytical and semantic question-answering capabilities on FMEA data. This paper contributes by presenting a new ontology for FMEA observations, an algorithm for creating vector embeddings from the FMEA KG, and a KG enhanced RAG framework. Our approach is validated through a human study and we measure the performance of the context retrieval recall and precision.


title: Open-vocabulary Mobile Manipulation in Unseen Dynamic Environments with 3D Semantic Maps

abstract: Open-Vocabulary Mobile Manipulation (OVMM) is a crucial capability for autonomous robots, especially when faced with the challenges posed by unknown and dynamic environments. This task requires robots to explore and build a semantic understanding of their surroundings, generate feasible plans to achieve manipulation goals, adapt to environmental changes, and comprehend natural language instructions from humans. To address these challenges, we propose a novel framework that leverages the zero-shot detection and grounded recognition capabilities of pretraining visual-language models (VLMs) combined with dense 3D entity reconstruction to build 3D semantic maps. Additionally, we utilize large language models (LLMs) for spatial region abstraction and online planning, incorporating human instructions and spatial semantic context. We have built a 10-DoF mobile manipulation robotic platform JSR-1 and demonstrated in real-world robot experiments that our proposed framework can effectively capture spatial semantics and process natural language user instructions for zero-shot OVMM tasks under dynamic environment settings, with an overall navigation and task success rate of 80.95% and 73.33% over 105 episodes, and better SFT and SPL by 157.18% and 19.53% respectively compared to the baseline. Furthermore, the framework is capable of replanning towards the next most probable candidate location based on the spatial semantic context derived from the 3D semantic map when initial plans fail, keeping an average success rate of 76.67%.


title: BADGE: BADminton report Generation and Evaluation with LLM

abstract: Badminton enjoys widespread popularity, and reports on matches generally include details such as player names, game scores, and ball types, providing audiences with a comprehensive view of the games. However, writing these reports can be a time-consuming task. This challenge led us to explore whether a Large Language Model (LLM) could automate the generation and evaluation of badminton reports. We introduce a novel framework named BADGE, designed for this purpose using LLM. Our method consists of two main phases: Report Generation and Report Evaluation. Initially, badminton-related data is processed by the LLM, which then generates a detailed report of the match. We tested different Input Data Types, In-Context Learning (ICL), and LLM, finding that GPT-4 performs best when using CSV data type and the Chain of Thought prompting. Following report generation, the LLM evaluates and scores the reports to assess their quality. Our comparisons between the scores evaluated by GPT-4 and human judges show a tendency to prefer GPT-4 generated reports. Since the application of LLM in badminton reporting remains largely unexplored, our research serves as a foundational step for future advancements in this area. Moreover, our method can be extended to other sports games, thereby enhancing sports promotion. For more details, please refer to https://github.com/AndyChiangSH/BADGE.


title: Resilient and Secure Programmable System-on-Chip Accelerator Offload

abstract: Computational offload to hardware accelerators is gaining traction due to increasing computational demands and efficiency challenges. Programmable hardware, like FPGAs, offers a promising platform in rapidly evolving application areas, with the benefits of hardware acceleration and software programmability. Unfortunately, such systems composed of multiple hardware components must consider integrity in the case of malicious components. In this work, we propose Samsara, the first secure and resilient platform that derives, from Byzantine Fault Tolerant (BFT), protocols to enhance the computing resilience of programmable hardware. Samsara uses a novel lightweight hardware-based BFT protocol for Systems-on-Chip, called H-Quorum, that implements the theoretical-minimum latency between applications and replicated compute nodes. To withstand malicious behaviors, Samsara supports hardware rejuvenation, which is used to replace, relocate, or diversify faulty compute nodes. Samsara's architecture ensures the security of the entire workflow while keeping the latency overhead, of both computation and rejuvenation, close to the non-replicated counterpart.


title: SafeAligner: Safety Alignment against Jailbreak Attacks via Response Disparity Guidance

abstract: As the development of large language models (LLMs) rapidly advances, securing these models effectively without compromising their utility has become a pivotal area of research. However, current defense strategies against jailbreak attacks (i.e., efforts to bypass security protocols) often suffer from limited adaptability, restricted general capability, and high cost. To address these challenges, we introduce SafeAligner, a methodology implemented at the decoding stage to fortify defenses against jailbreak attacks. We begin by developing two specialized models: the Sentinel Model, which is trained to foster safety, and the Intruder Model, designed to generate riskier responses. SafeAligner leverages the disparity in security levels between the responses from these models to differentiate between harmful and beneficial tokens, effectively guiding the safety alignment by altering the output token distribution of the target model. Extensive experiments show that SafeAligner can increase the likelihood of beneficial tokens, while reducing the occurrence of harmful ones, thereby ensuring secure alignment with minimal loss to generality.


title: Robust personnel rostering: how accurate should absenteeism predictions be?

abstract: Disruptions to personnel rosters caused by absenteeism often necessitate last-minute adjustments to the employees' working hours. A common strategy to mitigate the impact of such changes is to assign employees to reserve shifts: special on-call duties during which an employee can be called in to cover for an absent employee. To maximize roster robustness, we assume a predict-then-optimize approach that uses absence predictions from a machine learning model to schedule an adequate number of reserve shifts. In this paper we propose a methodology to evaluate the robustness of rosters generated by the predict-then-optimize approach, assuming the machine learning model will make predictions at a predetermined prediction performance level. Instead of training and testing machine learning models, our methodology simulates the predictions based on a characterization of model performance. We show how this methodology can be applied to identify the minimum performance level needed for the model to outperform simple non-data-driven robust rostering policies. In a computational study on a nurse rostering problem, we demonstrate how the predict-then-optimize approach outperforms non-data-driven policies under reasonable performance requirements, particularly when employees possess interchangeable skills.


title: ArzEn-LLM: Code-Switched Egyptian Arabic-English Translation and Speech Recognition Using LLMs

abstract: Motivated by the widespread increase in the phenomenon of code-switching between Egyptian Arabic and English in recent times, this paper explores the intricacies of machine translation (MT) and automatic speech recognition (ASR) systems, focusing on translating code-switched Egyptian Arabic-English to either English or Egyptian Arabic. Our goal is to present the methodologies employed in developing these systems, utilizing large language models such as LLama and Gemma. In the field of ASR, we explore the utilization of the Whisper model for code-switched Egyptian Arabic recognition, detailing our experimental procedures including data preprocessing and training techniques. Through the implementation of a consecutive speech-to-text translation system that integrates ASR with MT, we aim to overcome challenges posed by limited resources and the unique characteristics of the Egyptian Arabic dialect. Evaluation against established metrics showcases promising results, with our methodologies yielding a significant improvement of $56\%$ in English translation over the state-of-the-art and $9.3\%$ in Arabic translation. Since code-switching is deeply inherent in spoken languages, it is crucial that ASR systems can effectively handle this phenomenon. This capability is crucial for enabling seamless interaction in various domains, including business negotiations, cultural exchanges, and academic discourse. Our models and code are available as open-source resources. Code: \url{http://github.com/ahmedheakl/arazn-llm}}, Models: \url{http://huggingface.co/collections/ahmedheakl/arazn-llm-662ceaf12777656607b9524e}.


title: The Merton's Default Risk Model for Public Company

abstract: In this paper, we developed the Merton's structural model for public companies under an assumption that liabilities of the companies are observed. Using Campbell and Shiller's approximation method, we obtain formulas of risk-neutral equity and liability values and default probabilities for the public companies. Also, the paper provides ML estimators of suggested model's parameters.


title: Poisoned LangChain: Jailbreak LLMs by LangChain

abstract: With the development of natural language processing (NLP), large language models (LLMs) are becoming increasingly popular. LLMs are integrating more into everyday life, raising public concerns about their security vulnerabilities. Consequently, the security of large language models is becoming critically important. Currently, the techniques for attacking and defending against LLMs are continuously evolving. One significant method type of attack is the jailbreak attack, which designed to evade model safety mechanisms and induce the generation of inappropriate content. Existing jailbreak attacks primarily rely on crafting inducement prompts for direct jailbreaks, which are less effective against large models with robust filtering and high comprehension abilities. Given the increasing demand for real-time capabilities in large language models, real-time updates and iterations of new knowledge have become essential. Retrieval-Augmented Generation (RAG), an advanced technique to compensate for the model's lack of new knowledge, is gradually becoming mainstream. As RAG enables the model to utilize external knowledge bases, it provides a new avenue for jailbreak attacks. In this paper, we conduct the first work to propose the concept of indirect jailbreak and achieve Retrieval-Augmented Generation via LangChain. Building on this, we further design a novel method of indirect jailbreak attack, termed Poisoned-LangChain (PLC), which leverages a poisoned external knowledge base to interact with large language models, thereby causing the large models to generate malicious non-compliant dialogues.We tested this method on six different large language models across three major categories of jailbreak issues. The experiments demonstrate that PLC successfully implemented indirect jailbreak attacks under three different scenarios, achieving success rates of 88.56%, 79.04%, and 82.69% respectively.


title: Is the logistical engagement of stakeholders in short food chains a crucible of alternativity?

abstract: In response to the negative environmental, social, and economic externalities of the dominant food model, a consensus is emerging on the need to develop alternative food systems capable of facilitating a transition to a more sustainable model. Among these alternatives, short food supply chains (SFSCs) are identified as potential crucibles of alternativity. Defined as distribution channels with a maximum of one intermediary between producer and consumer, SFSCs can contribute to the reterritorialization of food flows and the creation of relational and geographical proximities among food chain actors. This study examines how logistical engagement translates into the choice of SFSC points of sale by consumers and farmers. It evaluates this engagement through the travel times farmers and consumers are willing to endure to sell or buy at an SFSC point of sale, and the prices they are willing to accept or pay for SFSC products. A discrete choice experiment conducted in 2022 with 154 farm managers and 1022 consumers analyzed preferences regarding types of points of sale, sales prices, travel times, and relational proximity. The results show that consumers engaged in SFSCs favour alternative points of sale such as farms and associations, even for longer travel times. Farmers also value these points of sale, with logistical engagement more pronounced among those already marketing through SFSCs. Supermarkets appear less attractive to alternative profiles but serve as entry points for new participants in SFSCs. Relational proximity between farmers and consumers is important, with a preference for direct exchanges during sales. This study highlights the importance of actor engagement in SFSCs and offers perspectives for developing alternative logistics by valuing relational proximity and using conventional points of sale as entry points for new actors in the SFSCs.


title: A Potential Second Shutoff from AT2018fyk: An updated Orbital Ephemeris of the Surviving Star under the Repeating Partial Tidal Disruption Event Paradigm

abstract: The tidal disruption event (TDE) AT2018dyk/ASASSN-18UL showed a rapid dimming event 500 days after discovery, followed by a re-brightening roughly 700 days later. It has been hypothesized that this behavior results from a repeating partial TDE (rpTDE), such that prompt dimmings/shutoffs are coincident with the return of the star to pericenter and rebrightenings generated by the renewed supply of tidally stripped debris. This model predicted that the emission should shut off again around August of 2023. We report AT2018fyk's continued X-ray and UV monitoring, which shows an X-ray (UV) drop in flux by a factor of 10 (5) over a span of two months, starting 14 Aug 2023. This sudden change can be interpreted as the second emission shutoff, which 1) strengthens the rpTDE scenario for AT2018fyk, 2) allows us to constrain the orbital period to a more precise value of 1306$\pm$47 days, and 3) establishes that X-ray and UV/optical emission track the fallback rate onto this SMBH -- an often-made assumption that otherwise lacks observational verification -- and therefore the UV/optical lightcurve is powered predominantly by processes tied to X-rays. The second cutoff implies that another rebrightening should happen between May-Aug 2025, and if the star survived the second encounter, a third shutoff is predicted to occur between Jan-July 2027. Finally, low-level accretion from the less bound debris tail (which is completely unbound/does not contribute to accretion in a non-repeating TDE) can result in a faint X-ray plateau that could be detectable until the next rebrightening.


title: ResumeAtlas: Revisiting Resume Classification with Large-Scale Datasets and Large Language Models

abstract: The increasing reliance on online recruitment platforms coupled with the adoption of AI technologies has highlighted the critical need for efficient resume classification methods. However, challenges such as small datasets, lack of standardized resume templates, and privacy concerns hinder the accuracy and effectiveness of existing classification models. In this work, we address these challenges by presenting a comprehensive approach to resume classification. We curated a large-scale dataset of 13,389 resumes from diverse sources and employed Large Language Models (LLMs) such as BERT and Gemma1.1 2B for classification. Our results demonstrate significant improvements over traditional machine learning approaches, with our best model achieving a top-1 accuracy of 92\% and a top-5 accuracy of 97.5\%. These findings underscore the importance of dataset quality and advanced model architectures in enhancing the accuracy and robustness of resume classification systems, thus advancing the field of online recruitment practices.


title: Graphical Conditions ensuring Equality between Differential and Mean Stochastic Dynamics

abstract: Complex systems can be advantageously modeled by formal reaction systems (RS), a.k.a. chemical reaction networks in chemistry. Reaction-based models can indeed be interpreted in a hierarchy of semantics, depending on the question at hand, most notably by Ordinary Differential Equations (ODEs), Continuous Time Markov Chains (CTMCs), discrete Petri nets and asynchronous Boolean transition systems. The last three semantics can be easily related in the framework of abstract interpretation. The first two are classically related by Kurtz's limit theorem which states that if reactions are density-dependent families, then, as the volume goes to infinity, the mean reactant concentrations of the CTMC tends towards the solution of the ODE. In the more realistic context of bounded volumes, it is easy to show, by moment closure, that the restriction to reactions with at most one reactant ensures similarly that the mean of the CTMC trajectories is equal to the solution of the ODE at all time points. In this paper, we generalize that result in presence of polyreactant reactions, by introducing the Stoichiometric Influence and Modification Graph (SIMG) of an RS, and by showing that the equality between the two interpretations holds for the variables that belong to distinct SIMG ancestors of polyreactant reactions. We illustrate this approach with several examples. Evaluation on BioModels reveals that the condition for all variables is satisfied on models with no polymolecular reaction only. However, our theorem can be applied selectively to certain variables of the model to provide insights into their behaviour within more complex systems. Interestingly, we also show that the equality holds for a basic oscillatory RS implementing the sine and cosine functions of time.


title: Rapid Polymorphic Screening using Sessile Microdroplets: Competitive Nucleation of Mannitol Polymorphs

abstract: We developed a rapid polymorphic screening approach based on contracting sessile microdroplets which offers several advantages: (1) achieves very high supersaturation to facilitate formation of metastable forms (2) allows systematic labeling of samples (3) gives access to statistical distribution of polymorphic selectivity as a function of experimental conditions (4) ensures the formation of crystal for each droplet, addressing the problem of uncrystallized droplets in traditional microfluidics. We studied the competitive nucleation of D-mannitol polymorphs and investigated the effect of droplet volume on polymorphic selectivity. We showed that our observed polymorph distributions at different volumes are qualitatively consistent with the predictions of classical nucleation theory except for very small volumes where thermodynamic confinement or surface effects could play a substantial role. Overall, our microfluidic approach can be a promising tool not only for routine screening of pharmaceutical polymorphs in the industrial context but also in the fundamental understanding of the mechanisms underlying the competitive nucleation of polymorphs.


title: Stokes' paradox in rarefied gases: A perspective through the method of fundamental solutions

abstract: In the realm of fluid dynamics, a curious and counterintuitive phenomenon is Stokes' paradox. While Stokes equations -- used for modeling slow and steady flows -- lead to a meaningful solution to the problem of slow and steady flow past a sphere, they fail to yield a non-trivial solution to the problem of slow and steady flow past an infinitely long cylinder (a two-dimensional problem essentially); this is referred to as Stokes' paradox. We revisit this paradox in the context of rarefied gas flows by means of the method of fundamental solutions (MFS). To this end, we adopt an extended hydrodynamic model, referred to as the CCR model, consisting of the balance equations for the mass, momentum and energy and closed with the coupled constitutive relations. We determine an analytic solution of the CCR model for the problem and compare it with the MFS-based numerical solution. Apart from addressing flow past a circular cylinder, we aim to showcase the capability of the MFS to predict the flow past other objects in two dimensions for which the analytic solutions do not exist. For that, we investigate the problem of rarefied gas flow past an infinitely long semicircular cylinder.


title: CTS: Sim-to-Real Unsupervised Domain Adaptation on 3D Detection

abstract: Simulation data can be accurately labeled and have been expected to improve the performance of data-driven algorithms, including object detection. However, due to the various domain inconsistencies from simulation to reality (sim-to-real), cross-domain object detection algorithms usually suffer from dramatic performance drops. While numerous unsupervised domain adaptation (UDA) methods have been developed to address cross-domain tasks between real-world datasets, progress in sim-to-real remains limited. This paper presents a novel Complex-to-Simple (CTS) framework to transfer models from labeled simulation (source) to unlabeled reality (target) domains. Based on a two-stage detector, the novelty of this work is threefold: 1) developing fixed-size anchor heads and RoI augmentation to address size bias and feature diversity between two domains, thereby improving the quality of pseudo-label; 2) developing a novel corner-format representation of aleatoric uncertainty (AU) for the bounding box, to uniformly quantify pseudo-label quality; 3) developing a noise-aware mean teacher domain adaptation method based on AU, as well as object-level and frame-level sampling strategies, to migrate the impact of noisy labels. Experimental results demonstrate that our proposed approach significantly enhances the sim-to-real domain adaptation capability of 3D object detection models, outperforming state-of-the-art cross-domain algorithms, which are usually developed for real-to-real UDA tasks.


title: Designing Unit Ising Models for Logic Gate Simulation through Integer Linear Programming

abstract: An Ising model is defined by a quadratic objective function known as the Hamiltonian, composed of spin variables that can take values of either $-1$ or $+1$. The goal is to assign spin values to these variables in a way that minimizes the value of the Hamiltonian. Ising models are instrumental in tackling many combinatorial optimization problems, leading to significant research in developing solvers for them. Notably, D-Wave Systems has pioneered the creation of quantum annealers, programmable solvers based on quantum mechanics, for these models. This paper introduces unit Ising models, where all non-zero coefficients of linear and quadratic terms are either $-1$ or $+1$. Due to the limited resolution of quantum annealers, unit Ising models are more suitable for quantum annealers to find optimal solutions. We propose a novel design methodology for unit Ising models to simulate logic circuits computing Boolean functions through integer linear programming. By optimizing these Ising models with quantum annealers, we can compute Boolean functions and their inverses. With a fixed unit Ising model for a logic circuit, we can potentially design Application-Specific Unit Quantum Annealers (ASUQAs) for computing the inverse function, which is analogous to Application-Specific Integrated Circuits (ASICs) in digital circuitry. For instance, if we apply this technique to a multiplication circuit, we can design an ASUQA for factorization of two numbers. Our findings suggest a powerful new method for compromising the RSA cryptosystem by leveraging ASUQAs in factorization.


title: Sequential Disentanglement by Extracting Static Information From A Single Sequence Element

abstract: One of the fundamental representation learning tasks is unsupervised sequential disentanglement, where latent codes of inputs are decomposed to a single static factor and a sequence of dynamic factors. To extract this latent information, existing methods condition the static and dynamic codes on the entire input sequence. Unfortunately, these models often suffer from information leakage, i.e., the dynamic vectors encode both static and dynamic information, or vice versa, leading to a non-disentangled representation. Attempts to alleviate this problem via reducing the dynamic dimension and auxiliary loss terms gain only partial success. Instead, we propose a novel and simple architecture that mitigates information leakage by offering a simple and effective subtraction inductive bias while conditioning on a single sample. Remarkably, the resulting variational framework is simpler in terms of required loss terms, hyperparameters, and data augmentation. We evaluate our method on multiple data-modality benchmarks including general time series, video, and audio, and we show beyond state-of-the-art results on generation and prediction tasks in comparison to several strong baselines.


title: Outperforming the Best 1D Low-Discrepancy Constructions with a Greedy Algorithm

abstract: The design of uniformly spread sequences on $[0,1)$ has been extensively studied since the work of Weyl and van der Corput in the early $20^{\text{th}}$ century. The current best sequences are based on the Kronecker sequence with golden ratio and a permutation of the van der Corput sequence by Ostromoukhov. Despite extensive efforts, it is still unclear if it is possible to improve these constructions further. We show, using numerical experiments, that a radically different approach introduced by Kritzinger in seems to perform better than the existing methods. In particular, this construction is based on a \emph{greedy} approach, and yet outperforms very delicate number-theoretic constructions. Furthermore, we are also able to provide the first numerical results in dimensions 2 and 3, and show that the sequence remains highly regular in this new setting.


title: ConvoCache: Smart Re-Use of Chatbot Responses

abstract: We present ConvoCache, a conversational caching system that solves the problem of slow and expensive generative AI models in spoken chatbots. ConvoCache finds a semantically similar prompt in the past and reuses the response. In this paper we evaluate ConvoCache on the DailyDialog dataset. We find that ConvoCache can apply a UniEval coherence threshold of 90% and respond to 89% of prompts using the cache with an average latency of 214ms, replacing LLM and voice synthesis that can take over 1s. To further reduce latency we test prefetching and find limited usefulness. Prefetching with 80% of a request leads to a 63% hit rate, and a drop in overall coherence. ConvoCache can be used with any chatbot to reduce costs by reducing usage of generative AI by up to 89%.


title: Assessing "Implicit" Retrieval Robustness of Large Language Models

abstract: Retrieval-augmented generation has gained popularity as a framework to enhance large language models with external knowledge. However, its effectiveness hinges on the retrieval robustness of the model. If the model lacks retrieval robustness, its performance is constrained by the accuracy of the retriever, resulting in significant compromises when the retrieved context is irrelevant. In this paper, we evaluate the "implicit" retrieval robustness of various large language models, instructing them to directly output the final answer without explicitly judging the relevance of the retrieved context. Our findings reveal that fine-tuning on a mix of gold and distracting context significantly enhances the model's robustness to retrieval inaccuracies, while still maintaining its ability to extract correct answers when retrieval is accurate. This suggests that large language models can implicitly handle relevant or irrelevant retrieved context by learning solely from the supervision of the final answer in an end-to-end manner. Introducing an additional process for explicit relevance judgment can be unnecessary and disrupts the end-to-end approach.


title: Automatic Speech Recognition for Hindi

abstract: Automatic speech recognition (ASR) is a key area in computational linguistics, focusing on developing technologies that enable computers to convert spoken language into text. This field combines linguistics and machine learning. ASR models, which map speech audio to transcripts through supervised learning, require handling real and unrestricted text. Text-to-speech systems directly work with real text, while ASR systems rely on language models trained on large text corpora. High-quality transcribed data is essential for training predictive models. The research involved two main components: developing a web application and designing a web interface for speech recognition. The web application, created with JavaScript and Node.js, manages large volumes of audio files and their transcriptions, facilitating collaborative human correction of ASR transcripts. It operates in real-time using a client-server architecture. The web interface for speech recognition records 16 kHz mono audio from any device running the web app, performs voice activity detection (VAD), and sends the audio to the recognition engine. VAD detects human speech presence, aiding efficient speech processing and reducing unnecessary processing during non-speech intervals, thus saving computation and network bandwidth in VoIP applications. The final phase of the research tested a neural network for accurately aligning the speech signal to hidden Markov model (HMM) states. This included implementing a novel backpropagation method that utilizes prior statistics of node co-activations.


title: Observations of the Formation and Disappearance of a Funnel Prominence

abstract: We present an observational study of the formation and disappearance of a funnel prominence. Before the funnel prominence formed, cool materials from the top of a preexisting polar crown prominence flowed along saddle-shaped coronal loops to their base, forming a smaller prominence. Meanwhile, the saddle-shaped coronal loops gradually rose, and U-shaped coronal loops, termed prominence horns, began to appear along with a coronal cavity. Afterwards, a cool column emerged from the chromosphere, rose vertically into the corona, and then moved laterally to be transported into the U-shaped coronal loops. The formed prominence slid into the chromosphere, while the U-shaped coronal loops and the coronal cavity became more pronounced. As cool materials accumulated at the base of the U-shaped coronal loops, these loops underwent a significant descent and a V-shaped structure appeared at the base of the cool materials, indicating that the U-shaped coronal loops may be dragged down to sag. Subsequently, cool materials from the V-shaped structure continued to flow almost vertically toward the chromosphere, forming the funnel prominence. The vertical downflows might be produced by magnetic reconnection within or between the sagging field lines. Due to persistent vertical downflows, the U-shaped coronal loops were lifted up and prominence materials followed along inclined coronal loops towards the chromosphere, causing the funnel prominence to disappear. Our observations suggest that chromospheric plasma transported into a coronal cavity and then drained out via vertical downflows can form a funnel prominence.


title: Sparse deep neural networks for nonparametric estimation in high-dimensional sparse regression

abstract: Generalization theory has been established for sparse deep neural networks under high-dimensional regime. Beyond generalization, parameter estimation is also important since it is crucial for variable selection and interpretability of deep neural networks. Current theoretical studies concerning parameter estimation mainly focus on two-layer neural networks, which is due to the fact that the convergence of parameter estimation heavily relies on the regularity of the Hessian matrix, while the Hessian matrix of deep neural networks is highly singular. To avoid the unidentifiability of deep neural networks in parameter estimation, we propose to conduct nonparametric estimation of partial derivatives with respect to inputs. We first show that model convergence of sparse deep neural networks is guaranteed in that the sample complexity only grows with the logarithm of the number of parameters or the input dimension when the $\ell_{1}$-norm of parameters is well constrained. Then by bounding the norm and the divergence of partial derivatives, we establish that the convergence rate of nonparametric estimation of partial derivatives scales as $\mathcal{O}(n^{-1/4})$, a rate which is slower than the model convergence rate $\mathcal{O}(n^{-1/2})$. To the best of our knowledge, this study combines nonparametric estimation and parametric sparse deep neural networks for the first time. As nonparametric estimation of partial derivatives is of great significance for nonlinear variable selection, the current results show the promising future for the interpretability of deep neural networks.


title: B-TMS: Bayesian Traversable Terrain Modeling and Segmentation Across 3D LiDAR Scans and Maps for Enhanced Off-Road Navigation

abstract: Recognizing traversable terrain from 3D point cloud data is critical, as it directly impacts the performance of autonomous navigation in off-road environments. However, existing segmentation algorithms often struggle with challenges related to changes in data distribution, environmental specificity, and sensor variations. Moreover, when encountering sunken areas, their performance is frequently compromised, and they may even fail to recognize them. To address these challenges, we introduce B-TMS, a novel approach that performs map-wise terrain modeling and segmentation by utilizing Bayesian generalized kernel (BGK) within the graph structure known as the tri-grid field (TGF). Our experiments encompass various data distributions, ranging from single scans to partial maps, utilizing both public datasets representing urban scenes and off-road environments, and our own dataset acquired from extremely bumpy terrains. Our results demonstrate notable contributions, particularly in terms of robustness to data distribution variations, adaptability to diverse environmental conditions, and resilience against the challenges associated with parameter changes.


title: LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Inference

abstract: Long-context Multimodal Large Language Models (MLLMs) demand substantial computational resources for inference as the growth of their multimodal Key-Value (KV) cache, in response to increasing input lengths, challenges memory and time efficiency. Unlike single-modality LLMs that manage only textual contexts, the KV cache of long-context MLLMs includes representations from multiple images with temporal and spatial relationships and related textual contexts. The predominance of image tokens means traditional optimizations for LLMs' KV caches are unsuitable for multimodal long-context settings, and no prior works have addressed this challenge. In this work, we introduce LOOK-M, a pioneering, fine-tuning-free approach that efficiently reduces the multimodal KV cache size while maintaining performance comparable to a full cache. We observe that during prompt prefill, the model prioritizes more textual attention over image features, and based on the multimodal interaction observation, a new proposed text-prior method is explored to compress the KV cache. Furthermore, to mitigate the degradation of image contextual information, we propose several compensatory strategies using KV pairs merging. LOOK-M demonstrates that with a significant reduction in KV Cache memory usage, such as reducing it by 80% in some cases, it not only achieves up to 1.5x faster decoding but also maintains or even enhances performance across a variety of long context multimodal tasks.


title: Exclusive Style Removal for Cross Domain Novel Class Discovery

abstract: As a promising field in open-world learning, \textit{Novel Class Discovery} (NCD) is usually a task to cluster unseen novel classes in an unlabeled set based on the prior knowledge of labeled data within the same domain. However, the performance of existing NCD methods could be severely compromised when novel classes are sampled from a different distribution with the labeled ones. In this paper, we explore and establish the solvability of NCD in cross domain setting with the necessary condition that style information must be removed. Based on the theoretical analysis, we introduce an exclusive style removal module for extracting style information that is distinctive from the baseline features, thereby facilitating inference. Moreover, this module is easy to integrate with other NCD methods, acting as a plug-in to improve performance on novel classes with different distributions compared to the seen labeled set. Additionally, recognizing the non-negligible influence of different backbones and pre-training strategies on the performance of the NCD methods, we build a fair benchmark for future NCD research. Extensive experiments on three common datasets demonstrate the effectiveness of our proposed module.


title: Dispersion-induced $Q$-factor enhancement in waveguide-coupled surface lattice resonances

abstract: Diffractively coupled nanoparticle arrays are promising candidates for helping to flatten many photonic devices such as lasers, lenses, and metrology instruments. Their performance, however, is directly linked with the size of the metasurfaces, limiting their applicability in nanophotonic applications. Here, we dramatically reduce array sizes of high-$Q$-factor metasurfaces by utilizing strongly dispersive media. The effect is demonstrated by theoretically and numerically studying periodic arrays of plasmonic nanoparticles embedded inside Bragg-reflector waveguides. We demonstrate array dimensions reduction up to two orders of magnitude while still achieving ultra-high $Q$-factors in excess of 10$^4$.


title: Innovating for Tomorrow: The Convergence of SE and Green AI

abstract: The latest advancements in machine learning, specifically in foundation models, are revolutionizing the frontiers of existing software engineering (SE) processes. This is a bi-directional phenomona, where 1) software systems are now challenged to provide AI-enabled features to their users, and 2) AI is used to automate tasks within the software development lifecycle. In an era where sustainability is a pressing societal concern, our community needs to adopt a long-term plan enabling a conscious transformation that aligns with environmental sustainability values. In this paper, we reflect on the impact of adopting environmentally friendly practices to create AI-enabled software systems and make considerations on the environmental impact of using foundation models for software development.


title: Image-based wavefront correction using model-free Reinforcement Learning

abstract: Optical aberrations prevent telescopes from reaching their theoretical diffraction limit. Once estimated, these aberrations can be compensated for using deformable mirrors in a closed loop. Focal plane wavefront sensing enables the estimation of the aberrations on the complete optical path, directly from the images taken by the scientific sensor. However, current focal plane wavefront sensing methods rely on physical models whose inaccuracies may limit the overall performance of the correction. The aim of this study is to develop a data-driven method using model-free reinforcement learning to automatically perform the estimation and correction of the aberrations, using only phase diversity images acquired around the focal plane as inputs. We formulate the correction problem within the framework of reinforcement learning and train an agent on simulated data. We show that the method is able to reliably learn an efficient control strategy for various realistic conditions. Our method also demonstrates robustness to a wide range of noise levels.


title: Artificial Immune System of Secure Face Recognition Against Adversarial Attacks

abstract: Insect production for food and feed presents a promising supplement to ensure food safety and address the adverse impacts of agriculture on climate and environment in the future. However, optimisation is required for insect production to realise its full potential. This can be by targeted improvement of traits of interest through selective breeding, an approach which has so far been underexplored and underutilised in insect farming. Here we present a comprehensive review of the selective breeding framework in the context of insect production. We systematically evaluate adjustments of selective breeding techniques to the realm of insects and highlight the essential components integral to the breeding process. The discussion covers every step of a conventional breeding scheme, such as formulation of breeding objectives, phenotyping, estimation of genetic parameters and breeding values, selection of appropriate breeding strategies, and mitigation of issues associated with genetic diversity depletion and inbreeding. This review combines knowledge from diverse disciplines, bridging the gap between animal breeding, quantitative genetics, evolutionary biology, and entomology, offering an integrated view of the insect breeding research area and uniting knowledge which has previously remained scattered across diverse fields of expertise.


title: Beyond Statistical Estimation: Differentially Private Individual Computation in the Shuffle Model

abstract: The shuffle model of differential privacy (DP) has recently emerged as a powerful one for decentralized computation without fully trustable parties. Since it anonymizes and permutes messages from clients through a shuffler, the privacy can be amplified and utility can be improved. However, the shuffling procedure in turn restricts its applications only to statistical tasks that are permutation-invariant. This work explores the feasibility of shuffle privacy amplification for prevalent non-statistical computations: spatial crowdsourcing, combinatorial optimization, location-based social systems, and federated learning with incentives, which suffer either computationally intractability or intolerable utility loss in existing approaches (e.g., secure MPC and local DP). We proposes a new paradigm of shuffle model that can provide critical security functionalities like message authorization and result access control, meanwhile maintaining the most of privacy amplification effects. It incurs almost the same computation/communication costs as the non-private setting, and permits the server to run arbitrary algorithms on (noisy) client information in plaintext. Our novel technique is introducing statistically random identity into DP and force identical random distribution on all clients, so as to support secure functionalities even after message shuffling and to maintain privacy amplification simultaneously. Given that existing DP randomizers fails in the new shuffle model, we also propose a new mechanism and prove its optimality therein. Experimental results on spatial crowdsourcing, location-based social system, and federated learning with incentives, show that our paradigm and mechanism is fast as non-private settings, while reducing up to 90% error and increasing utility performance indicates by 100%-300% relatively, and can be practical under reasonable privacy budget.


title: A Refer-and-Ground Multimodal Large Language Model for Biomedicine

abstract: With the rapid development of multimodal large language models (MLLMs), especially their capabilities in visual chat through refer and ground functionalities, their significance is increasingly recognized. However, the biomedical field currently exhibits a substantial gap in this area, primarily due to the absence of a dedicated refer and ground dataset for biomedical images. To address this challenge, we devised the Med-GRIT-270k dataset. It comprises 270k question-and-answer pairs and spans eight distinct medical imaging modalities. Most importantly, it is the first dedicated to the biomedical domain and integrating refer and ground conversations. The key idea is to sample large-scale biomedical image-mask pairs from medical segmentation datasets and generate instruction datasets from text using chatGPT. Additionally, we introduce a Refer-and-Ground Multimodal Large Language Model for Biomedicine (BiRD) by using this dataset and multi-task instruction learning. Extensive experiments have corroborated the efficacy of the Med-GRIT-270k dataset and the multi-modal, fine-grained interactive capabilities of the BiRD model. This holds significant reference value for the exploration and development of intelligent biomedical assistants.


title: Correlation entropy of free semigroup actions

abstract: This paper introduces the concepts of correlation entropy and local correlation entropy for free semigroup actions on compact metric space, and explores their fundamental properties. Thereafter, we generalize some classical results on correlation entropy and local correlation entropy to apply to free semigroup actions. Finally, we establish the relationship between topological entropy, measure-theoretic entropy, correlation entropy, and local correlation entropy for free semigroup actions under various conditions.


title: Searching anomalies using nonlinear dimensionality reduction techniques

abstract: We have searched for anomalous events using 2,520 hours of archival observations from Murriyang, CSIRO's Parkes radio telescope. These observations were originally undertaken to search for pulsars. We used a machine learning algorithm based on ResNet and Uniform Manifold Approximation and Projection (UMAP) in order to identify parts of the data stream that potentially contain anomalous signals. Many of these anomalous events are radio frequency interference, which were subsequently filtered using multibeam information. We detected 202 anomalous events and provide their positions and event times. One of the events could potentially come from a white dwarf. Some of them may originate from stellar flares, lightning, or be true anomalies, which are currently of an unknown type.


title: A Jammer-Mitigating 267 Mb/s 3.78 mm$^2$ 583 mW 32$\times$8 Multi-User MIMO Receiver in 22FDX

abstract: We present the first multi-user (MU) multiple-input multiple-output (MIMO) receiver ASIC that mitigates jamming attacks. The ASIC implements a recent nonlinear algorithm that performs joint jammer mitigation (via spatial filtering) and data detection (using a box prior on the data symbols). Our design supports 8 user equipments (UEs) and 32 basestation (BS) antennas, QPSK and 16-QAM with soft-outputs, and enables the mitigation of single-antenna barrage jammers and smart jammers. The fabricated 22 nm FD-SOI ASIC includes preprocessing, has a core area of 3.78 mm$^2$, achieves a throughput of 267 Mb/s while consuming 583 mW, and is the only existing design that enables reliable data detection under jamming attacks.


title: Approximate formula for $Z(t)$

abstract: The series for the zeta function does not converge on the critical line but the function \[G(t)=\sum_{n=1}^\infty \frac{1}{n^{\frac12+it}}\frac{t}{2\pi n^2+t}\] satisfies $Z(t)=2\Re\{e^{i\vartheta(t)}G(t)\}+O(t^{-\frac56+\varepsilon})$. So one expects that the zeros of zeta on the critical line are very near the zeros of $\Re\{e^{i\vartheta(t)}G(t)\}$. There is a related function $U(t)$ that satisfies the equality $Z(t)=2\Re\{e^{i\vartheta(t)}U(t)\}$.


title: SynRS3D: A Synthetic Dataset for Global 3D Semantic Understanding from Monocular Remote Sensing Imagery

abstract: Global semantic 3D understanding from single-view high-resolution remote sensing (RS) imagery is crucial for Earth Observation (EO). However, this task faces significant challenges due to the high costs of annotations and data collection, as well as geographically restricted data availability. To address these challenges, synthetic data offer a promising solution by being easily accessible and thus enabling the provision of large and diverse datasets. We develop a specialized synthetic data generation pipeline for EO and introduce SynRS3D, the largest synthetic RS 3D dataset. SynRS3D comprises 69,667 high-resolution optical images that cover six different city styles worldwide and feature eight land cover types, precise height information, and building change masks. To further enhance its utility, we develop a novel multi-task unsupervised domain adaptation (UDA) method, RS3DAda, coupled with our synthetic dataset, which facilitates the RS-specific transition from synthetic to real scenarios for land cover mapping and height estimation tasks, ultimately enabling global monocular 3D semantic understanding based on synthetic data. Extensive experiments on various real-world datasets demonstrate the adaptability and effectiveness of our synthetic dataset and proposed RS3DAda method. SynRS3D and related codes will be available.


title: Intrinsic Action Tendency Consistency for Cooperative Multi-Agent Reinforcement Learning

abstract: Efficient collaboration in the centralized training with decentralized execution (CTDE) paradigm remains a challenge in cooperative multi-agent systems. We identify divergent action tendencies among agents as a significant obstacle to CTDE's training efficiency, requiring a large number of training samples to achieve a unified consensus on agents' policies. This divergence stems from the lack of adequate team consensus-related guidance signals during credit assignments in CTDE. To address this, we propose Intrinsic Action Tendency Consistency, a novel approach for cooperative multi-agent reinforcement learning. It integrates intrinsic rewards, obtained through an action model, into a reward-additive CTDE (RA-CTDE) framework. We formulate an action model that enables surrounding agents to predict the central agent's action tendency. Leveraging these predictions, we compute a cooperative intrinsic reward that encourages agents to match their actions with their neighbors' predictions. We establish the equivalence between RA-CTDE and CTDE through theoretical analyses, demonstrating that CTDE's training process can be achieved using agents' individual targets. Building on this insight, we introduce a novel method to combine intrinsic rewards and CTDE. Extensive experiments on challenging tasks in SMAC and GRF benchmarks showcase the improved performance of our method.


title: Strengthening of the superconductivity by real space decimation of the flat band states

abstract: In contrast to standard BCS superconductivity, that in flat bands (FBs) possesses an interesting degree of freedom that enables the control of the superfluid weight (SFW), referred to as the quantum metric (QM). In the present work, we consider the stub lattice and study the impact of the dilution of FB eigenstates on superconductivity. Among the most remarkable results, it is revealed that the SFW can be boosted by the decimation of the FB eigenstates. In addition, it is shown that the widely used uniform pairing hypothesis systematically predicts the suppression of the SFW, appears misleading and qualitatively incorrect. With the great progress in nanotechnologies, we believe that our findings could be realised and tested experimentally in covalent organic frameworks or in decorated structures in which defects/vacancies/ad-atoms are created/deposited in a controlled manner and even in multilayered structures with intercalated atoms.


title: Errors-In-Variables Model Fitting for Partially Unpaired Data Utilizing Mixture Models

abstract: The goal of this paper is to introduce a general argumentation framework for regression in the errors-in-variables regime, allowing for full flexibility about the dimensionality of the data, error probability density types, the (linear or nonlinear) model type and the avoidance of explicit definition of loss functions. Further, we introduce in this framework model fitting for partially unpaired data, i.e. for given data groups the pairing information of input and output is lost (semi-supervised). This is achieved by constructing mixture model densities, which directly model this loss of pairing information allowing for inference. In a numerical simulation study linear and nonlinear model fits are illustrated as well as a real data study is presented based on life expectancy data from the world bank utilizing a multiple linear regression model. These results allow the conclusion that high quality model fitting is possible with partially unpaired data, which opens the possibility for new applications with unfortunate or deliberate loss of pairing information in the data.


title: SuperGrad: a differentiable simulator for superconducting processors

abstract: One significant advantage of superconducting processors is their extensive design flexibility, which encompasses various types of qubits and interactions. Given the large number of tunable parameters of a processor, the ability to perform gradient optimization would be highly beneficial. Efficient backpropagation for gradient computation requires a tightly integrated software library, for which no open-source implementation is currently available. In this work, we introduce SuperGrad, a simulator that accelerates the design of superconducting quantum processors by incorporating gradient computation capabilities. SuperGrad offers a user-friendly interface for constructing Hamiltonians and computing both static and dynamic properties of composite systems. This differentiable simulation is valuable for a range of applications, including optimal control, design optimization, and experimental data fitting. In this paper, we demonstrate these applications through examples and code snippets.


title: FedAQ: Communication-Efficient Federated Edge Learning via Joint Uplink and Downlink Adaptive Quantization

abstract: Federated learning (FL) is a powerful machine learning paradigm which leverages the data as well as the computational resources of clients, while protecting clients' data privacy. However, the substantial model size and frequent aggregation between the server and clients result in significant communication overhead, making it challenging to deploy FL in resource-limited wireless networks. In this work, we aim to mitigate the communication overhead by using quantization. Previous research on quantization has primarily focused on the uplink communication, employing either fixed-bit quantization or adaptive quantization methods. In this work, we introduce a holistic approach by joint uplink and downlink adaptive quantization to reduce the communication overhead. In particular, we optimize the learning convergence by determining the optimal uplink and downlink quantization bit-length, with a communication energy constraint. Theoretical analysis shows that the optimal quantization levels depend on the range of model gradients or weights. Based on this insight, we propose a decreasing-trend quantization for the uplink and an increasing-trend quantization for the downlink, which aligns with the change of the model parameters during the training process. Experimental results show that, the proposed joint uplink and downlink adaptive quantization strategy can save up to 66.7% energy compared with the existing schemes.


title: Photosensitive PEEK Ink Enables Digital Light Processing 3D Printed High-performance Small Architected-Plastics

abstract: Polyetheretherketone (PEEK), as a semi-crystalline high-performance engineering plastic, has demonstrated good application prospects since its introduction. The ability of PEEK to be fabricated in complex architecture is a major limitation due to the inherent shortcomings of material extrusion 3D printing technology in terms of low resolution, low surface quality, and interlayer bonding. We propose a novel PEEK ink processing process based on digital light processing (DLP) 3D printing, which is based on high solid content PEEK ink to achieve green bodies with high accuracy, and one-step sintering to enhance the crystallinity of PEEK. We have investigated the processing mechanism of this process and constructed perfect process parameters in terms of mouldability, printing accuracy, material thermal properties, and PEEK crystallinity. Furthermore, the material and architecture performance of the proposed process was evaluated in terms of comprehensive thermal performance (including heat resistance of the substrate, thermal stability, surface energy after heat treatment, and coefficient of static friction and coefficient of kinetic friction), mechanical performance, and corrosion resistance (20 wt% hydrochloric acid, 20 wt% sodium hydroxide, 99 wt% acetone, and 99.5 wt% chloroform). The process is a bold extension of PEEK processing methods to utilize the properties of PEEK in more flexible and efficient applications.


title: 3D-MVP: 3D Multiview Pretraining for Robotic Manipulation

abstract: Recent works have shown that visual pretraining on egocentric datasets using masked autoencoders (MAE) can improve generalization for downstream robotics tasks. However, these approaches pretrain only on 2D images, while many robotics applications require 3D scene understanding. In this work, we propose 3D-MVP, a novel approach for 3D multi-view pretraining using masked autoencoders. We leverage Robotic View Transformer (RVT), which uses a multi-view transformer to understand the 3D scene and predict gripper pose actions. We split RVT's multi-view transformer into visual encoder and action decoder, and pretrain its visual encoder using masked autoencoding on large-scale 3D datasets such as Objaverse. We evaluate 3D-MVP on a suite of virtual robot manipulation tasks and demonstrate improved performance over baselines. We also show promising results on a real robot platform with minimal finetuning. Our results suggest that 3D-aware pretraining is a promising approach to improve sample efficiency and generalization of vision-based robotic manipulation policies. We will release code and pretrained models for 3D-MVP to facilitate future research. Project site: https://jasonqsy.github.io/3DMVP


title: Human-Aware 3D Scene Generation with Spatially-constrained Diffusion Models

abstract: Generating 3D scenes from human motion sequences supports numerous applications, including virtual reality and architectural design. However, previous auto-regression-based human-aware 3D scene generation methods have struggled to accurately capture the joint distribution of multiple objects and input humans, often resulting in overlapping object generation in the same space. To address this limitation, we explore the potential of diffusion models that simultaneously consider all input humans and the floor plan to generate plausible 3D scenes. Our approach not only satisfies all input human interactions but also adheres to spatial constraints with the floor plan. Furthermore, we introduce two spatial collision guidance mechanisms: human-object collision avoidance and object-room boundary constraints. These mechanisms help avoid generating scenes that conflict with human motions while respecting layout constraints. To enhance the diversity and accuracy of human-guided scene generation, we have developed an automated pipeline that improves the variety and plausibility of human-object interactions in the existing 3D FRONT HUMAN dataset. Extensive experiments on both synthetic and real-world datasets demonstrate that our framework can generate more natural and plausible 3D scenes with precise human-scene interactions, while significantly reducing human-object collisions compared to previous state-of-the-art methods. Our code and data will be made publicly available upon publication of this work.


title: TeV $\gamma$-ray emission near globular cluster Terzan 5 as a probe of cosmic ray transport

abstract: Cosmic rays travelling through interstellar space have their propagation directions repeatedly scattered by fluctuating interstellar magnetic fields. The nature of this scattering is a major unsolved problem in astrophysics, one that has resisted solution largely due to a lack of direct observational constraints on the scattering rate. Here we show that very high-energy $\gamma$-ray emission from the globular cluster Terzan 5, which has unexpectedly been found to be displaced from the cluster, presents a direct probe of this process. We show that this displacement is naturally explained by cosmic rays accelerated in the bow shock around the cluster propagating a finite distance before scattering processes re-orient enough of them towards Earth to produce a detectable $\gamma$-ray signal. The angular distance between the cluster and the signal places tight constraints on the scattering rate, which we show are consistent with a model whereby scattering is primarily due to excitation of magnetic waves by the cosmic rays themselves. The analysis method we develop here will make it possible to use sources with similarly displaced non-thermal X-ray and TeV $\gamma$-ray signals as direct probes of cosmic ray scattering across a range of Galactic environments.


title: Balayage of Radon measures of infinite energy on locally compact spaces

abstract: For suitable kernels on a locally compact space $X$, we develop a theory of inner balayage of quite general Radon measures $\omega$ (not necessarily of finite energy) to arbitrary $A\subset X$. In the case where $A$ is Borel, this theory provides, as a by-product, a theory of outer balayage. We prove the existence and the uniqueness of inner (outer) swept measures, analyze their properties, and provide a number of alternative characterizations. In spite of being in agreement with Cartan's theory of Newtonian balayage, the results obtained require essentially new methods and approaches, since in the case in question, useful specific features of Newtonian potentials may fail to hold. The theory thereby established generalizes substantially the existing ones, pertaining either to $\omega$ of finite energy, or to some particular $A$ (e.g. quasiclosed). This work covers many interesting kernels in classical and modern potential theory, which looks promising for possible applications.


title: Multimodal Reaching-Position Prediction for ADL Support Using Neural Networks

abstract: This study aimed to develop daily living support robots for patients with hemiplegia and the elderly. To support the daily living activities using robots in ordinary households without imposing physical and mental burdens on users, the system must detect the actions of the user and move appropriately according to their motions. We propose a reaching-position prediction scheme that targets the motion of lifting the upper arm, which is burdensome for patients with hemiplegia and the elderly in daily living activities. For this motion, it is difficult to obtain effective features to create a prediction model in environments where large-scale sensor system installation is not feasible and the motion time is short. We performed motion-collection experiments, revealed the features of the target motion and built a prediction model using the multimodal motion features and deep learning. The proposed model achieved an accuracy of 93 \% macro average and F1-score of 0.69 for a 9-class classification prediction at 35\% of the motion completion.


title: Alexandrov's Soap Bubble Theorem for Polygons

abstract: Regular polygons are characterized as area-constrained critical points of the perimeter functional with respect to particular families of perturbations in the class of polygons with a fixed number of sides. We also review recent results in the literature involving other shape functionals as well as further open problems.


title: NeBuLa: A discourse aware Minecraft Builder

abstract: When engaging in collaborative tasks, humans efficiently exploit the semantic structure of a conversation to optimize verbal and nonverbal interactions. But in recent "language to code" or "language to action" models, this information is lacking. We show how incorporating the prior discourse and nonlinguistic context of a conversation situated in a nonlinguistic environment can improve the "language to action" component of such interactions. We fine tune an LLM to predict actions based on prior context; our model, NeBuLa, doubles the net-action F1 score over the baseline on this task of Jayannavar et al.(2020). We also investigate our model's ability to construct shapes and understand location descriptions using a synthetic dataset.


title: Prediction of superconductivity in Bilayer Kagome borophene

abstract: The element boron has long been central to two-dimensional superconducting materials, and numerous studies have demonstrated the presence of superconductivity in various boron-based structures. Recent work introduced a new variant: Bilayer Kagome borophene, characterized by its bilayer Kagome lattice with van Hove singularity. Using first-principles calculations, our research investigates the unique electronic structure and superconducting properties of Bilayer Kagome borophene (BK-borophene) through first-principles calculations. BK-borophene is identified as a single-gap superconductor with an initial superconducting transition temperature (Tc) of 11.0 K. By strategically doping the material to align its Fermi level with the Van Hove singularity, Tc is significantly enhanced to 30.0 K. The results contribute to the existing understanding of BK-borophene, highlighting its potential as a member of the expanding family of two-dimensional superconducting materials.


title: Start from Zero: Triple Set Prediction for Automatic Knowledge Graph Completion

abstract: Knowledge graph (KG) completion aims to find out missing triples in a KG. Some tasks, such as link prediction and instance completion, have been proposed for KG completion. They are triple-level tasks with some elements in a missing triple given to predict the missing element of the triple. However, knowing some elements of the missing triple in advance is not always a realistic setting. In this paper, we propose a novel graph-level automatic KG completion task called Triple Set Prediction (TSP) which assumes none of the elements in the missing triples is given. TSP is to predict a set of missing triples given a set of known triples. To properly and accurately evaluate this new task, we propose 4 evaluation metrics including 3 classification metrics and 1 ranking metric, considering both the partial-open-world and the closed-world assumptions. Furthermore, to tackle the huge candidate triples for prediction, we propose a novel and efficient subgraph-based method GPHT that can predict the triple set fast. To fairly compare the TSP results, we also propose two types of methods RuleTensor-TSP and KGE-TSP applying the existing rule- and embedding-based methods for TSP as baselines. During experiments, we evaluate the proposed methods on two datasets extracted from Wikidata following the relation-similarity partial-open-world assumption proposed by us, and also create a complete family data set to evaluate TSP results following the closed-world assumption. Results prove that the methods can successfully generate a set of missing triples and achieve reasonable scores on the new task, and GPHT performs better than the baselines with significantly shorter prediction time. The datasets and code for experiments are available at https://github.com/zjukg/GPHT-for-TSP.


title: H.E.S.S. observations of the 2021 periastron passage of PSR B1259-63/LS 2883

abstract: PSR B1259-63 is a gamma-ray binary system that hosts a pulsar in an eccentric orbit, with a 3.4 year period, around an O9.5Ve star. At orbital phases close to periastron passages, the system radiates bright and variable non-thermal emission. We report on an extensive VHE observation campaign conducted with the High Energy Stereoscopic System, comprised of ~100 hours of data taken from $t_p-24$ days to $t_p+127$ days around the system's 2021 periastron passage. We also present the timing and spectral analyses of the source. The VHE light curve in 2021 is consistent with the stacked light curve of all previous observations. Within the light curve, we report a VHE maximum at times coincident with the third X-ray peak first detected in the 2021 X-ray light curve. In the light curve -- although sparsely sampled in this time period -- we see no VHE enhancement during the second disc crossing. In addition, we see no correspondence to the 2021 GeV flare in the VHE light curve. The VHE spectrum obtained from the analysis of the 2021 dataset is best described by a power law of spectral index $\Gamma = 2.65 \pm 0.04_{\text{stat}}$ $\pm 0.04_{\text{sys}}$, a value consistent with the previous H.E.S.S. observations of the source. We report spectral variability with a difference of $\Delta \Gamma = 0.56 ~\pm~ 0.18_{\text{stat}}$ $~\pm~0.10_{\text{sys}}$ at 95% c.l., between sub-periods of the 2021 dataset. We also find a linear correlation between contemporaneous flux values of X-ray and TeV datasets, detected mainly after $t_p+25$ days, suggesting a change in the available energy for non-thermal radiation processes. We detect no significant correlation between GeV and TeV flux points, within the uncertainties of the measurements, from $\sim t_p-23$ days to $\sim t_p+126$ days. This suggests that the GeV and TeV emission originate from different electron populations.


title: Emergence of social hierarchies in a society with two competitive classes

abstract: Agent-based models describing social interactions among individuals can help to better understand emerging macroscopic patterns in societies. One of the topics which is worth tackling is the formation of different kinds of hierarchies that emerge in social spaces such as cities. Here we propose a Bonabeau-like model by adding a second class of agents. The fundamental particularity of our model is that only a pairwise interaction between agents of the opposite class is allowed. Agent fitness can thus only change by competition among the two classes, while the total fitness in the society remains constant. The main result is that for a broad range of values of the model parameters, the fitness of the agents of each class show a decay in time except for one or very few agents which capture almost all the fitness in the society. Numerical simulations also reveal a singular shift from egalitarian to hierarchical society for each class. This behaviour depends on the control parameter $\eta$, playing the role of the inverse of the temperature of the system. Results are invariant with regard to the system size, contingent solely on the quantity of agents within each class. Finally, a couple of scaling laws are provided thus showing a data collapse from different model parameters and they follow a shape which can be related to the presence of a phase transition in the model.

categories: physics.soc-ph cs.CC cs.MA physics.data-an


title: Timing and Scintillation Studies of Pulsars in Globular Cluster M3 (NGC 5272) with FAST

abstract: We present the phase-connected timing solutions of all the five pulsars in globular cluster (GC) M3 (NGC 5272), namely PSRs M3A to F (PSRs J1342+2822A to F), with the exception of PSR M3C, from FAST archival data. In these timing solutions, those of PSRs M3E, and F are obtained for the first time. We find that PSRs M3E and F have low mass companions, and are in circular orbits with periods of 7.1 and 3.0 days, respectively. For PSR M3C, we have not detected it in all the 41 observations. We found no X-ray counterparts for these pulsars in archival Chandra images in the band of 0.2-20 keV. We noticed that the pulsars in M3 seem to be native. From the Auto-Correlation Function (ACF) analysis of the M3A's and M3B's dynamic spectra, the scintillation timescale ranges from $7.0\pm0.3$ min to $60.0\pm0.6$ min, and the scintillation bandwidth ranges from $4.6\pm0.2$ MHz to $57.1\pm1.1$ MHz. The measured scintillation bandwidths from the dynamic spectra indicate strong scintillation, and the scattering medium is anisotropic. From the secondary spectra, we captured a scintillation arc only for PSR M3B with a curvature of $649\pm23 {\rm m}^{-1} {\rm mHz}^{-2}$.


title: Complex scalar dark matter in a new gauged U(1) symmetry with kinetic and direct mixings

abstract: We propose a scalar dark matter model featuring a hidden gauge symmetry, denoted as U(1)_X, with two complex scalars, Phi and S. In this framework, Phi spontaneously breaks the U(1)_X gauge symmetry, while S serves as a viable dark matter candidate. Particularly, the kinetic and direct mixings between the U(1)_X and U(1)_Y gauge groups provide a portal between dark matter and the Standard Model particles. These mixings offer a plausible explanation for the W boson mass anomaly observed by the CDF Collaboration. We study the comprehensive phenomenological constraints of this model from colliders and dark matter detection experiments, including Z' searches at the LHC, the 125 GeV Higgs boson measurements, the relic density of dark matter and the indirect detection of dark matter annihilation. By randomly scanning the parameter space, we find that the regions where m_(Z') > 4750 GeV and m_(Z') < 4750 GeV for g_x close to 1 remain viable and can be tested by future experiments.


title: Similarity-Based Analysis of Atmospheric Organic Compounds for Machine Learning Applications

abstract: The formation of aerosol particles in the atmosphere impacts air quality and climate change, but many of the organic molecules involved remain unknown. Machine learning could aid in identifying these compounds through accelerated analysis of molecular properties and detection characteristics. However, such progress is hindered by the current lack of curated datasets for atmospheric molecules and their associated properties. To tackle this challenge, we propose a similarity analysis that connects atmospheric compounds to existing large molecular datasets used for machine learning development. We find a small overlap between atmospheric and non-atmospheric molecules using standard molecular representations in machine learning applications. The identified out-of-domain character of atmospheric compounds is related to their distinct functional groups and atomic composition. Our investigation underscores the need for collaborative efforts to gather and share more molecular-level atmospheric chemistry data. The presented similarity based analysis can be used for future dataset curation for machine learning development in the atmospheric sciences.


title: In vivo and in vitro study of resorbable magnesium wires for medical implants: Mg purity, surface quality, Zn alloying and polymer coating

abstract: Magnesium is an excellent material in terms of biocompatibility and its corrosion products can serve as an active source for new bone formation. However, localized corrosion and H2 generation limit the potential of Mg-based implants. Utilizing low-alloyed Mg-Zn wires can strongly reduce problems with large H2 bubbles and improve the mechanical properties considerably while maintaining excellent long-term biocompatibility. Acidic pickling and a polymer coating can be effectively used to lower the rate of in vivo degradation. In this work, microstructural, mechanical, and in vitro characterization of 250 um and 300 um extruded wires made from ultra-pure Mg, commercially pure Mg, Mg-0.15Zn, Mg-0.4Zn and Mg-1Zn was performed. Additionally, Mg-0.4Zn wires together with a variant coated with a copolymer of L-lactide and {\epsilon}-caprolactone were tested in vivo on artificially damaged Wistar rat femurs. Based on the observed Mg-induced osteogenesis, polymer-coated Mg wires with a small addition of Zn are a perspective material for bone-support applications, such as cerclage and fixation wires.


title: UIO-LLMs: Unbiased Incremental Optimization for Long-Context LLMs

abstract: Managing long texts is challenging for large language models (LLMs) due to limited context window sizes. This study introduces UIO-LLMs, an unbiased incremental optimization approach for memory-enhanced transformers under long-context settings. We initially conceptualize the process as a streamlined encoder-decoder framework where the weights-shared encoder and decoder respectively encapsulate a context segment into memories and leverage these memories to predict outputs of the subsequent segment. Subsequently, by treating our memory-enhanced transformers as fully-connected recurrent neural networks (RNNs), we refine the training process using the Truncated Backpropagation Through Time (TBPTT) algorithm, which incorporates innovative incremental optimization techniques. These techniques not only diminish time complexity but also address the bias in gradient computation through an unbiased optimization process. UIO-LLMs successfully handle long context, such as extending the context window of Llama2-7b-chat from 4K to 100K tokens with minimal 2% additional parameters, while keeping the inference cost nearly linear as context length increases.


title: An elementary proof of representation of submodular function as an supremum of measures on $\sigma$-algebra with totally ordered generating class

abstract: We give an alternative proof of a fact that a finite continuous non-decreasing submodular set function on a measurable space can be expressed as a supremum of measures dominated by the function, if there exists a class of sets which is totally ordered with respect to inclusion and generates the sigma-algebra of the space. The proof is elementary in the sense that the measure attaining the supremum in the claim is constructed by a standard extension theorem of measures. As a consequence, a uniquness of the supremum attaining measure also follows. A Polish space is an examples of the measurable space which has a class of totally ordered sets that generates the Borel sigma-algebra.