title: MuseumMaker: Continual Style Customization without Catastrophic Forgetting

abstract: Pre-trained large text-to-image (T2I) models with an appropriate text prompt has attracted growing interests in customized images generation field. However, catastrophic forgetting issue make it hard to continually synthesize new user-provided styles while retaining the satisfying results amongst learned styles. In this paper, we propose MuseumMaker, a method that enables the synthesis of images by following a set of customized styles in a never-end manner, and gradually accumulate these creative artistic works as a Museum. When facing with a new customization style, we develop a style distillation loss module to extract and learn the styles of the training data for new image generation. It can minimize the learning biases caused by content of new training images, and address the catastrophic overfitting issue induced by few-shot images. To deal with catastrophic forgetting amongst past learned styles, we devise a dual regularization for shared-LoRA module to optimize the direction of model update, which could regularize the diffusion model from both weight and feature aspects, respectively. Meanwhile, to further preserve historical knowledge from past styles and address the limited representability of LoRA, we consider a task-wise token learning module where a unique token embedding is learned to denote a new style. As any new user-provided style come, our MuseumMaker can capture the nuances of the new styles while maintaining the details of learned styles. Experimental results on diverse style datasets validate the effectiveness of our proposed MuseumMaker method, showcasing its robustness and versatility across various scenarios.


title: Stochastic Dissipative Euler's equations for a free body

abstract: Intrinsic thermal fluctuations within a real solid challenge the rigid body assumption that is central to Euler's equations for the motion of a free body. Recently, we have introduced a dissipative and stochastic version of Euler's equations in a thermodynamically consistent way (European Journal of Mechanics - A/Solids 103, 105184 (2024)). This framework describes the evolution of both orientation and shape of a free body, incorporating internal thermal fluctuations and their concomitant dissipative mechanisms. In the present work, we demonstrate that, in the absence of angular momentum, the theory predicts that principal axis unit vectors of a body undergo an anisotropic Brownian motion on the unit sphere, with the anisotropy arising from the body's varying moments of inertia. The resulting equilibrium time correlation function of the principal eigenvectors decays exponentially. This theoretical prediction is confirmed in molecular dynamics simulations of small bodies. The comparison of theory and equilibrium MD simulations allow us to measure the orientational diffusion tensor. We then use this information in the Stochastic Dissipative Euler's Equations, to describe a non-equilibrium situation of a body spinning around the unstable intermediate axis. The agreement between theory and simulations is excellent, offering a validation of the theoretical framework.


title: Derandomization with Pseudorandomness

abstract: Derandomization techniques are often used within advanced randomized algorithms. In particular, pseudorandom objects, such as hash families and expander graphs, are key components of such algorithms, but their verification presents a challenge. This work shows how such algorithms can be expressed and verified in Isabelle and presents a pseudorandom objects library that abstracts away the involved deep algebraic/analytic results. Moreover, it presents examples that show how the library eases and enables the verification of advanced randomized algorithms. Highlighting the value of this framework is that it was recently used to verify the optimal-space distinct elements algorithm by Blasiok from 2018, which relies on the combination of many derandomization techniques to achieve its optimality.


title: On first passage time problems of Brownian motion -- The inverse method of images revisited

abstract: Let $W$ be a standard Brownian motion with $W_0 = 0$ and let $b\colon[0,\infty) \to \mathbb{R}$ be a continuous function with $b(0) > 0$. In this article, we look at the classical First Passage Time (FPT) problem, i.e., the question of determining the distribution of $\tau := \inf \{ t\in [0,\infty)\colon W_t \geq b(t) \}.$ More specifically, we revisit the method of images, which we feel has received less attention than it deserves. The main observation of this approach is that the FPT problem is fully solved if a measure $\mu$ exists such that \begin{align*} \int_{(0,\infty)} \exp\left(-\frac{\theta^2}{2t}+\frac{\theta b(t)}{t}\right)\mu(d\theta)=1, \qquad t\in(0,\infty). \end{align*} The goal of this article is to lay the foundation for answering the still open question of the existence and characterisation of such a measure $\mu$ for a given curve $b$. We present a new duality approach that allows us to give sufficient conditions for the existence. Moreover, we introduce a very efficient algorithm for approximating the representing measure $\mu$ and provide a rigorous theoretical foundation.


title: Robust Capped lp-Norm Support Vector Ordinal Regression

abstract: Ordinal regression is a specialized supervised problem where the labels show an inherent order. The order distinguishes it from normal multi-class problem. Support Vector Ordinal Regression, as an outstanding ordinal regression model, is widely used in many ordinal regression tasks. However, like most supervised learning algorithms, the design of SVOR is based on the assumption that the training data are real and reliable, which is difficult to satisfy in real-world data. In many practical applications, outliers are frequently present in the training set, potentially leading to misguide the learning process, such that the performance is non-optimal. In this paper, we propose a novel capped $\ell_{p}$-norm loss function that is theoretically robust to both light and heavy outliers. The capped $\ell_{p}$-norm loss can help the model detect and eliminate outliers during training process. Adhering to this concept, we introduce a new model, Capped $\ell_{p}$-Norm Support Vector Ordinal Regression(CSVOR), that is robust to outliers. CSVOR uses a weight matrix to detect and eliminate outliers during the training process to improve the robustness to outliers. Moreover, a Re-Weighted algorithm algorithm which is illustrated convergence by our theoretical results is proposed to effectively minimize the corresponding problem. Extensive experimental results demonstrate that our model outperforms state-of-the-art(SOTA) methods, particularly in the presence of outliers.


title: Denoising: from classical methods to deep CNNs

abstract: This paper aims to explore the evolution of image denoising in a pedagological way. We briefly review classical methods such as Fourier analysis and wavelet bases, highlighting the challenges they faced until the emergence of neural networks, notably the U-Net, in the 2010s. The remarkable performance of these networks has been demonstrated in studies such as Kadkhodaie et al. (2024). They exhibit adaptability to various image types, including those with fixed regularity, facial images, and bedroom scenes, achieving optimal results and biased towards geometry-adaptive harmonic basis. The introduction of score diffusion has played a crucial role in image generation. In this context, denoising becomes essential as it facilitates the estimation of probability density scores. We discuss the prerequisites for genuine learning of probability densities, offering insights that extend from mathematical research to the implications of universal structures.


title: Contramodules for algebraic groups: the existence of mock projectives

abstract: Let $G$ be an affine algebraic group over an algebraically closed field of positive characteristic. Recent work of Hardesty, Nakano, and Sobaje gives necessary and sufficient conditions for the existence of so-called mock injective $G$-modules, that is, modules which are injective upon restriction to all Frobenius kernels of $G$. In this paper, we give analogous results for contramodules, including showing that the same necessary and sufficient conditions on $G$ guarantee the existence of mock-projective contramodules. In order to do this we first develop contramodule analogs to many well-known (co)module constructions.


title: The THU-HCSI Multi-Speaker Multi-Lingual Few-Shot Voice Cloning System for LIMMITS'24 Challenge

abstract: This paper presents the multi-speaker multi-lingual few-shot voice cloning system developed by THU-HCSI team for LIMMITS'24 Challenge. To achieve high speaker similarity and naturalness in both mono-lingual and cross-lingual scenarios, we build the system upon YourTTS and add several enhancements. For further improving speaker similarity and speech quality, we introduce speaker-aware text encoder and flow-based decoder with Transformer blocks. In addition, we denoise the few-shot data, mix up them with pre-training data, and adopt a speaker-balanced sampling strategy to guarantee effective fine-tuning for target speakers. The official evaluations in track 1 show that our system achieves the best speaker similarity MOS of 4.25 and obtains considerable naturalness MOS of 3.97.


title: Intrinsic and extrinsic plasmons in the hard x-ray photoelectron spectra of nearly free electron metals

abstract: Collective plasmon excitations in solids that result from the process of photoemission are an important area of fundamental research. In this study, we identify a significant number ($n$) of multiple bulk plasmons ($n\omega_p$) in the hard x-ray photoelectron spectra of the core levels and valence bands (VBs) of two well-known, nearly free electron metals, aluminum (Al) and magnesium (Mg). On the basis of earlier theoretical works, we estimate the contributions of extrinsic, intrinsic, and interference processes to the intensities of 1$s$ to 2$s$ core level plasmons. The intrinsic contribution diminishes from 22% for 1$\omega_p$, to 4.4% for 2$\omega_p$, and becomes negligible thereafter (0.5% for 3$\omega_p$). The extrinsic and intrinsic plasmon contributions do not vary significantly across a broad range of photoelectron kinetic energies, and also between the two metals (Al and Mg). The interference contribution varies from negative to zero as $n$ increases. An asymmetric line shape is observed for the bulk plasmons, which is most pronounced for 1$\omega_p$. Signature of the surface plasmon is detected in normal emission, and it exhibits a significantly increased intensity in the grazing emission. The VB spectra of Al and Mg, which are dominated by $s$-like states, exhibit excellent agreement with the calculated VB based on density functional theory. The VB exhibits four multiple bulk plasmon peaks in the loss region, which are influenced by an intrinsic process in addition to the extrinsic process. On a completely oxidized aluminum surface, the relative intensity of the Al metal bulk plasmon remains nearly unaltered, while the surface plasmon is completely attenuated.


title: Hippocrates: An Open-Source Framework for Advancing Large Language Models in Healthcare

abstract: The integration of Large Language Models (LLMs) into healthcare promises to transform medical diagnostics, research, and patient care. Yet, the progression of medical LLMs faces obstacles such as complex training requirements, rigorous evaluation demands, and the dominance of proprietary models that restrict academic exploration. Transparent, comprehensive access to LLM resources is essential for advancing the field, fostering reproducibility, and encouraging innovation in healthcare AI. We present Hippocrates, an open-source LLM framework specifically developed for the medical domain. In stark contrast to previous efforts, it offers unrestricted access to its training datasets, codebase, checkpoints, and evaluation protocols. This open approach is designed to stimulate collaborative research, allowing the community to build upon, refine, and rigorously evaluate medical LLMs within a transparent ecosystem. Also, we introduce Hippo, a family of 7B models tailored for the medical domain, fine-tuned from Mistral and LLaMA2 through continual pre-training, instruction tuning, and reinforcement learning from human and AI feedback. Our models outperform existing open medical LLMs models by a large-margin, even surpassing models with 70B parameters. Through Hippocrates, we aspire to unlock the full potential of LLMs not just to advance medical knowledge and patient care but also to democratize the benefits of AI research in healthcare, making them available across the globe.


title: DAVE -- A Detect-and-Verify Paradigm for Low-Shot Counting

abstract: Low-shot counters estimate the number of objects corresponding to a selected category, based on only few or no exemplars annotated in the image. The current state-of-the-art estimates the total counts as the sum over the object location density map, but does not provide individual object locations and sizes, which are crucial for many applications. This is addressed by detection-based counters, which, however fall behind in the total count accuracy. Furthermore, both approaches tend to overestimate the counts in the presence of other object classes due to many false positives. We propose DAVE, a low-shot counter based on a detect-and-verify paradigm, that avoids the aforementioned issues by first generating a high-recall detection set and then verifying the detections to identify and remove the outliers. This jointly increases the recall and precision, leading to accurate counts. DAVE outperforms the top density-based counters by ~20% in the total count MAE, it outperforms the most recent detection-based counter by ~20% in detection quality and sets a new state-of-the-art in zero-shot as well as text-prompt-based counting.


title: Layered List Labeling

abstract: The list-labeling problem is one of the most basic and well-studied algorithmic primitives in data structures, with an extensive literature spanning upper bounds, lower bounds, and data management applications. The classical algorithm for this problem, dating back to 1981, has amortized cost $O(\log^2 n)$. Subsequent work has led to improvements in three directions: \emph{low-latency} (worst-case) bounds; \emph{high-throughput} (expected) bounds; and (adaptive) bounds for \emph{important workloads}. Perhaps surprisingly, these three directions of research have remained almost entirely disjoint -- this is because, so far, the techniques that allow for progress in one direction have forced worsening bounds in the others. Thus there would appear to be a tension between worst-case, adaptive, and expected bounds. List labeling has been proposed for use in databases at least as early as PODS'99, but a database needs good throughput, response time, and needs to adapt to common workloads (e.g., bulk loads), and no current list-labeling algorithm achieve good bounds for all three. We show that this tension is not fundamental. In fact, with the help of new data-structural techniques, one can actually \emph{combine} any three list-labeling solutions in order to cherry-pick the best worst-case, adaptive, and expected bounds from each of them.


title: Development of parallel programs on shared data-structures -- Revised version

abstract: A syntax-directed formal system for the development of totally correct programs with respect to an unfair shared-state parallel while-language is proposed. The system can be understood as a compositional reformulation of the Owicki/Gries method for verification of parallel programs. Auxiliary variables are used both as a specification tool to eliminate undesirable implementations, and as a verification tool to make it possible to prove that an already finished program satisfies a particular specification. Auxiliary variables may be of any sort, and it is up to the user to define the auxiliary structure he prefers. Moreover, the auxiliary structure is only a part of the logic. This means that auxiliary variables do not have to be implemented as if they were ordinary programming variables. The system is proved sound and relatively complete with respect to an operational semantics and employed to develop three nontrivial algorithms: the Dining-Philosophers, the Bubble-Lattice-Sort and the Set-Partition algorithms. Finally, a related method for the development of (possibly nonterminating) programs with respect to four properties is described. This approach is then used to develop Dekker's algorithm.


title: Long-term stellar activity of M dwarfs: A combined K2 and TESS study of two early M-type stars

abstract: Studies of the rotation and activity of M type stars are essential to enhance our understanding of stellar dynamos and angular momentum evolution. Using the outstanding photometric capabilities of space telescopes rotation signals even with low amplitudes can be investigated in up to now unrivaled detail. By combining data of K2 and the TESS prime mission the star spot activity of M dwarfs can be monitored on half a decade timescale. In the framework of our study on the rotation-activity relation for bright and nearby M dwarfs we also aim at an investigation of the long-term activity. While K2 was observing fields distributed around the ecliptic plane, the TESS prime mission was oriented along a line of ecliptic longitude with one camera centered on an ecliptic pole. Due to these different observing strategies, the overlap between K2 and the TESS prime mission is marginal. However, 45 stars from our sample were observed with both missions of which two early M-type stars that fulfill our selection criteria, EPIC 202059229 and EPIC 245919787, were analyzed in more detail. We found that for both stars the rotation period did not change while the rotational phase did change for EPIC 245919787 by ~0.2. The amplitude of the spot induced variability changed for both stars but more significant for EPIC 245919787. By comparing the cumulative flare frequency distributions we found that the flare activity for EPIC 202059229 is unchanged while it slightly changes for EPIC 245919787 between the K2 and TESS epochs. Using a combination of light curves from K2 and TESS that span a baseline up to 4.5 years we could measure significant differential rotation for EPIC 245919787. Furthermore, we show that combining missions like K2 and TESS is a promising method for detecting stellar activity cycles.


title: Understanding small neutrino mass and its implication

abstract: We have derived previously the relations between the neutrino masses and mixing angles in a dispersive analysis on the mixing of neutral leptonic states. The only involved assumption is that the electroweak symmetry of the Standard Model (SM) is restored at a high energy scale in some new physics scenario, which diminishes the box diagrams responsible for the mixing. Here we include corrections to the analysis up to three loops, arising from exchanges of additional neutral and charged scalars in the electroweak symmetric phase. The solution to the dispersion relation for the $\mu^-e^+$-$\mu^+e^-$ mixing generates a typical neutrino mass $m_\nu\sim O(1)$ eV in the SM unambiguously. The solution also favors the normal ordering of the neutrino masses over the inverted one, and links the large electroweak symmetry restoration, i.e., new physics scale to the small neutrino mass.


title: Incorporating Lexical and Syntactic Knowledge for Unsupervised Cross-Lingual Transfer

abstract: Unsupervised cross-lingual transfer involves transferring knowledge between languages without explicit supervision. Although numerous studies have been conducted to improve performance in such tasks by focusing on cross-lingual knowledge, particularly lexical and syntactic knowledge, current approaches are limited as they only incorporate syntactic or lexical information. Since each type of information offers unique advantages and no previous attempts have combined both, we attempt to explore the potential of this approach. In this paper, we present a novel framework called "Lexicon-Syntax Enhanced Multilingual BERT" that combines both lexical and syntactic knowledge. Specifically, we use Multilingual BERT (mBERT) as the base model and employ two techniques to enhance its learning capabilities. The code-switching technique is used to implicitly teach the model lexical alignment information, while a syntactic-based graph attention network is designed to help the model encode syntactic structure. To integrate both types of knowledge, we input code-switched sequences into both the syntactic module and the mBERT base model simultaneously. Our extensive experimental results demonstrate this framework can consistently outperform all baselines of zero-shot cross-lingual transfer, with the gains of 1.0~3.7 points on text classification, named entity recognition (ner), and semantic parsing tasks. Keywords:cross-lingual transfer, lexicon, syntax, code-switching, graph attention network


title: The quasi-isometry invariance of the Coset Intersection Complex

abstract: For a pair $(G,\mathcal{P})$ consisting of a group and finite collection of subgroups, we introduce a simplicial $G$-complex $\mathcal{K}(G,\mathcal{P})$ called the coset intersection complex. We prove that the quasi-isometry type and the homotopy type of $\mathcal{K}(G,\mathcal{P})$ are quasi-isometric invariants of the group pair $(G,\mathcal{P})$. Classical properties of $\mathcal{P}$ in $G$ correspond to topological or geometric properties of $\mathcal{K}(G,\mathcal{P})$, such as having finite height, having finite width, being almost malnormal, admiting a malnormal core, or having thickness of order one. As applications, we obtain that a number of algebraic properties of $\mathcal{P}$ in $G$ are quasi-isometry invariants of the pair $(G,\mathcal{P})$. For a certain class of right-angled Artin groups and their maximal parabolic subgroups, we show that the complex $\mathcal{K}(G,\mathcal{P})$ is quasi-isometric to the Extension graph; in particular, it is quasi-isometric to a tree.


title: Implementing and Optimizing the Scaled Dot-Product Attention on Streaming Dataflow

abstract: Transformer models serve as the backbone of many state-ofthe-art language models, and most use the scaled dot-product attention (SDPA) mechanism to capture relationships between tokens. However, the straightforward implementation of SDPA has quadratic compute and memory complexity with respect to the sequence length. On processor architectures such as GPUs and TPUs, there is a robust body of prior work. However, little work has been performed on non-processor architectures.In this work, we show how the architecture and execution model of Streaming Dataflow Accelerators can help tackle this challenge. We first define abstract hardware that adopts a streaming execution model, and we implement a cycle-accurate simulator of the abstract hardware using the Dataflow Abstract Machine simulation framework. Second, we implement the naive SDPA algorithm on this abstract hardware and show it requires linear (O(N)) intermediate memory. Third, we then modify the naive algorithm, taking inspiration from prior processor-oriented works, by reordering the multiplication and division operations. Finally, we map the modified algorithm to abstract hardware, and confirm that the implementation computes SDPA at full throughput while only using a constant amount (O(1)) of intermediate memory.


title: Legal Aspects for Software Developers Interested in Generative AI Applications

abstract: Recent successes in Generative Artificial Intelligence (GenAI) have led to new technologies capable of generating high-quality code, natural language, and images. The next step is to integrate GenAI technology into products, a task typically conducted by software developers. Such product development always comes with a certain risk of liability. Within this article, we want to shed light on the current state of two such risks: data protection and copyright. Both aspects are crucial for GenAI. This technology deals with data for both model training and generated output. We summarize key aspects regarding our current knowledge that every software developer involved in product development using GenAI should be aware of to avoid critical mistakes that may expose them to liability claims.


title: Chemical abundances of LINER galaxies -- Nitrogen abundance estimations

abstract: In this work, we investigated the nitrogen and oxygen abundances in a sample of galaxies with Low Ionization Nuclear Emission Regions (LINERs) in their nucleus. Optical spectroscopic data (3 600 - 10 000 {\AA}) of 40 LINERs from the Mapping Nearby Galaxies (MaNGA) survey were considered. Only objects classified as retired galaxies, i.e. whose main ionization sources are post-Asymptotic Giant Branch (pAGB) stars, were selected. The abundance estimates were obtained through detailed photoionization models built with the cloudy code to reproduce a set of observational emission line intensities ratios of the sample. Our results show that LINERs have oxygen and nitrogen abundances in the ranges of $ 8.0 \leq 12+\log(O/H) \leq 9.0$ (mean value $8.74\pm 0.27$) and $7.6 \leq 12+\log(N/H) \leq 8.5$ (mean value $8.05\pm 0.25$), respectively. About 70% of the sample have oversolar O/H and N/H abundances. Our abundance estimates are in consonance with those for Seyfert 2 nuclei and H ii regions with the highest metallicity, indicating that these distinct object classes show similar enrichment of the interstellar medium (ISM). The LINERs in our sample are located in the higher N/O region of the N/O versus O/H diagram, showing an expected negative correlation between these two parameters. These results suggest that these LINERs mainly exhibit a secondary nitrogen production and could be acting some other mechanisms that deviate them from the usual theoretical secondary nitrogen production curve and the H ii regions observations. However, we did not find any evidence in our data able to support the literature suggested mechanisms. On the other hand, our results show that LINERs do not present any correlation between the N/O abundances and the stellar masses of the hosting galaxies.


title: Introducing Systems Thinking as a Framework for Teaching and Assessing Threat Modeling Competency

abstract: Computing systems face diverse and substantial cybersecurity threats. To mitigate these cybersecurity threats, software engineers need to be competent in the skill of threat modeling. In industry and academia, there are many frameworks for teaching threat modeling, but our analysis of these frameworks suggests that (1) these approaches tend to be focused on component-level analysis rather than educating students to reason holistically about a system's cybersecurity, and (2) there is no rubric for assessing a student's threat modeling competency. To address these concerns, we propose using systems thinking in conjunction with popular and industry-standard threat modeling frameworks like STRIDE for teaching and assessing threat modeling competency. Prior studies suggest a holistic approach, like systems thinking, can help understand and mitigate cybersecurity threats. Thus, we developed and piloted two novel rubrics - one for assessing STRIDE threat modeling performance and the other for assessing systems thinking performance while conducting STRIDE. To conduct this study, we piloted the two rubrics mentioned above to assess threat model artifacts of students enrolled in an upper-level software engineering course at Purdue University in Fall 2021, Spring 2023, and Fall 2023. Students who had both systems thinking and STRIDE instruction identified and attempted to mitigate component-level as well as systems-level threats. Students with only STRIDE instruction tended to focus on identifying and mitigating component-level threats and discounted system-level threats. We contribute to engineering education by: (1) describing a new rubric for assessing threat modeling based on systems thinking; (2) identifying trends and blindspots in students' threat modeling approach; and (3) envisioning the benefits of integrating systems thinking in threat modeling teaching and assessment.


title: Self-Balanced R-CNN for Instance Segmentation

abstract: Current state-of-the-art two-stage models on instance segmentation task suffer from several types of imbalances. In this paper, we address the Intersection over the Union (IoU) distribution imbalance of positive input Regions of Interest (RoIs) during the training of the second stage. Our Self-Balanced R-CNN (SBR-CNN), an evolved version of the Hybrid Task Cascade (HTC) model, brings brand new loop mechanisms of bounding box and mask refinements. With an improved Generic RoI Extraction (GRoIE), we also address the feature-level imbalance at the Feature Pyramid Network (FPN) level, originated by a non-uniform integration between low- and high-level features from the backbone layers. In addition, the redesign of the architecture heads toward a fully convolutional approach with FCC further reduces the number of parameters and obtains more clues to the connection between the task to solve and the layers used. Moreover, our SBR-CNN model shows the same or even better improvements if adopted in conjunction with other state-of-the-art models. In fact, with a lightweight ResNet-50 as backbone, evaluated on COCO minival 2017 dataset, our model reaches 45.3% and 41.5% AP for object detection and instance segmentation, with 12 epochs and without extra tricks. The code is available at https://github.com/IMPLabUniPr/mmdetection/tree/sbr_cnn


title: Inverse scattering for repulsive potential and strong singular interactions

abstract: In a previous work of 2014 on a quantum system governed by the repulsive Hamiltonian, the author proved uniqueness for short-range interactions described by a scattering operator consisting of regular and singular parts. In this paper, the singular part is assumed to have much stronger singularities and the same uniqueness theorem is proved. By applying the time-dependent method invented by Enss and Weder in 1995, the high-velocity limit for a wider class of the scattering operator with stronger singularities also uniquely determines uniquely the interactions of a multi-dimensional system.


title: TinyChart: Efficient Chart Understanding with Visual Token Merging and Program-of-Thoughts Learning

abstract: Charts are important for presenting and explaining complex data relationships. Recently, multimodal large language models (MLLMs) have shown remarkable capabilities in various chart understanding tasks. However, the sheer size of these models in terms of parameters and computational requirements limits their use in resource-constrained environments. In this paper, we present TinyChart, an efficient MLLM for chart understanding with only 3B parameters. TinyChart overcomes two key challenges in efficient chart understanding: (1) reduce the burden of learning numerical computations through a Program-of-Thoughts (PoT) learning strategy, which trains the model to generate Python programs for numerical calculations, and (2) reduce lengthy vision feature sequences produced by the vision transformer for high-resolution images through a Vision Token Merging module, which gradually merges most similar vision tokens. Extensive experiments demonstrate that our 3B TinyChart achieves SOTA performance on a variety of chart understanding benchmarks including ChartQA, Chart-to-Text, Chart-to-Table, OpenCQA, and ChartX. It outperforms several chart understanding MLLM with up to 13B parameters such as ChartLlama and ChartAst, and close-sourced general-purpose MLLM GPT-4V on ChartQA. It also demonstrates its superior efficiency with higher throughput during inference due to a smaller model scale and more efficient vision encoding. Our code and model are available at https://github.com/X-PLUG/mPLUG-DocOwl/tree/main/TinyChart.


title: An extension of Gauss congruences for Ap\'ery numbers

abstract: Osburn, Sahu and Straub introduced the numbers: \begin{align*} A_n^{(r,s,t)}=\sum_{k=0}^n{n\choose k}^r{n+k\choose k}^s{2k\choose n}^t, \end{align*} for non-negative integers $n,r,s,t$ with $r\ge 2$, which includes two kinds of Ap\'ery numbers and four kinds of Ap\'ery-like numbers as special cases, and showed that the numbers $\{A_n^{(r,s,t)}\}_{n\ge 0}$ satisfy the Gauss congruences of order $3$. We establish an extension of Osburn--Sahu--Straub congruence through Bernoulli numbers, which is one step deep congruence of the Gauss congruence for $A_n^{(r,s,t)}$.


title: Zero-Shot Distillation for Image Encoders: How to Make Effective Use of Synthetic Data

abstract: Multi-modal foundation models such as CLIP have showcased impressive zero-shot capabilities. However, their applicability in resource-constrained environments is limited due to their large number of parameters and high inference time. While existing approaches have scaled down the entire CLIP architecture, we focus on training smaller variants of the image encoder, which suffices for efficient zero-shot classification. The use of synthetic data has shown promise in distilling representations from larger teachers, resulting in strong few-shot and linear probe performance. However, we find that this approach surprisingly fails in true zero-shot settings when using contrastive losses. We identify the exploitation of spurious features as being responsible for poor generalization between synthetic and real data. However, by using the image feature-based L2 distillation loss, we mitigate these problems and train students that achieve zero-shot performance which on four domain-specific datasets is on-par with a ViT-B/32 teacher model trained on DataCompXL, while featuring up to 92% fewer parameters.


title: Privacy-Preserving Statistical Data Generation: Application to Sepsis Detection

abstract: The biomedical field is among the sectors most impacted by the increasing regulation of Artificial Intelligence (AI) and data protection legislation, given the sensitivity of patient information. However, the rise of synthetic data generation methods offers a promising opportunity for data-driven technologies. In this study, we propose a statistical approach for synthetic data generation applicable in classification problems. We assess the utility and privacy implications of synthetic data generated by Kernel Density Estimator and K-Nearest Neighbors sampling (KDE-KNN) within a real-world context, specifically focusing on its application in sepsis detection. The detection of sepsis is a critical challenge in clinical practice due to its rapid progression and potentially life-threatening consequences. Moreover, we emphasize the benefits of KDE-KNN compared to current synthetic data generation methodologies. Additionally, our study examines the effects of incorporating synthetic data into model training procedures. This investigation provides valuable insights into the effectiveness of synthetic data generation techniques in mitigating regulatory constraints within the biomedical field.


title: Honda-Tate theory for log abelian varieties over finite fields

abstract: In this article we study the Honda-Tate theory for log abelian varieties over an fs log point $S=(\mathrm{Spec}(\mathbf{k}),M_S)$ for $\mathbf{k}=\mathbb{F}_q$ a finite field, generalizing the classical Honda-Tate theory for abelian varieties over $\mathbf{k}$. For the standard log point $S$, we give a complete description of the isogeny classes of such log abelian varieties using Weil $q$-numbers of weight 0,1, and 2. In the general case where $M_S$ admits a global chart $P\to\mathbf{k}$ with $P=\mathbb{N}^k$, we also give a complete description of simple isogeny classes of log abelian varieties over $S$ in terms of rational points in generalized simplices.


title: Higher H\"older regularity for a subquadratic nonlocal parabolic equation

abstract: In this paper, we are concerned with the H\"older regularity for solutions of the nonlocal evolutionary equation $$ \partial_t u+(-\Delta_p)^s u = 0. $$ Here, $(-\Delta_p)^s$ is the fractional $p$-Laplacian, $0<s<1$ and $1<p<2$. We establish H\"older regularity with explicit H\"older exponents. We also include the inhomogeneous equation with a bounded inhomogeneity. In some cases, the obtained H\"older exponents are almost sharp. Our results complement the previous results for the superquadratic case when $p\geq 2$.


title: Extended high-ionization [MgIV] emission tracing widespread shocks in starbursts seen by JWST /NIRSpec

abstract: We report the detection of extended (>0.5-1kpc) high-ionization [MgIV] 4.487 $\mu$m (80 eV) emission in four local luminous infrared galaxies observed with JWST/NIRSpec. Excluding the nucleus and outflow of the Type 1 active galactic nucleus (AGN) in the sample, we find that the [MgIV] luminosity is well correlated with that of H recombination lines, which mainly trace star forming clumps in these objects, and that the [ArVI] 4.530 $\mu$m (75 eV), usually seen in AGN, is undetected. On 100-400pc scales, the [MgIV] line profiles are broader (sigma([MgIV])=90 +- 25 km/s) and shifted (Delta_v up to +- 50 km/s) compared to those of the H recombination lines and lower ionization transitions (e.g., sigma(Hu-12)=57 +- 15 km/s). The [MgIV] kinematics follow the large scale rotating velocity field of these galaxies and the broad [MgIV] profiles are compatible with the broad wings detected in the H recombination lines. Based on these observational results, extended highly ionized gas more turbulent than the ambient interstellar medium, possibly as a result of ionizing shocks associated with star-formation, is the most likely origin of the [MgIV] emission. We also computed new grids of photoionization and shock models to investigate where the [MgIV] line originates. Shocks with velocities of 100-130 km/s reproduce the observed line ratios and the [MgIV] luminosity agrees with that expected from the mechanical energy released by supernove (SNe) in these regions. Therefore, these models support shocks induced by SNe as the origin of the [MgIV] line. Future studies on the stellar feedback from SNe will benefit from the [MgIV] line that is little affected by obscuration and, in absence of an AGN, can only be produced by shocks due to its high ionization potential.


title: Gaussian free field and Liouville quantum gravity

abstract: Over fourty years ago, the physicist Polyakov proposed a bold framework for string theory, in which the problem was reduced to the study of certain "random surfaces". He further made the tantalising suggestion that this theory could be explicitly solved. Recent breakthroughs from the last fifteen years have not only given a concrete mathematical basis for this theory but also verified some of its most striking predictions, as well as Polyakov's original vision. This theory, now known in the mathematics literature either as Liouville quantum gravity or Liouville conformal field theory, is based on a remarkable combination of ideas coming from different fields, above all probability and geometry. This book is intended to be an introduction to these developments assuming as few prerequisites as possible.


title: Subadditivity of shifts, Eilenberg-Zilber shuffle products and homology of lattices

abstract: We show that the maximal shifts in the minimal free resolution of the quotients of a polynomial ring by a monomial ideal are subadditive as a function of the homological degree. This answers a question that has received some attention in recent years. To do so, we define and study a new model for the homology of posets, given by the so called synor complex. We also introduce an Eilenberg-Zilber type shuffle product on the simplicial chain complex of lattices. Combining these concepts we prove that the existence of a non-zero homology class for a lattice forces certain non-zero homology classes in lower intervals. This result then translates into properties of the minimal free resolution. In particular, it implies a generalization of the original question.


title: Explanations in Everyday Software Systems: Towards a Taxonomy for Explainability Needs

abstract: Modern software systems are becoming increasingly complex and opaque. The integration of explanations within software has shown the potential to address this opacity and can make the system more understandable to end-users. As a result, explainability has gained much traction as a non-functional requirement of complex systems. Understanding what type of system requires what types of explanations is necessary to facilitate the inclusion of explainability in early software design processes. In order to specify explainability requirements, an explainability taxonomy that applies to a variety of different software types is needed. In this paper, we present the results of an online survey with 84 participants. We asked the participants to state their questions and confusions concerning their three most recently used software systems and elicited both explicit and implicit explainability needs from their statements. These needs were coded by three researchers. In total, we identified and classified 315 explainability needs from the survey answers. Drawing from a large pool of explainability needs and our coding procedure, we present two major contributions of this work: 1) a taxonomy for explainability needs in everyday software systems and 2) an overview of how the need for explanations differs between different types of software systems.


title: Tele-FLM Technical Report

abstract: Large language models (LLMs) have showcased profound capabilities in language understanding and generation, facilitating a wide array of applications. However, there is a notable paucity of detailed, open-sourced methodologies on efficiently scaling LLMs beyond 50 billion parameters with minimum trial-and-error cost and computational resources. In this report, we introduce Tele-FLM (aka FLM-2), a 52B open-sourced multilingual large language model that features a stable, efficient pre-training paradigm and enhanced factual judgment capabilities. Tele-FLM demonstrates superior multilingual language modeling abilities, measured by BPB on textual corpus. Besides, in both English and Chinese foundation model evaluation, it is comparable to strong open-sourced models that involve larger pre-training FLOPs, such as Llama2-70B and DeepSeek-67B. In addition to the model weights, we share the core designs, engineering practices, and training details, which we expect to benefit both the academic and industrial communities.


title: Improving TAS Adaptability with a Variable Temperature Threshold

abstract: Thermal-Aware Scheduling (TAS) provides methods to manage the thermal dissipation of a computing chip during task execution. These methods aim to avoid issues such as accelerated aging of the device, premature failure and degraded chip performance. In this work, we implement a new TAS algorithm, VTF-TAS, which makes use of a variable temperature threshold to control task execution and thermal dissipation. To enable adequate execution of the tasks to reach their deadlines, this threshold is managed based on the theory of fluid scheduling. Using an evaluation methodology as described in POD-TAS, we evaluate VTF-TAS using a set of 4 benchmarks from the COMBS benchmark suite to examine its ability to minimize chip temperature throughout schedule execution. Through our evaluation, we demonstrate that this new algorithm is able to adaptively manage the temperature threshold such that the peak temperature during schedule execution is lower than POD-TAS, with no requirement for an expensive search procedure to obtain an optimal threshold for scheduling.


title: Application of RESNET50 Convolution Neural Network for the Extraction of Optical Parameters in Scattering Media

abstract: Estimation of the optical properties of scattering media such as tissue is important in diagnostics as well as in the development of techniques to image deeper. As light penetrates the sample scattering events occur that alter the propagation direction of the photons in a random manner leading degradation of image quality. The distribution of the scattered light does, however, give a measure of the optical properties such as the reduced scattering coefficient and the absorption coefficient. Unfortunately, inverting scattering patterns to recover the optical properties is not simple, especially in the regime where the light is partially randomized. Machine learning has been proposed by several authors as a means of recovering these properties from either the back scattered or the transmitted light. In the present paper, we train a general purpose convolutional neural network RESNET 50 with simulated data based on Monte Carlo simulations. We show that compared with previous work our approach gives comparable or better reconstruction accuracy with training on a much smaller dataset. Moreover, by training on multiple parameters such as the intensity distribution at multiple planes or the exit angle and spatial distribution one achieves improved performance compared to training on a single input such as the intensity distribution captured at the sample surface. While our approach gives good parameter reconstruction, we identify factors that limit the accuracy of the recovered properties, particularly the absorption coefficient. In the light of these limitations, we suggest how the present approach may be enhanced for even better performance.


title: Comparison of adaptive mesh refinement techniques for numerical weather prediction

abstract: This paper examines the application of adaptive mesh refinement (AMR) in the field of numerical weather prediction (NWP). We implement and assess two distinct AMR approaches and evaluate their performance through standard NWP benchmarks. In both cases, we solve the fully compressible Euler equations, fundamental to many non-hydrostatic weather models. The first approach utilizes oct-tree cell-based mesh refinement coupled with a high-order discontinuous Galerkin method for spatial discretization. In the second approach, we employ level-based AMR with the finite difference method. Our study provides insights into the accuracy and benefits of employing these AMR methodologies for the multi-scale problem of NWP. Additionally, we explore essential properties including their impact on mass and energy conservation. Moreover, we present and evaluate an AMR solution transfer strategy for the tree-based AMR approach that is simple to implement, memory-efficient, and ensures conservation for both flow in the box and sphere. Furthermore, we discuss scalability, performance portability, and the practical utility of the AMR methodology within an NWP framework -- crucial considerations in selecting an AMR approach. The current de facto standard for mesh refinement in NWP employs a relatively simplistic approach of static nested grids, either within a general circulation model or a separately operated regional model with loose one-way synchronization. It is our hope that this study will stimulate further interest in the adoption of AMR frameworks like AMReX in NWP. These frameworks offer a triple advantage: a robust dynamic AMR for tracking localized and consequential features such as tropical cyclones, extreme scalability, and performance portability.


title: Kalman-based approaches for online estimation of bioreactor dynamics from fluorescent reporter measurements

abstract: We address online estimation of microbial growth dynamics in bioreactors from measurements of a fluorescent reporter protein synthesized along with microbial growth. We consider an extended version of standard growth models that accounts for the dynamics of reporter synthesis. We develop state estimation from sampled, noisy measurements in the cases of known and unknown growth rate functions. Leveraging conservation laws and regularized estimation techniques, we reduce these nonlinear estimation problems to linear time-varying ones, and solve them via Kalman filtering. We establish convergence results in absence of noise and show performance on noisy data in simulation.


title: Design optimization of advanced tow-steered composites with manufacturing constraints

abstract: Tow steering technologies, such as Automated fiber placement, enable the fabrication of composite laminates with curvilinear fiber, tow, or tape paths. Designers may therefore tailor tow orientations locally according to the expected local stress state within a structure, such that strong and stiff orientations of the tow are (for example) optimized to provide maximal mechanical benefit. Tow path optimization can be an effective tool in automating this design process, yet has a tendency to create complex designs that may be challenging to manufacture. In the context of tow steering, these complexities can manifest in defects such as tow wrinkling, gaps, overlaps. In this work, we implement manufacturing constraints within the tow path optimization formulation to restrict the minimum tow turning radius and the maximum density of gaps between and overlaps of tows. This is achieved by bounding the local value of the curl and divergence of the vector field associated with the tow orientations. The resulting local constraints are effectively enforced in the optimization framework through the Augmented Lagrangian method. The resulting optimization methodology is demonstrated by designing 2D and 3D structures with optimized tow orientation paths that maximize stiffness (minimize compliance) considering various levels of manufacturing restrictions. The optimized tow paths are shown to be structurally efficient and to respect imposed manufacturing constraints. As expected, the more geometrical complexity that can be achieved by the feedstock tow and placement technology, the higher the stiffness of the resulting optimized design.


title: Evolutionary Large Language Models for Hardware Security: A Comparative Survey

abstract: Automating hardware (HW) security vulnerability detection and mitigation during the design phase is imperative for two reasons: (i) It must be before chip fabrication, as post-fabrication fixes can be costly or even impractical; (ii) The size and complexity of modern HW raise concerns about unknown vulnerabilities compromising CIA triad. While Large Language Models (LLMs) can revolutionize both HW design and testing processes, within the semiconductor context, LLMs can be harnessed to automatically rectify security-relevant vulnerabilities inherent in HW designs. This study explores the seeds of LLM integration in register transfer level (RTL) designs, focusing on their capacity for autonomously resolving security-related vulnerabilities. The analysis involves comparing methodologies, assessing scalability, interpretability, and identifying future research directions. Potential areas for exploration include developing specialized LLM architectures for HW security tasks and enhancing model performance with domain-specific knowledge, leading to reliable automated security measurement and risk mitigation associated with HW vulnerabilities.


title: Obstruction classes for moduli spaces of sheaves and Lagrangian fibrations

abstract: We investigate obstruction classes of moduli spaces of sheaves on K3 surfaces. We extend previous results by Caldararu, explicitly determining the obstruction class and its order in the Brauer group. Our main theorem establishes a short exact sequence relating the Brauer group of the moduli space to that of the underlying K3 surface. This provides a criterion for when the moduli space is fine, generalising well-known results for K3 surfaces. Additionally, we explore applications to Ogg-Shafarevich theory for Beauville-Mukai systems. Furthermore, we investigate birational equivalences of Beauville-Mukai systems on elliptic K3 surfaces, presenting a complete characterisation of such equivalences.


title: An\'alise de ambiguidade lingu\'istica em modelos de linguagem de grande escala (LLMs)

abstract: Linguistic ambiguity continues to represent a significant challenge for natural language processing (NLP) systems, notwithstanding the advancements in architectures such as Transformers and BERT. Inspired by the recent success of instructional models like ChatGPT and Gemini (In 2023, the artificial intelligence was called Bard.), this study aims to analyze and discuss linguistic ambiguity within these models, focusing on three types prevalent in Brazilian Portuguese: semantic, syntactic, and lexical ambiguity. We create a corpus comprising 120 sentences, both ambiguous and unambiguous, for classification, explanation, and disambiguation. The models capability to generate ambiguous sentences was also explored by soliciting sets of sentences for each type of ambiguity. The results underwent qualitative analysis, drawing on recognized linguistic references, and quantitative assessment based on the accuracy of the responses obtained. It was evidenced that even the most sophisticated models, such as ChatGPT and Gemini, exhibit errors and deficiencies in their responses, with explanations often providing inconsistent. Furthermore, the accuracy peaked at 49.58 percent, indicating the need for descriptive studies for supervised learning.


title: Two-state transfer: a generalization of pair and plus state transfer

abstract: In the study of quantum state transfer, one is interested in being able to transmit a quantum state with high fidelity within a quantum spin network. In most of the literature, the state of interest is taken to be associated with a standard basis vector; however, more general states have recently been considered. Here, we consider a general linear combination of two vertex states, which encompasses the definitions of pair states and plus states in connected weighted graphs. A two-state in a graph $X$ is a quantum state of the form $\mathbf{e}_u+s\mathbf{e}_v$, where $u$ and $v$ are two vertices in $X$ and $s$ is a non-zero real number. If $s=-1$ or $s=1$, then such a state is called a pair state or a plus state, respectively. In this paper, we investigate quantum state transfer between two-states, where the Hamiltonian is taken to be the adjacency, Laplacian or signless Laplacian matrix of the graph. By analyzing the spectral properties of the Hamiltonian, we characterize strongly cospectral two-states built from strongly cospectral vertices. This allows us to characterize perfect state transfer (PST) between two-states in complete graphs, cycles and hypercubes. We also produce infinite families of graphs that admit strong cospectrality and PST between two-states that are neither pair nor plus states. Using singular values and singular vectors, we show that vertex PST in the line graph of $X$ implies PST between the plus states formed by corresponding edges in $X$. Furthermore, we provide conditions such that the converse of the previous statement holds. As an application, we characterize strong cospectrality and PST between vertices in line graphs of trees, unicyclic graphs and Cartesian products.


title: Rational Designing of Anthocyanidins-Directed Near-Infrared Two-Photon Fluorescence Probes

abstract: Recently, two-photon fluorescent probes based on anthocyanidins molecules have attracted extensive attention due to their outstanding photophysical properties. However, there are only a few two-photon excited fluorescent probes that really meet the requirements of relatively long emission wavelengths (>600 nm), large two-photon absorption (TPA) cross sections (300 GM), significant Stokes shift (>80 nm), and high fluorescence intensity. Herein, the photophysical properties of a series of anthocyanidins with the same substituents but different fluorophore skeletons were investigated in detail. Compared with b-series molecules, a-series molecules with a six-membered ring in the backbone have a slightly higher reorganization energy. This results in more energy loss upon light excitation, enabling the reaction products to detect NTR through a larger Stokes shift. More importantly, there is very little decrease in fluorescence intensity as the Stokes shift increases. These features are extremely valuable for high-resolution NTR detection. In light of this, novel 2a-n (n=1-5) compounds are designed, which are accomplished by inhibiting the twisted intramolecular charge transfer (TICT) effect through alkyl cyclization, azetidine ring and extending {\pi} conjugation. Among them, 2a-3 gains long emission spectrum ({\lambda}em=691.42 nm), noticeable TPA cross section (957.36 GM), and large Stokes shift (110.88 nm), indicating that it serves as a promising candidate for two-photon fluorescent dyes. It is hoped that this work will offer some insightful theoretical direction for the development of novel high performance anthocyanin fluorescent materials.


title: A Self-Organizing Clustering System for Unsupervised Distribution Shift Detection

abstract: Modeling non-stationary data is a challenging problem in the field of continual learning, and data distribution shifts may result in negative consequences on the performance of a machine learning model. Classic learning tools are often vulnerable to perturbations of the input covariates, and are sensitive to outliers and noise, and some tools are based on rigid algebraic assumptions. Distribution shifts are frequently occurring due to changes in raw materials for production, seasonality, a different user base, or even adversarial attacks. Therefore, there is a need for more effective distribution shift detection techniques. In this work, we propose a continual learning framework for monitoring and detecting distribution changes. We explore the problem in a latent space generated by a bio-inspired self-organizing clustering and statistical aspects of the latent space. In particular, we investigate the projections made by two topology-preserving maps: the Self-Organizing Map and the Scale Invariant Map. Our method can be applied in both a supervised and an unsupervised context. We construct the assessment of changes in the data distribution as a comparison of Gaussian signals, making the proposed method fast and robust. We compare it to other unsupervised techniques, specifically Principal Component Analysis (PCA) and Kernel-PCA. Our comparison involves conducting experiments using sequences of images (based on MNIST and injected shifts with adversarial samples), chemical sensor measurements, and the environmental variable related to ozone levels. The empirical study reveals the potential of the proposed approach.


title: $p$-adic Hodge parameters in the crystabelline representations of $\mathrm{GL}_3(\mathbb{Q}_p)$

abstract: We build a one-to-one correspondence between $3$-dimensional (generic) crystabelline representations of the absolute Galois group of $\mathbb{Q}_p$ and certain locally analytic representations of $\mathrm{GL}_3(\mathbb{Q}_p)$. We show that the correspondence can be realized in subspaces of $p$-adic automorphic representations.


title: Inferring solid-state diffusivity in lithium-ion battery active materials: improving upon the classical GITT method

abstract: The Galvanostatic Intermittent Titration Technique (GITT) is a ubiquitous method for determining the solid-state diffusivity in lithium-ion battery materials. However, it is notoriously time-consuming and relies upon assumptions whose applicability is questionable. We propose a novel methodology that allows inference of the diffusivity for a more general class of data that is simpler and faster to harvest. We infer the diffusivity (as a function of stoichiometry) by minimising the residual sum of squares between data and solutions to a spherically-symmetric diffusion model in a single representative active material particle. Using data harvested from the NMC cathode of a commercial LG M50 cell we first demonstrate that our method is able to reproduce the diffusivities inferred by the GITT, which requires ten days of galvanostatic intermittent titration data. We then demonstrate that our method reliably reconstructs diffusivity using significantly less data. Despite arising from quick-to-measure data, our method more accurately infers diffusivities. This work is a contribution towards developing faster and more reliable techniques in parameter inference for lithium-ion batteries.


title: ProbGate at EHRSQL 2024: Enhancing SQL Query Generation Accuracy through Probabilistic Threshold Filtering and Error Handling

abstract: Recently, deep learning-based language models have significantly enhanced text-to-SQL tasks, with promising applications in retrieving patient records within the medical domain. One notable challenge in such applications is discerning unanswerable queries. Through fine-tuning model, we demonstrate the feasibility of converting medical record inquiries into SQL queries. Additionally, we introduce an entropy-based method to identify and filter out unanswerable results. We further enhance result quality by filtering low-confidence SQL through log probability-based distribution, while grammatical and schema errors are mitigated by executing queries on the actual database. We experimentally verified that our method can filter unanswerable questions, which can be widely utilized even when the parameters of the model are not accessible, and that it can be effectively utilized in practice.


title: Benchmarking Mobile Device Control Agents across Diverse Configurations

abstract: Developing autonomous agents for mobile devices can significantly enhance user interactions by offering increased efficiency and accessibility. However, despite the growing interest in mobile device control agents, the absence of a commonly adopted benchmark makes it challenging to quantify scientific progress in this area. In this work, we introduce B-MoCA: a novel benchmark designed specifically for evaluating mobile device control agents. To create a realistic benchmark, we develop B-MoCA based on the Android operating system and define 60 common daily tasks. Importantly, we incorporate a randomization feature that changes various aspects of mobile devices, including user interface layouts and language settings, to assess generalization performance. We benchmark diverse agents, including agents employing large language models (LLMs) or multi-modal LLMs as well as agents trained from scratch using human expert demonstrations. While these agents demonstrate proficiency in executing straightforward tasks, their poor performance on complex tasks highlights significant opportunities for future research to enhance their effectiveness. Our source code is publicly available at https://b-moca.github.io.


title: Time-domain analysis of multi-waveband flares from AD Leonis

abstract: Radio bursts of magnetically active stars reveal the intensity and activity of the stellar magnetic field. They may also be related to the planets around the stars. We monitored a radio-active star, AD Leonis, 3000 seconds per day for 17 days in November 2020, and 5000 seconds per day for 5 days in July 2023 with the Five-hundred-meter Aperture Spherical radio Telescope (FAST). Based on the simultaneous flux increases in Stokes I and Stokes V, one left-hand circular polarized radio burst is identified. The $\sim50\%$ degree of circular polarization indicates the burst being originated from non-thermal radiation related to the stellar magnetic field. Combining the newly discovered burst with previous observations of radio and X-ray bursts from AD Leonis, we did a periodicity analysis for the 49 bursts in total. No periodicity with confidence level $>3\sigma$ is found, while a candidate period of 3.04 days at $\approx 2\sigma$ confidence level is presented and discussed. Results of recent FAST observations and the periodicity analysis suggest a more compact campaign of observation toward this source, from which a more optimistic result of period search could be achieved.


title: Computing Hamiltonian Paths with Partial Order Restrictions

abstract: When solving the Hamiltonian path problem it seems natural to be given additional precedence constraints for the order in which the vertices are visited. For example one could decide whether a Hamiltonian path exists for a fixed starting point, or that some vertices are visited before another vertex. We consider the problem of finding a Hamiltonian path that observes all precedence constraints given in a partial order on the vertex set. We show that this problem is $\mathsf{NP}$-complete even if restricted to complete bipartite graphs and posets of height 2. In contrast, for posets of width $k$ there is an $\mathcal{O}(k^2 n^k)$ algorithm for arbitrary graphs with $n$ vertices. We show that it is unlikely that the running time of this algorithm can be improved significantly, i.e., there is no $f(k) n^{o(k)}$ time algorithm under the assumption of the Exponential Time Hypothesis. Furthermore, for the class of outerplanar graphs, we give an $\mathcal{O}(n^2)$ algorithm for arbitrary posets.


title: Formal Specification, Assessment, and Enforcement of Fairness for Generative AIs

abstract: Reinforcing or even exacerbating societal biases and inequalities will increase significantly as generative AI increasingly produces useful artifacts, from text to images and beyond, for the real world. We address these issues by formally characterizing the notion of fairness for generative AI as a basis for monitoring and enforcing fairness. We define two levels of fairness using the notion of infinite sequences of abstractions of AI-generated artifacts such as text or images. The first is the fairness demonstrated on the generated sequences, which is evaluated only on the outputs while agnostic to the prompts and models used. The second is the inherent fairness of the generative AI model, which requires that fairness be manifested when input prompts are neutral, that is, they do not explicitly instruct the generative AI to produce a particular type of output. We also study relative intersectional fairness to counteract the combinatorial explosion of fairness when considering multiple categories together with lazy fairness enforcement. Finally, fairness monitoring and enforcement are tested against some current generative AI models.


title: Lu.i -- A low-cost electronic neuron for education and outreach

abstract: With an increasing presence of science throughout all parts of society, there is a rising expectation for researchers to effectively communicate their work and, equally, for teachers to discuss contemporary findings in their classrooms. While the community can resort to an established set of teaching aids for the fundamental concepts of most natural sciences, there is a need for similarly illustrative experiments and demonstrators in neuroscience. We therefore introduce Lu.i: a parametrizable electronic implementation of the leaky-integrate-and-fire neuron model in an engaging form factor. These palm-sized neurons can be used to visualize and experience the dynamics of individual cells and small spiking neural networks. When stimulated with real or simulated sensory input, Lu.i demonstrates brain-inspired information processing in the hands of a student. As such, it is actively used at workshops, in classrooms, and for science communication. As a versatile tool for teaching and outreach, Lu.i nurtures the comprehension of neuroscience research and neuromorphic engineering among future generations of scientists and in the general public.


title: A new way of deriving implicit Runge-Kutta methods based on repeated integrals

abstract: Runge-Kutta methods have an irreplaceable position among numerical methods designed to solve ordinary differential equations. Especially, implicit ones are suitable for approximating solutions of stiff initial value problems. We propose a new way of deriving coefficients of implicit Runge-Kutta methods. This approach based on repeated integrals yields both new and well-known Butcher's tableaux. We discuss the properties of newly derived methods and compare them with standard collocation implicit Runge-Kutta methods in a series of numerical experiments. In particular, we observe higher accuracy and higher experimental order of convergence of some newly derived methods.


title: PhyRecon: Physically Plausible Neural Scene Reconstruction

abstract: Neural implicit representations have gained popularity in multi-view 3D reconstruction. However, most previous work struggles to yield physically plausible results, limiting their utility in domains requiring rigorous physical accuracy, such as embodied AI and robotics. This lack of plausibility stems from the absence of physics modeling in existing methods and their inability to recover intricate geometrical structures. In this paper, we introduce PhyRecon, the first approach to leverage both differentiable rendering and differentiable physics simulation to learn implicit surface representations. PhyRecon features a novel differentiable particle-based physical simulator built on neural implicit representations. Central to this design is an efficient transformation between SDF-based implicit representations and explicit surface points via our proposed Surface Points Marching Cubes (SP-MC), enabling differentiable learning with both rendering and physical losses. Additionally, PhyRecon models both rendering and physical uncertainty to identify and compensate for inconsistent and inaccurate monocular geometric priors. This physical uncertainty further facilitates a novel physics-guided pixel sampling to enhance the learning of slender structures. By integrating these techniques, our model supports differentiable joint modeling of appearance, geometry, and physics. Extensive experiments demonstrate that PhyRecon significantly outperforms all state-of-the-art methods. Our results also exhibit superior physical stability in physical simulators, with at least a 40% improvement across all datasets, paving the way for future physics-based applications.


title: Simulation of depth-dose curves and water equivalent ratios of energetic proton beams in cortical bone

abstract: We have determined the depth-dose curve, the penetration range, and the water equivalent ratio (WER), for proton beams of clinical energies in cortical bone, by means of a detailed and accurate simulation that combines molecular dynamics and Monte Carlo techniques. The fundamental input quantities (stopping power and energy loss straggling) for the simulation were obtained from a reliable electronic excitation spectrum of the condensed-phase target, which takes into account the organic and mineral phases that form it. Our simulations with these inputs, that are in excellent agreement with the scarce data available for a cortical bone target, deviate from simulations performed using other stopping quantities, such as those provided in the widely used ICRU Report 49. The results of this work emphasize the importance of an accurate determination of the stopping quantities of cortical bone in order to advance towards the millimetric precision for the proton penetration ranges and deposited dose needed in radiotherapy.


title: The First Estimation of the Ambipolar Diffusivity Coefficient from Multi-Scale Observations of the Class 0/I Protostar, HOPS-370

abstract: Protostars are born in magnetized environments. As a consequence, the formation of protostellar disks can be suppressed by the magnetic field efficiently removing angular momentum of the infalling material. Non-ideal MHD effects are proposed to as one way to allow protostellar disks to form. Thus, it is important to understand their contributions in observations of protostellar systems. We derive an analytical equation to estimate the ambipolar diffusivity coefficient at the edge of the protostellar disk in the Class 0/I protostar, HOPS-370, for the first time, under the assumption that the disk radius is set by ambipolar diffusion. Using previous results of the protostellar mass, disk mass, disk radius, density and temperature profiles and magnetic field strength, we estimate the ambipolar diffusivity coefficient to be $1.7^{+1.5}_{-1.4}\times10^{19}\,\mathrm{cm^{2}\,s^{-1}}$. We quantify the contribution of ambipolar diffusion by estimating its dimensionless Els\"{a}sser number to be $\sim1.7^{+1.0}_{-1.0}$, indicating its dynamical importance in this region. We compare to chemical calculations of the ambipolar diffusivity coefficient using the Non-Ideal magnetohydrodynamics Coefficients and Ionisation Library (NICIL), which is consistent with our results. In addition, we compare our derived ambipolar diffusivity coefficient to the diffusivity coefficients for Ohmic dissipation and the Hall effect, and find ambipolar diffusion is dominant in our density regime. These results demonstrate a new methodology to understand non-ideal MHD effects in observations of protostellar disks. More detailed modeling of the magnetic field, envelope and microphysics, along with a larger sample of protostellar systems is needed to further understand the contributions of non-ideal MHD.


title: A candidate period of 4.605 day for FRB 20121102A and one possible implication of its origin

abstract: A firm establishment of the presence or the lack of periodicity in repeating Fast Radio Bursts (FRBs) is crucial for determining their origins. Here we compile 1145 radio bursts of FRB 20121102A with fluence larger than 0.15 Jy ms from observations using the Five-hundredmeter Aperture Spherical radio Telescope, Arecibo Observatory, Green Bank Telescope, Effelsberg Telescope, MeerKAT Telescope, Lovell Telescope, Deep Space Network 70 m radio telescopes, Very Large Array, and the Westerbork Synthesis Radio Telescope spanning the time interval of MJD 57175-58776. A quasi-period of $157.1_{-4.8}^{+5.2}$ day and a candidate quasi-period of $4.605_{-0.010}^{+0.003}$ day are found through the phase-folding probability binomial analysis. The former is consistent with previous findings and the latter is new. The 4.605 day periodicity is more obvious in high-energy bursts with fluence larger than $10^{38}$ erg. The presence of these (candidate) quasi-periods, together with the corresponding width of burst accumulation in the phase space, are consistent with the bursts' originating from a binary degenerate star system with a close-by planet around the primary neutron star.


title: EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning

abstract: Visual Instruction Tuning represents a novel learning paradigm involving the fine-tuning of pre-trained language models using task-specific instructions. This paradigm shows promising zero-shot results in various natural language processing tasks but is still unexplored in vision emotion understanding. In this work, we focus on enhancing the model's proficiency in understanding and adhering to instructions related to emotional contexts. Initially, we identify key visual clues critical to visual emotion recognition. Subsequently, we introduce a novel GPT-assisted pipeline for generating emotion visual instruction data, effectively addressing the scarcity of annotated instruction data in this domain. Expanding on the groundwork established by InstructBLIP, our proposed EmoVIT architecture incorporates emotion-specific instruction data, leveraging the powerful capabilities of Large Language Models to enhance performance. Through extensive experiments, our model showcases its proficiency in emotion classification, adeptness in affective reasoning, and competence in comprehending humor. The comparative analysis provides a robust benchmark for Emotion Visual Instruction Tuning in the era of LLMs, providing valuable insights and opening avenues for future exploration in this domain. Our code is available at \url{https://github.com/aimmemotion/EmoVIT}.


title: Magnetic Resonance Frequency Shift Caused by Nonuniform Field and Boundary Relaxation

abstract: Magnetic field inhomogeneity is usually detrimental to magnetic resonance (MR) experiments. It is widely recognized that a nonuniform magnetic field can lead to an increase in the resonance line width, as well as a reduction in sensitivity and spectral resolution. However, nonuniform magnetic field can also cause shift in resonance frequency, which received far less attention. In this work, we investigate the frequency shift under arbitrary nonuniform magnetic field and boundary relaxation by applying perturbation theory to the Torrey equation. Several compact frequency shift formulas are reported. We find that the frequency shift is mainly determined by $B_z$ distribution (rather than the transverse field components in previous study) and has important dependence on boundary relaxation. Furthermore, due to the difference of boundary relaxation and high order perturbation correction, this frequency shift is spin-species dependent, which implies a systematic error in many MR based precision measurements such as NMR gyroscope and comagnetometers. This insight provides a potential tool for understanding the unexplained isotope shifts in recent NMR gyroscope and new physics searching experiments that utilize comagnetometers. Finally, we propose a new tool for wall interaction research based on the frequency shift's dependency on boundary relaxation.


title: RUMOR: Reinforcement learning for Understanding a Model of the Real World for Navigation in Dynamic Environments

abstract: Autonomous navigation in dynamic environments is a complex but essential task for autonomous robots, with recent deep reinforcement learning approaches showing promising results. However, the complexity of the real world makes it infeasible to train agents in every possible scenario configuration. Moreover, existing methods typically overlook factors such as robot kinodynamic constraints, or assume perfect knowledge of the environment. In this work, we present RUMOR, a novel planner for differential-drive robots that uses deep reinforcement learning to navigate in highly dynamic environments. Unlike other end-to-end DRL planners, it uses a descriptive robocentric velocity space model to extract the dynamic environment information, enhancing training effectiveness and scenario interpretation. Additionally, we propose an action space that inherently considers robot kinodynamics and train it in a simulator that reproduces the real world problematic aspects, reducing the gap between the reality and simulation. We extensively compare RUMOR with other state-of-the-art approaches, demonstrating a better performance, and provide a detailed analysis of the results. Finally, we validate RUMOR's performance in real-world settings by deploying it on a ground robot. Our experiments, conducted in crowded scenarios and unseen environments, confirm the algorithm's robustness and transferability.


title: Illuminating Black Hole Shadow with Dark Matter Annihilation

abstract: The Event Horizon Telescope (EHT) has revolutionized our ability to study black holes by providing unprecedented spatial resolution and unveiling horizon-scale details. With advancements leading to the next-generation EHT, there is potential to probe even deeper into the black hole's dark region, especially the inner shadow characterized by low-intensity foreground emissions from the jet, thanks to a significant enhancement in dynamic range by two orders of magnitude. We demonstrate how such enhanced observations could transform supermassive black holes into powerful probes for detecting annihilating dark matter, which can form a dense profile in the vicinity of supermassive black holes, by examining the morphology of the black hole image.


title: Thermodynamic Properties, Shadows and Geodesic Motions of Quantum Corrected Spherically Symmetric AdS Black Hole with Phantom Global Monopoles

abstract: In this paper, we introduce a metric ansatz for describing spherically symmetric quantum corrected black hole (BH) space-time within an AdS background, incorporating both ordinary and phantom global monopoles. Afterwards, we focus into the thermodynamic properties of this BH, calculating essential parameters such as the Hawking temperature and the specific heat capacity. Moving forward, we analyze the effective potential of the system for both null and time-like geodesics, as well as the shadow radius of the BH. Additionally, we compute the emission rate of particles from this BH. Finally, we explore the geodesic equations of motion and visualize the trajectories of massive particles within the BH. Throughout our investigation, we examine how the presence of ordinary and phantom global monopoles, alongside the quantum corrected parameter, influences various thermal properties, the effective potential of the system, the BH shadow radius, energy emission rate, and the trajectories of massive particles. Importantly, through the generation of figures depicting these phenomena, we highlight the distinctions between results obtained with ordinary global monopoles and phantom ones, across a range of quantum corrected parameter values considering small values of the energy scale parameter.


title: Operator realizations of non-commutative analytic functions

abstract: A realization or linearization is a triple, $(A,b,c)$, consisting of a $d-$tuple, $A= (A _1, \cdots, A_d )$, $d\in \mathbb{N}$, of bounded linear operators on a separable, complex Hilbert space, $\mathcal{H}$, and vectors $b,c \in \mathcal{H}$. Any such realization defines a (uniformly) analytic non-commutative (NC) function in an open neighbourhood of the origin, $0:= (0, \cdots , 0)$, of the NC universe of $d-$tuples of square matrices of any fixed size via the formula $h(X) = I \otimes b^* ( I \otimes I _{\mathcal{H}} - \sum X_j \otimes A_j ) ^{-1} I \otimes c$. It is well-known that an NC function has a finite-dimensional realization if and only if it is a non-commutative rational function that is defined at $0$. Such finite realizations contain valuable information about the NC rational functions they generate. By considering more general, infinite-dimensional realizations we study, construct and characterize more general classes of uniformly analytic NC functions. In particular, we show that an NC function, $h$, is (uniformly) entire, if and only if it has a jointly compact and quasinilpotent realization. Restricting our results to one variable shows that an analytic Taylor-MacLaurin series extends globally to an entire or meromorphic function if and only if it has a realization whose component operator is compact and quasinilpotent, or compact, respectively. This then motivates our definition of the set of global uniformly meromorphic NC functions as the (universal) skew field (of fractions) generated by NC rational expressions in the (semi-free ideal) ring of NC functions with jointly compact realizations.


title: Multilayer Correlation Clustering

abstract: In this paper, we establish Multilayer Correlation Clustering, a novel generalization of Correlation Clustering (Bansal et al., FOCS '02) to the multilayer setting. In this model, we are given a series of inputs of Correlation Clustering (called layers) over the common set $V$. The goal is then to find a clustering of $V$ that minimizes the $\ell_p$-norm ($p\geq 1$) of the disagreements vector, which is defined as the vector (with dimension equal to the number of layers), each element of which represents the disagreements of the clustering on the corresponding layer. For this generalization, we first design an $O(L\log n)$-approximation algorithm, where $L$ is the number of layers, based on the well-known region growing technique. We then study an important special case of our problem, namely the problem with the probability constraint. For this case, we first give an $(\alpha+2)$-approximation algorithm, where $\alpha$ is any possible approximation ratio for the single-layer counterpart. For instance, we can take $\alpha=2.5$ in general (Ailon et al., JACM '08) and $\alpha=1.73+\epsilon$ for the unweighted case (Cohen-Addad et al., FOCS '23). Furthermore, we design a $4$-approximation algorithm, which improves the above approximation ratio of $\alpha+2=4.5$ for the general probability-constraint case. Computational experiments using real-world datasets demonstrate the effectiveness of our proposed algorithms.


title: The azimuthal distribution of ejecta mass from oblique impacts into sand

abstract: We measure ejecta mass as a function of azimuthal and impact angle for 104 m/s oblique impacts into sand. We find that the ejecta mass distribution is strongly sensitive to azimuthal angle with up to 8 times more mass in ejecta on the downrange side compared to the uprange side. Crater radii, measured from the site of impact, are measured at different impact and azimuthal angles. Crater ejecta scaling laws are modified to depend on azimuthal and impact angle. We find that crater radii are sensitive to both impact and azimuthal angle but the ejecta mass as a function of both angles can be estimated from the cube of the crater radius without an additional angular dependent function. The ejecta distributions are relevant for processes that depend upon the integrated properties of intermediate velocity impacts occurring in the outer solar system and possibly during planetesimal formation.


title: Multimodal Semantic-Aware Automatic Colorization with Diffusion Prior

abstract: Colorizing grayscale images offers an engaging visual experience. Existing automatic colorization methods often fail to generate satisfactory results due to incorrect semantic colors and unsaturated colors. In this work, we propose an automatic colorization pipeline to overcome these challenges. We leverage the extraordinary generative ability of the diffusion prior to synthesize color with plausible semantics. To overcome the artifacts introduced by the diffusion prior, we apply the luminance conditional guidance. Moreover, we adopt multimodal high-level semantic priors to help the model understand the image content and deliver saturated colors. Besides, a luminance-aware decoder is designed to restore details and enhance overall visual quality. The proposed pipeline synthesizes saturated colors while maintaining plausible semantics. Experiments indicate that our proposed method considers both diversity and fidelity, surpassing previous methods in terms of perceptual realism and gain most human preference.


title: Martin boundary of a space-time Brownian motion with drift killed at the boundary of a moving cone

abstract: We study a space-time Brownian motion with drift B(t)=(t_0+t,y_0+W(t)+t) killed at the moving boundary of the cone {(t,x):0<x<t}. This article determines the parabolic Martin boundary and all harmonic functions associated with this process. To that end, the asymptotics of Green's functions are determined along all directions. We also find the exit probabilities at the edges, the probability of remaining in the cone forever and the laws of the exit point and exit time. From this, we derive an explicit formula for the transition kernel of the process. These results arise from two different methods initially introduced to study random walks. An analytical approach, developed in the 1970s by Malyshev and based on the steepest descent method on a Riemann surface, is used to determine the asymptotics of the Green's functions. A recursive compensation approach, inspired by the method developed in the 1990s by Adan, Wessels and Zijm, is used to determine the harmonic functions.


title: Unrevealing the existence of nontensorial gravitational-wave polarizations from individual supermassive black hole binaries with pulsar timing arrays

abstract: With the strong evidence for a gravitational wave (GW) background in the nanohertz frequency band from pulsar timing arrays, the detection of continuous GWs from individual supermassive black hole binaries is already at the dawn. Utilizing continuous GWs to test theories of gravity, especially to test the polarizations of GWs is becoming more and more realistic. In this theoretical study, assuming a detection of signals from individual supermassive binary black holes, we use the null stream to estimate the capability of identifying the nontensorial polarizations of GWs. We consider cases for the nontensorial polarizations where the dipole radiation and quadrupole radiation dominate separately. With a frequentist method, we estimate the threshold of the nontensor-to-tensor relative amplitude above which extra polarizations can be detected. We also conduct Bayesian analysis to do parameter estimation with the null stream data. Our treatment provides a data-analysis methodology using the null stream to probe the nontensorial GW polarizations with pulsar timing arrays.


title: An obstruction theory for strictly commutative algebras in positive characteristic

abstract: This is the first in a sequence of articles exploring the relationship between commutative algebras and $E_\infty$-algebras in characteristic $p$ and mixed characteristic. In this paper we lay the groundwork by defining a new class of cohomology operations over $\mathbb F_p$ called cotriple products, generalising Massey products. We compute the secondary cohomology operations for a strictly commutative dg-algebra and the obstruction theories these induce, constructing several counterexamples to characteristic 0 behaviour, one of which answers a question of Campos, Petersen, Robert-Nicoud and Wierstra. We construct some families of higher cotriple products and comment on their behaviour. Finally, we distingush a subclass of cotriple products that we call higher Steenrod operations and conclude with our main theorem, which says that $E_\infty$-algebras can be rectified if and only if the higher Steenrod operations vanish coherently.


title: The magnetization process of classical Heisenberg magnets with non-coplanar cuboc ground states

abstract: We consider a classical Heisenberg model on the kagom\'{e} and the square kagom\'{e} lattice, where at zero magnetic field non-coplanar cuboctahedral ground states with twelve sublattices exist if suitable exchange couplings are introduced between the other neighbors. Such 'cuboc ground states' are remarkable because they allow for chiral ordering. For these models, we discuss the magnetization process in an applied magnetic field $H$ by both numerical and analytical methods. We find some universal properties that are present in all models. The magnetization curve $M(H)$ usually contains only non-linear components and there is at least one magnetic field driven phase transition. Details of the $M(H)$ curve such as the number and characteristics (continuous or discontinuous) of the phase transitions depend on the lattice and the details of the exchange between the further neighbors. Typical features of these magnetization processes can already be derived for a paradigmatic 12 spin model that we define in this work.


title: Observation of intra-unit-cell superconductivity modulation

abstract: In unconventional high-temperature (high-Tc) superconductors, the symmetry-breaking electronic orders intertwined with the superconductivity provide important clues for understanding the nature of the unconventional pairing mechanism. Recently, an exotic superconducting order showing spatially periodic order parameter modulations and translational symmetry breaking, namely the pair density wave (PDW) state, has attracted broad attention. Without breaking translational symmetry, point group symmetry breaking may also induce superconductivity modulations on different atom sites within a single unit cell. However, the intra-unit-cell superconductivity modulation has never been carefully investigated before. Here, using scanning tunneling microscopy/spectroscopy, we report the observation of intra-unit-cell superconductivity modulations in the superconducting gap size and the coherence peak sharpness in monolayer high-Tc Fe(Te,Se) films epitaxially grown on SrTiO3(001) substrates. Further analysis shows that the maxima and minima in the superconductivity modulation are centered at the crystallographic locations of the Te/Se atoms, revealing the breaking of the glide-mirror symmetry of the Te/Se atoms in monolayer high-Tc Fe(Te,Se) films grown on SrTiO3(001). Our findings provide precise microscopic information of superconductivity within the lattice unit cell and indicate that the p-orbital electrons of the Te/Se atoms also play an important role in Cooper pairing in unconventional high-Tc iron-based superconductors.


title: Monolithic two-level Schwarz preconditioner for Biot's consolidation model in two space dimensions

abstract: This paper addresses the construction and analysis of a class of domain decomposition methods for the iterative solution of the quasi-static Biot problem in three-field formulation. The considered discrete model arises from time discretization by the implicit Euler method and space discretization by a family of strongly mass-conserving methods exploiting $H^{div}$-conforming approximations of the solid displacement and fluid flux fields. For the resulting saddle-point problem, we construct monolithic overlapping domain decomposition (DD) methods whose analysis relies on a transformation into an equivalent symmetric positive definite system and on stable decompositions of the involved finite element spaces under proper problem-dependent norms. Numerical results on two-dimensional test problems are in accordance with the provided theoretical uniform convergence estimates for the two-level multiplicative Schwarz method.


title: Multi-scale HSV Color Feature Embedding for High-fidelity NIR-to-RGB Spectrum Translation

abstract: The NIR-to-RGB spectral domain translation is a formidable task due to the inherent spectral mapping ambiguities within NIR inputs and RGB outputs. Thus, existing methods fail to reconcile the tension between maintaining texture detail fidelity and achieving diverse color variations. In this paper, we propose a Multi-scale HSV Color Feature Embedding Network (MCFNet) that decomposes the mapping process into three sub-tasks, including NIR texture maintenance, coarse geometry reconstruction, and RGB color prediction. Thus, we propose three key modules for each corresponding sub-task: the Texture Preserving Block (TPB), the HSV Color Feature Embedding Module (HSV-CFEM), and the Geometry Reconstruction Module (GRM). These modules contribute to our MCFNet methodically tackling spectral translation through a series of escalating resolutions, progressively enriching images with color and texture fidelity in a scale-coherent fashion. The proposed MCFNet demonstrates substantial performance gains over the NIR image colorization task. Code is released at: https://github.com/AlexYangxx/MCFNet.


title: Calibrating non-parametric morphological indicators from {\it JWST} images for galaxies over $0.5<z<3$

abstract: The measurements of morphological indicators of galaxies are often influenced by a series of observational effects. In this study, we utilize a sample of over 800 TNG50 simulated galaxies with log($M_*$/M$_\odot$)$>9$ at $0.5<z<3$ to investigate the differences in non-parametric morphological indicators ($C$, $S$, $Gini$, $M_{\rm 20}$, $A_{\rm O}$, and $D_{\rm O}$) derived from noise-free and high-resolution TNG50 images and mock images simulated to have the same observational conditions as {\it JWST}/NIRCam. We quantify the relationship between intrinsic and observed values of the morphological indicators and accordingly apply this calibration to over 4600 galaxies in the same stellar mass and redshift ranges observed in {\it JWST} CEERS and JADES surveys. We find a significant evolution of morphological indicators with rest-frame wavelength ($\lambda_{\rm rf}$) at $\lambda_{\rm rf}<1$\,$\mu$m, while essentially no obvious variations occur at $\lambda_{\rm rf}>1$\,$\mu$m. The morphological indicators of star-forming galaxies (SFGs) and quiescent galaxies (QGs) are significantly different. The morphologies of QGs exhibit a higher sensitivity to rest-frame wavelength than SFGs. After analyzing the evolution of morphological indicators in the rest-frame V-band (0.5-0.7\,$\mu$m) and rest-frame J-band (1.1-1.4\,$\mu$m), we find that the morphologies of QGs evolve substantially with both redshift and stellar mass. For SFGs, the $C$, $Gini$ and $M_{\rm 20}$ show a rapid evolution with stellar mass at log($M_*$/M$_\odot$)$\geq10.5$, while the $A_{\rm O}$, $D_{\rm O}$ and $A$ evolve with both redshift and stellar mass. Our comparison shows that TNG50 simulations effectively reproduce the morphological indicators we measured from {\it JWST} observations when the impact of dust attenuation is considered.


abstract: This paper reports on the NTIRE 2024 Quality Assessment of AI-Generated Content Challenge, which will be held in conjunction with the New Trends in Image Restoration and Enhancement Workshop (NTIRE) at CVPR 2024. This challenge is to address a major challenge in the field of image and video processing, namely, Image Quality Assessment (IQA) and Video Quality Assessment (VQA) for AI-Generated Content (AIGC). The challenge is divided into the image track and the video track. The image track uses the AIGIQA-20K, which contains 20,000 AI-Generated Images (AIGIs) generated by 15 popular generative models. The image track has a total of 318 registered participants. A total of 1,646 submissions are received in the development phase, and 221 submissions are received in the test phase. Finally, 16 participating teams submitted their models and fact sheets. The video track uses the T2VQA-DB, which contains 10,000 AI-Generated Videos (AIGVs) generated by 9 popular Text-to-Video (T2V) models. A total of 196 participants have registered in the video track. A total of 991 submissions are received in the development phase, and 185 submissions are received in the test phase. Finally, 12 participating teams submitted their models and fact sheets. Some methods have achieved better results than baseline methods, and the winning methods in both tracks have demonstrated superior prediction performance on AIGC.