title: A Survey on Query-based API Recommendation

abstract: Application Programming Interfaces (APIs) are designed to help developers build software more effectively. Recommending the right APIs for specific tasks has gained increasing attention among researchers and developers in recent years. To comprehensively understand this research domain, we have surveyed to analyze API recommendation studies published in the last 10 years. Our study begins with an overview of the structure of API recommendation tools. Subsequently, we systematically analyze prior research and pose four key research questions. For RQ1, we examine the volume of published papers and the venues in which these papers appear within the API recommendation field. In RQ2, we categorize and summarize the prevalent data sources and collection methods employed in API recommendation research. In RQ3, we explore the types of data and common data representations utilized by API recommendation approaches. We also investigate the typical data extraction procedures and collection approaches employed by the existing approaches. RQ4 delves into the modeling techniques employed by API recommendation approaches, encompassing both statistical and deep learning models. Additionally, we compile an overview of the prevalent ranking strategies and evaluation metrics used for assessing API recommendation tools. Drawing from our survey findings, we identify current challenges in API recommendation research that warrant further exploration, along with potential avenues for future research.


title: Can Offline A/B Testing Be Automated for Data-Driven Requirement Engineering?

abstract: Online A/B testing has been widely used by software companies to evaluate the impact of new technologies by offering it to a groups of users and comparing against the unmodified product. However, running online A/B testing needs not only efforts in design, implementation and stakeholders' approval to be served in production, but also several weeks to collect the data in iterations. To address these issues, a recent emerging topic, called \textit{offline A/B testing}, is getting increasing attention, with the goal to conduct offline evaluation of a new technology by estimating historical logged data. Although this approach is promising due to lower implementation effort, faster turnaround time and no potential user harm, for it to be effectively prioritized as requirements in practice, several limitations need to be addressed, including its discrepancy with online A/B test results, and lack of systematic updates on new data. In response, in this vision paper, we introduce AutoOffAB, an idea to automatically runs variants of offline A/B testing against recent logging and update the offline evaluation results, which are used to make decisions on requirements more reliably and systematically.


title: Skein valued cluster transformation in enumerative geometry of Legendrian mutation

abstract: Under certain hypotheses, we show that Legendrian surfaces related by disk surgery will have q-deformed augmentation spaces that are related by q-deformed cluster transformation. The proof is geometric, via considerations of moduli of holomorphic curves. In fact, our results naturally give a more general HOMFLYPT "skein-valued cluster transformation", of which the q-cluster transformation is the U(1) specialization. We apply our methods to the Legendrians associated to cubic planar graphs, where mutation of graphs lifts to Legendrian disk surgery. We show that their skein-valued mirrors transform by skein-valued cluster transformation, and give a formula for the skein-valued curve counts on their fillings.


title: Decoding Concerns: Multi-label Classification of Vaccine Sentiments in Social Media

abstract: In the realm of public health, vaccination stands as the cornerstone for mitigating disease risks and controlling their proliferation. The recent COVID-19 pandemic has highlighted how vaccines play a crucial role in keeping us safe. However the situation involves a mix of perspectives, with skepticism towards vaccines prevailing for various reasons such as political dynamics, apprehensions about side effects, and more. The paper addresses the challenge of comprehensively understanding and categorizing these diverse concerns expressed in the context of vaccination. Our focus is on developing a robust multi-label classifier capable of assigning specific concern labels to tweets based on the articulated apprehensions towards vaccines. To achieve this, we delve into the application of a diverse set of advanced natural language processing techniques and machine learning algorithms including transformer models like BERT, state of the art GPT 3.5, Classifier Chains & traditional methods like SVM, Random Forest, Naive Bayes. We see that the cutting-edge large language model outperforms all other methods in this context.


title: A note on the spaces of Eisenstein series on general congruence subgroups of $\text{Sl}_2(\mathbb{Z})$

abstract: We construct bases for the spaces of Eisenstein series of weight $\geq 2$ attached to the congruence subgroups of $\text{Sl}_2(\mathbb{Z})$. The basis elements admit an explicit description in terms of Eisenstein series on a principal level contained in the congruence subgroup and possess a natural parameterization by the cusps of the transpose of the corresponding subgroup. To address the sign problem intrinsic to the series of odd weights we introduce a refinement of the notion of regularity of cusps. These arguments also yield an elementary proof of the standard dimension formula for the spaces of Eisenstein series of weight $\geq 3$. The article is expository and we explicitly work out the theory for $\Gamma_{1}(N)$ and $\Gamma_{0}(N)$.


title: T2M-HiFiGPT: Generating High Quality Human Motion from Textual Descriptions with Residual Discrete Representations

abstract: In this study, we introduce T2M-HiFiGPT, a novel conditional generative framework for synthesizing human motion from textual descriptions. This framework is underpinned by a Residual Vector Quantized Variational AutoEncoder (RVQ-VAE) and a double-tier Generative Pretrained Transformer (GPT) architecture. We demonstrate that our CNN-based RVQ-VAE is capable of producing highly accurate 2D temporal-residual discrete motion representations. Our proposed double-tier GPT structure comprises a temporal GPT and a residual GPT. The temporal GPT efficiently condenses information from previous frames and textual descriptions into a 1D context vector. This vector then serves as a context prompt for the residual GPT, which generates the final residual discrete indices. These indices are subsequently transformed back into motion data by the RVQ-VAE decoder. To mitigate the exposure bias issue, we employ straightforward code corruption techniques for RVQ and a conditional dropout strategy, resulting in enhanced synthesis performance. Remarkably, T2M-HiFiGPT not only simplifies the generative process but also surpasses existing methods in both performance and parameter efficacy, including the latest diffusion-based and GPT-based models. On the HumanML3D and KIT-ML datasets, our framework achieves exceptional results across nearly all primary metrics. We further validate the efficacy of our framework through comprehensive ablation studies on the HumanML3D dataset, examining the contribution of each component. Our findings reveal that RVQ-VAE is more adept at capturing precise 3D human motion with comparable computational demand compared to its VQ-VAE counterparts. As a result, T2M-HiFiGPT enables the generation of human motion with significantly increased accuracy, outperforming recent state-of-the-art approaches such as T2M-GPT and Att-T2M.


title: Effective String Theories (EST) of Yang-Mills Flux Tubes

abstract: This chapter explains the concept of \emph{Effective String Theories}(EST), and their success in explaining the results that Yang-Mills flux tubes behave, to a high degree of accuracy, like Bosonic Strings(BST). It describes EST's of L\"uscher and Weisz, and their principal conclusions. It then discusses the Polchinski-Strominger EST's. which are valid in all dimensions. It then describes the works by Drummond, and, the author and Peter Matlock, which extended the analysis to $R^{-3}$ order and showed, that even at that order the spectrum is that of BST. The chapter analyses the issues of string momentum in higher orders. It discusses at length the powerful covariant calculus, to systematically construct EST's to arbitrary orders. The most general actions to $R^{-7}$ order are shown to be governed by just two parameters. The works of Aharony and collaborators on the spectrum of EST's, both in static and conformal gauges,to $R^{-5}$ order, and their results that even at that order the ground state energy remains the same as that of BST, but the excited spectrum gets corrected for $D\,>\,3$, are explained. It discusses the simulation results for excited states. It also discusses the AdS-CFT approaches and thickness of flux tubes.Recent works by Ambjorn, Makeenko, and Sedrakyan on the path-integral approaches to this issue are also discussed and compared with the other approaches. It concludes with remarks on the significance of the results for QCD.


title: A multiwavelength study of spiral structure in galaxies. II. Spiral arms in deep optical observations

abstract: In this paper, we look to analyse the spiral features of grand-design, multiarmed, and flocculent spiral galaxies using deep optical imaging from DESI Legacy Imaging Surveys. We explore the resulting distributions of various characteristics of spiral structure beyond the optical radius, such as the distributions of azimuthal angle, the extent of spiral arms, and of the spiral arm widths for the aforementioned galaxy classes. We also compare the measured properties for isolated galaxies and galaxies in groups and clusters. We find that, on average, compared to multiarmed and flocculent spiral galaxies, the spiral arms of grand-design galaxies exhibit slightly larger azimuthal angles, greater extent, and larger widths in the periphery of the galaxy. Furthermore, on average, isolated galaxies tend to have slightly smaller widths of outer spiral arms compared to galaxies in tight environments, which is likely related to the tidally-induced mechanism for generating wider outer spiral arms. We also report that breaks of the disc surface brightness profiles are often related to the truncation of spiral arms in galaxies.


title: LLM-Twin: Mini-Giant Model-driven Beyond 5G Digital Twin Networking Framework with Semantic Secure Communication and Computation

abstract: Beyond 5G networks provide solutions for next-generation communications, especially digital twins networks (DTNs) have gained increasing popularity for bridging physical space and digital space. However, current DTNs networking frameworks pose a number of challenges especially when applied in scenarios that require high communication efficiency and multimodal data processing. First, current DTNs frameworks are unavoidable regarding high resource consumption and communication congestion because of original bit-level communication and high-frequency computation, especially distributed learning-based DTNs. Second, current machine learning models for DTNs are domain-specific (e.g. E-health), making it difficult to handle DT scenarios with multimodal data processing requirements. Last but not least, current security schemes for DTNs, such as blockchain, introduce additional overheads that impair the efficiency of DTNs. To address the above challenges, we propose a large language model (LLM) empowered DTNs networking framework, LLM-Twin. First, we design the mini-giant model collaboration scheme to achieve efficient deployment of LLM in DTNs, since LLM are naturally conducive to processing multimodal data. Then, we design a semantic-level high-efficiency, and secure communication model for DTNs. The feasibility of LLM-Twin is demonstrated by numerical experiments and case studies. To our knowledge, this is the first to propose LLM-based semantic-level digital twin networking framework.


title: Dosimetric calibration of an anatomically specific ultra-high dose rate electron irradiation platform for preclinical FLASH radiobiology experiments

abstract: We characterized the dosimetric properties of a clinical linear accelerator configured to deliver ultra-high dose rate (UHDR) irradiation to mice and cell-culture FLASH radiobiology experiments. UHDR electron beams were controlled by a microcontroller and relay interfaced with the respiratory gating system. We produced beam collimators with indexed stereotactic mouse positioning devices to provide anatomically specific preclinical treatments. Treatment delivery was monitored directly with an ionization chamber, and charge measurements were correlated with radiochromic film at the entry surface of the mice. The setup for conventional (CONV) dose rate irradiation was similar but the source-to-surface distance was longer. Monte Carlo simulations and film dosimetry were used to characterize beam properties and dose distributions. The mean electron beam energies before the flattening filter were 18.8 MeV (UHDR) and 17.7 MeV (CONV), with corresponding values at the mouse surface of 17.2 MeV and 16.2 MeV. The charges measured with an external ion chamber were linearly correlated with the mouse entrance dose. Use of relay gating for pulse control initially led to a delivery failure rate of 20% ($+/-$ 1 pulse); adjustments to account for the linac latency improved this rate to <1/20. Beam field sizes for two anatomically specific mouse collimators (4x4 $cm^2$ for whole-abdomen and 1.5x1.5 $cm^2$ for unilateral lung irradiation) were accurate within <5% and had low radiation leakage (<4%). Normalizing the dose at the center of the mouse (~0.75 cm depth) produced UHDR and CONV doses to the irradiated volumes with >95% agreement. We successfully configured a clinical linear accelerator for increased output and developed a robust preclinical platform for anatomically specific irradiation, with highly accurate and precise temporal and spatial dose delivery, for both CONV and UHDR applications.


title: Some Ideas for Improving Stock Price Prediction Based on Machine Learning

abstract: Stock price prediction is a complicated and interesting task. Noisy trends make stock pricing sensitive and complicated while the economical motivation behind, keeps it interesting for researchers and investors. In this paper we are to outline two novel ideas for stock pricing. We also test each of our suggested algorithms for predicting the price of 6 stocks from different sectors. To show the efficiency of our proposed algorithm, we compare the predicted prices with real values and also perform a backtest to verify that the annual returns based on real data and predicted price are almost the same.


title: Anomaly Score: Evaluating Generative Models and Individual Generated Images based on Complexity and Vulnerability

abstract: With the advancement of generative models, the assessment of generated images becomes more and more important. Previous methods measure distances between features of reference and generated images from trained vision models. In this paper, we conduct an extensive investigation into the relationship between the representation space and input space around generated images. We first propose two measures related to the presence of unnatural elements within images: complexity, which indicates how non-linear the representation space is, and vulnerability, which is related to how easily the extracted feature changes by adversarial input changes. Based on these, we introduce a new metric to evaluating image-generative models called anomaly score (AS). Moreover, we propose AS-i (anomaly score for individual images) that can effectively evaluate generated images individually. Experimental results demonstrate the validity of the proposed approach.


title: Risk-Constrained Reinforcement Learning for Inverter-Dominated Power System Controls

abstract: This paper develops a risk-aware controller for grid-forming inverters (GFMs) to minimize large frequency oscillations in GFM inverter-dominated power systems. To tackle the high variability from loads/renewables, we incorporate a mean-variance risk constraint into the classical linear quadratic regulator (LQR) formulation for this problem. The risk constraint aims to bound the time-averaged cost of state variability and thus can improve the worst-case performance for large disturbances. The resulting risk-constrained LQR problem is solved through the dual reformulation to a minimax problem, by using a reinforcement learning (RL) method termed as stochastic gradient-descent with max-oracle (SGDmax). In particular, the zero-order policy gradient (ZOPG) approach is used to simplify the gradient estimation using simulated system trajectories. Numerical tests conducted on the IEEE 68-bus system have validated the convergence of our proposed SGDmax for GFM model and corroborate the effectiveness of the risk constraint in improving the worst-case performance while reducing the variability of the overall control cost.


title: Graft: Efficient Inference Serving for Hybrid Deep Learning with SLO Guarantees via DNN Re-alignment

abstract: Deep neural networks (DNNs) have been widely adopted for various mobile inference tasks, yet their ever-increasing computational demands are hindering their deployment on resource-constrained mobile devices. Hybrid deep learning partitions a DNN into two parts and deploys them across the mobile device and a server, aiming to reduce inference latency or prolong battery life of mobile devices. However, such partitioning produces (non-uniform) DNN fragments which are hard to serve efficiently on the server.This paper presents Graft -- an efficient inference serving system for hybrid deep learning with latency service-level objective (SLO) guarantees. Our main insight is to mitigate the non-uniformity by a core concept called DNN re-alignment, allowing multiple heterogeneous DNN fragments to be restructured to share layers. To fully exploit the potential of DNN re-alignment, Graft employs fine-grained GPU resource sharing. Based on that, we propose efficient algorithms for merging, grouping, and re-aligning DNN fragments to maximize request batching opportunities, minimizing resource consumption while guaranteeing the inference latency SLO. We implement a Graft prototype and perform extensive experiments with five types of widely used DNNs and real-world network traces. Our results show that Graft improves resource efficiency by up to 70% compared with the state-of-the-art inference serving systems.


title: An Evaluation of GPT-4V and Gemini in Online VQA

abstract: While there is much excitement about the potential of large multimodal models (LMM), a comprehensive evaluation is critical to establish their true capabilities and limitations. In support of this aim, we evaluate two state-of-the-art LMMs, GPT-4V and Gemini, on a new visual question answering dataset sourced from an authentic online question answering community. We conduct fine-grained analysis by generating seven types of metadata for nearly 2,000 visual questions, such as image type and the required image processing capabilities. Our zero-shot performance analysis highlights the types of questions that are most challenging for both models, including questions related to "puzzling" topic, with "Identification" user intention, with "Sheet Music" image type, or labeled as "hard" by GPT-4.


title: HyperPIE: Hyperparameter Information Extraction from Scientific Publications

abstract: Automatic extraction of information from publications is key to making scientific knowledge machine readable at a large scale. The extracted information can, for example, facilitate academic search, decision making, and knowledge graph construction. An important type of information not covered by existing approaches is hyperparameters. In this paper, we formalize and tackle hyperparameter information extraction (HyperPIE) as an entity recognition and relation extraction task. We create a labeled data set covering publications from a variety of computer science disciplines. Using this data set, we train and evaluate BERT-based fine-tuned models as well as five large language models: GPT-3.5, GALACTICA, Falcon, Vicuna, and WizardLM. For fine-tuned models, we develop a relation extraction approach that achieves an improvement of 29% F1 over a state-of-the-art baseline. For large language models, we develop an approach leveraging YAML output for structured data extraction, which achieves an average improvement of 5.5% F1 in entity recognition over using JSON. With our best performing model we extract hyperparameter information from a large number of unannotated papers, and analyze patterns across disciplines. All our data and source code is publicly available at https://github.com/IllDepence/hyperpie


title: Artificial intelligence optical hardware empowers high-resolution hyperspectral video understanding at 1.2 Tb/s

abstract: Foundation models, exemplified by GPT technology, are discovering new horizons in artificial intelligence by executing tasks beyond their designers' expectations. While the present generation provides fundamental advances in understanding language and images, the next frontier is video comprehension. Progress in this area must overcome the 1 Tb/s data rate demanded to grasp real-time multidimensional video information. This speed limit lies well beyond the capabilities of the existing generation of hardware, imposing a roadblock to further advances. This work introduces a hardware-accelerated integrated optoelectronic platform for multidimensional video understanding in real-time. The technology platform combines artificial intelligence hardware, processing information optically, with state-of-the-art machine vision networks, resulting in a data processing speed of 1.2 Tb/s with hundreds of frequency bands and megapixel spatial resolution at video rates. Such performance, validated in the AI tasks of video semantic segmentation and object understanding in indoor and aerial applications, surpasses the speed of the closest technologies with similar spectral resolution by three to four orders of magnitude. This platform opens up new avenues for research in real-time AI video understanding of multidimensional visual information, helping the empowerment of future human-machine interactions and cognitive processing developments.


title: Inverse design of coherent supercontinuum generation using free-form nanophotonic waveguides

abstract: Many key functionalities of optical frequency combs such as self-referencing and broad spectral access rely on coherent supercontinuum generation (SCG). While nanophotonic waveguides have emerged as a compact and power-efficient platform for SCG, their geometric degrees of freedom have not been fully utilized due to the underlying nonlinear and stochastic physics. Here, we introduce inverse design to unlock free-form waveguides for coherent SCG. The efficacy of our design is numerically and experimentally demonstrated on Si3N4 waveguides, producing flat and coherent spectra from visible to mid-infrared wavelengths. Our work has direct applications in developing chip-based broadband light sources for spectroscopy, metrology, and sensing across multiple spectral regimes.


title: Beamforming Design for Integrated Sensing and Communication with Extended Target

abstract: This paper studies transmit beamforming design in an integrated sensing and communication (ISAC) system, where a base station sends symbols to perform downlink multi-user communication and sense an extended target simultaneously. We first model the extended target contour with truncated Fourier series. By considering echo signals as reflections from the valid elements on the target contour, a novel Cram\'er-Rao bound (CRB) on the direction estimation of extended target is derived. We then formulate the transmit beamforming design as an optimization problem by minimizing the CRB of radar sensing, and satisfying a minimum signal-to-interference-plus-noise ratio requirement for each communication user, as well as a 3-dB beam coverage requirement tailored for the extended sensing target under a total transmit power constraint. In view of the non-convexity of the above problem, we employ semidefinite relaxation (SDR) technique for convex relaxation, followed by a rank-one extraction scheme for non-tight relaxation circumstances. Numerical results show that the proposed SDR beamforming scheme outperforms benchmark beampattern design methods with lower CRBs for the circumstances considered.


title: Episodic Return Decomposition by Difference of Implicitly Assigned Sub-Trajectory Reward

abstract: Real-world decision-making problems are usually accompanied by delayed rewards, which affects the sample efficiency of Reinforcement Learning, especially in the extremely delayed case where the only feedback is the episodic reward obtained at the end of an episode. Episodic return decomposition is a promising way to deal with the episodic-reward setting. Several corresponding algorithms have shown remarkable effectiveness of the learned step-wise proxy rewards from return decomposition. However, these existing methods lack either attribution or representation capacity, leading to inefficient decomposition in the case of long-term episodes. In this paper, we propose a novel episodic return decomposition method called Diaster (Difference of implicitly assigned sub-trajectory reward). Diaster decomposes any episodic reward into credits of two divided sub-trajectories at any cut point, and the step-wise proxy rewards come from differences in expectation. We theoretically and empirically verify that the decomposed proxy reward function can guide the policy to be nearly optimal. Experimental results show that our method outperforms previous state-of-the-art methods in terms of both sample efficiency and performance.


title: Signal significance incorporating systematic uncertainty for continuous test

abstract: To properly estimate signal significance while accounting for both statistical and systematic uncertainties, we conducted a study to analyze the impact of typical systematic uncertainties, such as background shape, signal shape, and the number of backgrounds, on significance calculation using the continuous test method. Our investigation reveals unexpected and complex features, leading us to recommend a conservative approach: one should estimate signal significance by conducting trials with as many as possible combinations of various uncertainties associated with the fitting procedure, and then select the "worst" outcome as the final result.


title: Hyperbolic problems with totally characteristic boundary

abstract: We study first-order symmetrizable hyperbolic $N\times N$ systems in a spacetime cylinder whose lateral boundary is totally characteristic. In local coordinates near the boundary at $x=0$, these systems take the form \[ \partial_t u + \mathcal A(t,x,y,xD_x,D_y) u = f(t,x,y), \quad (t,x,y)\in(0,T)\times\mathbb R_+\times\mathbb R^d, \] where $\mathcal A(t,x,y,xD_x,D_y)$ is a first-order differential operator with coefficients smooth up to $x=0$ and the derivative with respect to $x$ appears in the combination $xD_x$. No boundary conditions are required in such a situation and corresponding initial-boundary value problems are effectively Cauchy problems. We introduce a certain scale of Sobolev spaces with asymptotics and show that the Cauchy problem for the operator $\partial_t + \mathcal A(t,x,y,xD_x,D_y)$ is well-posed in that scale. More specifically, solutions $u$ exhibit formal asymptotic expansions of the form \[ u(t,x,y) \sim \sum_{(p,k)} \frac{(-1)^k}{k!} x^{-p} \log^k \!x \, u_{pk}(t,y) \quad \text{as $x\to+0$} \] where $(p,k)\in\mathbb C\times\mathbb N_0$ and $\Re p\to-\infty$ as $|p|\to\infty$, provided that the right-hand side $f$ and the initial data $u|_{t=0}$ admit asymptotic expansions as $x \to +0$ of a similar form, with the singular exponents $p$ and their multiplicities unchanged. In fact, the coefficient $u_{pk}$ are, in general, not regular enough to write the terms appearing in the asymptotic expansions as tensor products. This circumstance requires an additional analysis of the function spaces. In addition, we demonstrate that the coefficients $u_{pk}$ solve certain explicitly known first-order symmetrizable hyperbolic systems in the lateral boundary. Especially, it follows that the Cauchy problem for the operator $\partial_t+\mathcal A(t,x,y,xD_x,D_y)$ is well-posed in the scale of standard Sobolev spaces $H^s((0,T)\times\mathbb R_+^{1+d})$.


title: FedMKGC: Privacy-Preserving Federated Multilingual Knowledge Graph Completion

abstract: Knowledge graph completion (KGC) aims to predict missing facts in knowledge graphs (KGs), which is crucial as modern KGs remain largely incomplete. While training KGC models on multiple aligned KGs can improve performance, previous methods that rely on transferring raw data among KGs raise privacy concerns. To address this challenge, we propose a new federated learning framework that implicitly aggregates knowledge from multiple KGs without demanding raw data exchange and entity alignment. We treat each KG as a client that trains a local language model through textbased knowledge representation learning. A central server then aggregates the model weights from clients. As natural language provides a universal representation, the same knowledge thus has similar semantic representations across KGs. As such, the aggregated language model can leverage complementary knowledge from multilingual KGs without demanding raw user data sharing. Extensive experiments on a benchmark dataset demonstrate that our method substantially improves KGC on multilingual KGs, achieving comparable performance to state-of-the-art alignment-based models without requiring any labeled alignments or raw user data sharing. Our codes will be publicly available.


title: Some remarks on real algebraic maps which are topologically special generic maps and generalize the canonical projections of the unit spheres

abstract: Morse functions with exactly two singular points on homotopy spheres and canonical projections of spheres are generalized as special generic maps. A special generic map is, roughly, a smooth map represented as the composition of a smooth surjection onto a manifold whose preimages are diffeomorphic to a unit sphere in the interior of the manifold and single point sets on the boundary with a smooth immersion of codimension $0$. This paper constructs real algebraic maps topologically special generic maps whose images are smoothly embedded manifolds. We are also interested in construction of explicit and meaningful smooth maps in differential topology and recently ones in real algebraic geometry. This has been an important and difficult problem. In such stories, we have previously constructed real algebraic maps topologically regarded as special generic maps. This paper is a kind of additional short remark on such maps.


title: Single-Stage Optimization of Open-loop Stable Limit Cycles with Smooth, Symbolic Derivatives

abstract: Open-loop stable limit cycles are foundational to the dynamics of legged robots. They impart a self-stabilizing character to the robot's gait, thus alleviating the need for compute-heavy feedback-based gait correction. This paper proposes a general approach to rapidly generate limit cycles with explicit stability constraints for a given dynamical system. In particular, we pose the problem of open-loop limit cycle stability as a single-stage constrained-optimization problem (COP), and use Direct Collocation to transcribe it into a nonlinear program (NLP) with closed-form expressions for constraints, objectives, and their gradients. The COP formulations of stability are developed based (1) on the spectral radius of a discrete return map, and (2) on the spectral radius of the system's monodromy matrix, where the spectral radius is bounded using different constraint-satisfaction formulations of the eigenvalue problem. We compare the performance and solution qualities of each approach, but specifically highlight the Schur decomposition of the monodromy matrix as a formulation which boasts wider applicability through weaker assumptions and attractive numerical convergence properties. Moreover, we present results from our experiments on a spring-loaded inverted pendulum model of a robot, where our method generated actuation trajectories for open-loop stable hopping in under 2 seconds (on the Intel Core i7-6700K), and produced energy-minimizing actuation trajectories even under tight stability constraints.


title: Faithful Model Explanations through Energy-Constrained Conformal Counterfactuals

abstract: Counterfactual explanations offer an intuitive and straightforward way to explain black-box models and offer algorithmic recourse to individuals. To address the need for plausible explanations, existing work has primarily relied on surrogate models to learn how the input data is distributed. This effectively reallocates the task of learning realistic explanations for the data from the model itself to the surrogate. Consequently, the generated explanations may seem plausible to humans but need not necessarily describe the behaviour of the black-box model faithfully. We formalise this notion of faithfulness through the introduction of a tailored evaluation metric and propose a novel algorithmic framework for generating Energy-Constrained Conformal Counterfactuals that are only as plausible as the model permits. Through extensive empirical studies, we demonstrate that ECCCo reconciles the need for faithfulness and plausibility. In particular, we show that for models with gradient access, it is possible to achieve state-of-the-art performance without the need for surrogate models. To do so, our framework relies solely on properties defining the black-box model itself by leveraging recent advances in energy-based modelling and conformal prediction. To our knowledge, this is the first venture in this direction for generating faithful counterfactual explanations. Thus, we anticipate that ECCCo can serve as a baseline for future research. We believe that our work opens avenues for researchers and practitioners seeking tools to better distinguish trustworthy from unreliable models.


title: PNeRFLoc: Visual Localization with Point-based Neural Radiance Fields

abstract: Due to the ability to synthesize high-quality novel views, Neural Radiance Fields (NeRF) have been recently exploited to improve visual localization in a known environment. However, the existing methods mostly utilize NeRFs for data augmentation to improve the regression model training, and the performance on novel viewpoints and appearances is still limited due to the lack of geometric constraints. In this paper, we propose a novel visual localization framework, \ie, PNeRFLoc, based on a unified point-based representation. On the one hand, PNeRFLoc supports the initial pose estimation by matching 2D and 3D feature points as traditional structure-based methods; on the other hand, it also enables pose refinement with novel view synthesis using rendering-based optimization. Specifically, we propose a novel feature adaption module to close the gaps between the features for visual localization and neural rendering. To improve the efficacy and efficiency of neural rendering-based optimization, we also develop an efficient rendering-based framework with a warping loss function. Furthermore, several robustness techniques are developed to handle illumination changes and dynamic objects for outdoor scenarios. Experiments demonstrate that PNeRFLoc performs the best on synthetic data when the NeRF model can be well learned and performs on par with the SOTA method on the visual localization benchmark datasets.


title: Towards Designing a Question-Answering Chatbot for Online News: Understanding Questions and Perspectives

abstract: Large Language Models (LLMs) have created opportunities for designing chatbots that can support complex question-answering (QA) scenarios and improve news audience engagement. However, we still lack an understanding of what roles journalists and readers deem fit for such a chatbot in newsrooms. To address this gap, we first interviewed six journalists to understand how they answer questions from readers currently and how they want to use a QA chatbot for this purpose. To understand how readers want to interact with a QA chatbot, we then conducted an online experiment (N=124) where we asked each participant to read three news articles and ask questions to either the author(s) of the articles or a chatbot. By combining results from the studies, we present alignments and discrepancies between how journalists and readers want to use QA chatbots and propose a framework for designing effective QA chatbots in newsrooms.


title: Gas Giant Simulations of Eddy-Driven Jets Accompanied by Deep Meridional Circulation

abstract: Jupiter's atmosphere comprises several dynamical regimes: the equatorial eastward flows and surrounding retrograde jets; the midlatitudes, with the eddy-driven, alternating jet-streams and meridional circulation cells; and the jet-free turbulent polar region. Despite intensive research conducted on each of these dynamical regimes over the past decades, they remain only partially understood. Saturn's atmosphere also encompasses similar distinguishable regimes, but observational evidence for midlatitude deep meridional cells is lacking. Models offer a variety of explanations for each of these regions, but only a few are capable of simulating more than one of the regimes at once. This study presents new numerical simulations using a 3D deep anelastic model that can reproduce the equatorial flows as well as the midlatitudinal pattern of the mostly barotropic, alternating eddy-driven jets and the meridional circulation cells accompanying them. These simulations are consistent with recent Juno mission gravity and microwave data. We find that the vertical eddy momentum fluxes are as important as the meridional eddy momentum fluxes, which drive the midlatitudinal circulation on Earth. In addition, we discuss the parameters controlling the number of midlatitudinal jets/cells, their extent, strength, and location. We identify the strong relationship between meridional circulation and the zonal jets in a deep convection setup, and analyze the mechanism responsible for their generation and maintenance. The analysis presented here provides another step in the ongoing pursuit of understanding the deep atmospheres of gas giants.


title: Explorers at #SMM4H 2023: Enhancing BERT for Health Applications through Knowledge and Model Fusion

abstract: An increasing number of individuals are willing to post states and opinions in social media, which has become a valuable data resource for studying human health. Furthermore, social media has been a crucial research point for healthcare now. This paper outlines the methods in our participation in the #SMM4H 2023 Shared Tasks, including data preprocessing, continual pre-training and fine-tuned optimization strategies. Especially for the Named Entity Recognition (NER) task, we utilize the model architecture named W2NER that effectively enhances the model generalization ability. Our method achieved first place in the Task 3. This paper has been peer-reviewed and accepted for presentation at the #SMM4H 2023 Workshop.


title: Stability Properties of Multi-Order Fractional Differential Systems in 3D

abstract: This paper is devoted to studying three-dimensional non-commensurate fractional order differential equation systems with Caputo derivatives. Necessary and sufficient conditions are for the asymptotic stability of such systems are obtained.


title: About the magnitude of the $\gamma^\ast N \to N(1520)$ transverse amplitudes near $Q^2=0$

abstract: The $\gamma^\ast N \to N(1520)$ transition has a property that differs from the other low-lying nucleon resonance amplitudes: the magnitude of the transverse helicity amplitudes.The transition helicity amplitudes are defined in terms of square-transfer momentum $q^2$, or $Q^2=-q^2$. Near the photon point ($Q^2=0$) there is a significant difference in the magnitude of the transverse amplitudes: $A_{3/2}$ is very large and $A_{1/2}$ is very small. This atypical behavior contrasts with the relation between the amplitudes at the pseudothreshold [the limit where the nucleon and the $N(1520)$ are both at rest and $Q^2 <0$], where $A_{3/2} = A_{1/2}/\sqrt{3}$, and also in the large-$Q^2$ region, where theory and data suggest that $A_{3/2}$ is suppressed relative to $A_{1/2}$. In the present work, we look for the source of the suppression of the $A_{1/2}$ amplitude at $Q^2=0$. The result is easy to understand in first approximation, when we look into the relation between the transverse amplitudes and the elementary form factors, defined by a gauge-invariant parametrization of the $\gamma^\ast N \to N(1520)$ transition current, near $Q^2=0$. There is a partial cancellation between contributions of two elementary form factors near $Q^2=0$. We conclude, however, that the correlation between the two elementary form factors at $Q^2=0$ is not sufficient to explain the transverse amplitude data below $Q^2 = 1$ GeV$^2$. The description of the dependence of the transverse amplitudes on $Q^2$ requires the determination of the scale of variation of the elementary form factors in the range $Q^2=0$...0.5 GeV$^2$,a region with almost non existent data. We conclude at the end that the low-$Q^2$ data for the transverse amplitudes can be well described when we relate the scale of variation of the elementary form factors with the nucleon dipole form factor.


title: Practical Non-Intrusive GUI Exploration Testing with Visual-based Robotic Arms

abstract: GUI testing is significant in the SE community. Most existing frameworks are intrusive and only support some specific platforms. With the development of distinct scenarios, diverse embedded systems or customized operating systems on different devices do not support existing intrusive GUI testing frameworks. Some approaches adopt robotic arms to replace the interface invoking of mobile apps under test and use computer vision technologies to identify GUI elements. However, some challenges are unsolved. First, existing approaches assume that GUI screens are fixed so that they cannot be adapted to diverse systems with different screen conditions. Second, existing approaches use XY-plane robotic arms, which cannot flexibly simulate testing operations. Third, existing approaches ignore compatibility bugs and only focus on crash bugs. A more practical approach is required for the non-intrusive scenario. We propose a practical non-intrusive GUI testing framework with visual robotic arms. RoboTest integrates novel GUI screen and widget detection algorithms, adaptive to detecting screens of different sizes and then to extracting GUI widgets from the detected screens. Then, a set of testing operations is applied with a 4-DOF robotic arm, which effectively and flexibly simulates human testing operations. During app exploration, RoboTest integrates the Principle of Proximity-guided exploration strategy, choosing close widgets of the previous targets to reduce robotic arm movement overhead and improve exploration efficiency. RoboTest can effectively detect some compatibility bugs beyond crash bugs with a GUI comparison on different devices of the same test operations. We evaluate RoboTest with 20 mobile apps, with a case study on an embedded system. The results show that RoboTest can effectively, efficiently, and generally explore AUTs to find bugs and reduce exploration time overhead.


title: VidToMe: Video Token Merging for Zero-Shot Video Editing

abstract: Diffusion models have made significant advances in generating high-quality images, but their application to video generation has remained challenging due to the complexity of temporal motion. Zero-shot video editing offers a solution by utilizing pre-trained image diffusion models to translate source videos into new ones. Nevertheless, existing methods struggle to maintain strict temporal consistency and efficient memory consumption. In this work, we propose a novel approach to enhance temporal consistency in generated videos by merging self-attention tokens across frames. By aligning and compressing temporally redundant tokens across frames, our method improves temporal coherence and reduces memory consumption in self-attention computations. The merging strategy matches and aligns tokens according to the temporal correspondence between frames, facilitating natural temporal consistency in generated video frames. To manage the complexity of video processing, we divide videos into chunks and develop intra-chunk local token merging and inter-chunk global token merging, ensuring both short-term video continuity and long-term content consistency. Our video editing approach seamlessly extends the advancements in image editing to video editing, rendering favorable results in temporal consistency over state-of-the-art methods.


title: UltraClean: A Simple Framework to Train Robust Neural Networks against Backdoor Attacks

abstract: Backdoor attacks are emerging threats to deep neural networks, which typically embed malicious behaviors into a victim model by injecting poisoned samples. Adversaries can activate the injected backdoor during inference by presenting the trigger on input images. Prior defensive methods have achieved remarkable success in countering dirty-label backdoor attacks where the labels of poisoned samples are often mislabeled. However, these approaches do not work for a recent new type of backdoor -- clean-label backdoor attacks that imperceptibly modify poisoned data and hold consistent labels. More complex and powerful algorithms are demanded to defend against such stealthy attacks. In this paper, we propose UltraClean, a general framework that simplifies the identification of poisoned samples and defends against both dirty-label and clean-label backdoor attacks. Given the fact that backdoor triggers introduce adversarial noise that intensifies in feed-forward propagation, UltraClean first generates two variants of training samples using off-the-shelf denoising functions. It then measures the susceptibility of training samples leveraging the error amplification effect in DNNs, which dilates the noise difference between the original image and denoised variants. Lastly, it filters out poisoned samples based on the susceptibility to thwart the backdoor implantation. Despite its simplicity, UltraClean achieves a superior detection rate across various datasets and significantly reduces the backdoor attack success rate while maintaining a decent model accuracy on clean data, outperforming existing defensive methods by a large margin. Code is available at https://github.com/bxz9200/UltraClean.


title: Description of Bhabha-scattering at small angles using the Monte Carlo generator ReneSANCe

abstract: Results of a simulation of Bhabha small-angle scattering process at center-of-mass energy of 240~GeV and at the $Z$-boson resonance using the Monte Carlo generator {\tt{ReneSANCe}} are presented. For the given accuracy about $10^{-4}$ in estimating luminosity of future electron-positron accelerators, the minimum cutoff angle for simulated events is established.


title: Flat bands, strange metals, and the Kondo effect

abstract: Flat band materials such as the kagome metals or moir\'e superlattice systems are of intense current interest. Flat bands can result from the electron motion on numerous (special) lattices and usually exhibit topological properties. Their reduced bandwidth proportionally enhances the effect of Coulomb interaction, even when the absolute magnitude of the latter is relatively small. Seemingly unrelated to these cases is the large family of strongly correlated electron systems, which includes the heavy fermion compounds, cuprate and pnictide superconductors. In addition to itinerant electrons from large, strongly overlapping orbitals, they frequently contain electrons from more localized orbitals, which are subject to a large Coulomb interaction. The question then arises as to what commonality in the physical properties and microscopic physics, if any, exists between the two broad categories of materials? A rapidly increasing body of strikingly similar phenomena across the different platforms -- from electronic localization-delocalization transitions to strange metal behavior and unconventional superconductivity -- suggests that similar underlying principles could be at play. Indeed, it has recently been suggested that flat band physics can be understood in terms of Kondo physics. Inversely, the concept of electronic topology from lattice symmetry, which is fundamental in flat band systems, is enriching the field of strongly correlated electron systems where correlation-driven topological phases are increasingly being investigated. Here we elucidate this connection, survey the new opportunities for cross-fertilization in understanding across the platforms, and assess the prospect for new insights that may be gained into both the correlation physics and its intersection with electronic topology.


title: Cryogenic hybrid magnonic circuits based on spalled YIG thin films

abstract: Yttrium iron garnet (YIG) magnonics has sparked extensive research interests toward harnessing magnons (quasiparticles of collective spin excitation) for signal processing. In particular, YIG magnonics-based hybrid systems exhibit great potentials for quantum information science because of their wide frequency tunability and excellent compatibility with other platforms. However, the broad application and scalability of thin-film YIG devices in the quantum regime has been severely limited due to the substantial microwave loss in the host substrate for YIG, gadolinium gallium garnet (GGG), at cryogenic temperatures. In this study, we demonstrate that substrate-free YIG thin films can be obtained by introducing the controlled spalling and layer transfer technology to YIG/GGG samples. Our approach is validated by measuring a hybrid device consisting of a superconducting resonator and a spalled YIG film, which gives a strong coupling feature indicating the good coherence of our system. This advancement paves the way for enhanced on-chip integration and the scalability of YIG-based quantum devices.


title: Wikiformer: Pre-training with Structured Information of Wikipedia for Ad-hoc Retrieval

abstract: With the development of deep learning and natural language processing techniques, pre-trained language models have been widely used to solve information retrieval (IR) problems. Benefiting from the pre-training and fine-tuning paradigm, these models achieve state-of-the-art performance. In previous works, plain texts in Wikipedia have been widely used in the pre-training stage. However, the rich structured information in Wikipedia, such as the titles, abstracts, hierarchical heading (multi-level title) structure, relationship between articles, references, hyperlink structures, and the writing organizations, has not been fully explored. In this paper, we devise four pre-training objectives tailored for IR tasks based on the structured knowledge of Wikipedia. Compared to existing pre-training methods, our approach can better capture the semantic knowledge in the training corpus by leveraging the human-edited structured data from Wikipedia. Experimental results on multiple IR benchmark datasets show the superior performance of our model in both zero-shot and fine-tuning settings compared to existing strong retrieval baselines. Besides, experimental results in biomedical and legal domains demonstrate that our approach achieves better performance in vertical domains compared to previous models, especially in scenarios where long text similarity matching is needed.


title: Jones Wenzl projectors in tensor products of a Verma module and irreducible modules

abstract: We construct special idempotents in $\mathrm{End}_{U_q(\mathfrak{sl}_2)}(M(\mu)\otimes V_1^{\otimes n})$ like the Jones Wenzl projector where $M(\mu)$ is Verma module whose highest weight is $\mu$ and $V_1$ is $2$-dimensional irreducible module.


title: Heuristics and Metaheuristics for Dynamic Management of Computing and Cooling Energy in Cloud Data Centers

abstract: Data centers handle impressive high figures in terms of energy consumption, and the growing popularity of Cloud applications is intensifying their computational demand. Moreover, the cooling needed to keep the servers within reliable thermal operating conditions also has an impact on the thermal distribution of the data room, thus affecting to servers' power leakage. Optimizing the energy consumption of these infrastructures is a major challenge to place data centers on a more scalable scenario. Thus, understanding the relationship between power, temperature, consolidation and performance is crucial to enable an energy-efficient management at the data center level. In this research, we propose novel power and thermal-aware strategies and models to provide joint cooling and computing optimizations from a local perspective based on the global energy consumption of metaheuristic-based optimizations. Our results show that the combined awareness from both metaheuristic and best fit decreasing algorithms allow us to describe the global energy into faster and lighter optimization strategies that may be used during runtime. This approach allows us to improve the energy efficiency of the data center, considering both computing and cooling infrastructures, in up to a 21.74\% while maintaining quality of service.


title: Nonadiabatic transitions during a passage near a critical point

abstract: The passage through a critical point of a many-body quantum system leads to abundant nonadiabatic excitations. Here, we explore a regime, in which the critical point is not crossed although the system is passing slowly very close to it. We show that the leading exponent for the excitation probability then can be obtained by standard arguments of the Dykhne formula but the exponential prefactor is no longer simple, and behaves as a power law on the characteristic transition rate. We derive this prefactor for the nonlinear Landau-Zener (nLZ) model by adjusting the Dykhne's approach. Then, we introduce an exactly solvable model of the transition near a critical point in the Stark ladder. We derive the number of the excitations for it without approximations, and find qualitatively similar results for the excitation scaling.


title: Silkie: Preference Distillation for Large Visual Language Models

abstract: This paper explores preference distillation for large vision language models (LVLMs), improving their ability to generate helpful and faithful responses anchoring the visual context. We first build a vision-language feedback (VLFeedback) dataset utilizing AI annotation. Specifically, responses are generated by models sampled from 12 LVLMs, conditioned on multi-modal instructions sourced from various datasets. We adopt GPT-4V to assess the generated outputs regarding helpfulness, visual faithfulness, and ethical considerations. Furthermore, the preference supervision is distilled into Qwen-VL-Chat through the direct preference optimization (DPO) method. The resulting model Silkie, achieves 6.9% and 9.5% relative improvement on the MME benchmark regarding the perception and cognition capabilities, respectively. Silkie also demonstrates reduced hallucination by setting a new state-of-the-art score of 3.02 on the MMHal-Bench benchmark. Further analysis shows that DPO with our VLFeedback dataset mainly boosts the fine-grained perception and complex cognition abilities of LVLMs, leading to more comprehensive improvements compared to human-annotated preference datasets.


title: CACTO-SL: Using Sobolev Learning to improve Continuous Actor-Critic with Trajectory Optimization

abstract: Trajectory Optimization (TO) and Reinforcement Learning (RL) are powerful and complementary tools to solve optimal control problems. On the one hand, TO can efficiently compute locally-optimal solutions, but it tends to get stuck in local minima if the problem is not convex. On the other hand, RL is typically less sensitive to non-convexity, but it requires a much higher computational effort. Recently, we have proposed CACTO (Continuous Actor-Critic with Trajectory Optimization), an algorithm that uses TO to guide the exploration of an actor-critic RL algorithm. In turns, the policy encoded by the actor is used to warm-start TO, closing the loop between TO and RL. In this work, we present an extension of CACTO exploiting the idea of Sobolev learning. To make the training of the critic network faster and more data efficient, we enrich it with the gradient of the Value function, computed via a backward pass of the differential dynamic programming algorithm. Our results show that the new algorithm is more efficient than the original CACTO, reducing the number of TO episodes by a factor ranging from 3 to 10, and consequently the computation time. Moreover, we show that CACTO-SL helps TO to find better minima and to produce more consistent results.


title: Beyond Wolstenholme's Theorem

abstract: Wolstenholme's type summations involve certain powers of all residues $k$ modulo some prime number $p$. We consider the sums of double or triple products of certain powers of all residues, e.g., the sums of the terms $(a+k)^m(b+k)^n$ or $(a+k)^m(b+k)^n(c+k)^s$ as $k$ ranges over all residues modulo $p$. We also consider the sums of double or triple ratios of such terms. We showed that each of such sums is congruent to some simpler expression involving certain binomial coefficients.


title: On a discrete approach to lower bounds in discrepancy theory

abstract: In the present paper we prove that some renowned lower bounds in discrepancy theory admit a discrete analogue. Namely, we prove that the lower bound of the discrepancy for corners in the unit cube due to Roth holds true also for a suitable finite family of corners. We also prove two analogous results for the discrepancy on the torus with respect to squares and balls.


title: Analisis Eksploratif Dan Augmentasi Data NSL-KDD Menggunakan Deep Generative Adversarial Networks Untuk Meningkatkan Performa Algoritma Extreme Gradient Boosting Dalam Klasifikasi Jenis Serangan Siber

abstract: This study proposes the implementation of Deep Generative Adversarial Networks (GANs) for augmenting the NSL-KDD dataset. The primary objective is to enhance the efficacy of eXtreme Gradient Boosting (XGBoost) in the classification of cyber-attacks on the NSL-KDD dataset. As a result, the method proposed in this research achieved an accuracy of 99.53% using the XGBoost model without data augmentation with GAN, and 99.78% with data augmentation using GAN.


title: On Solving General and Special Structure Medium-Scale MINLP Problems

abstract: Mixed integer nonlinear programming (MINLP) problems are encountered in modeling a physical/industrial process consisting both nonlinearity and discrete selective parameters. There are variety of algorithms for solving MINLP problems most of which solve large-scale MINLP problems very slowly. In this research two parallelization scheme are suggested for solving general and special structure large-scale MINLP problems satisfyingly fast. Special structure refers to problems in which a group of variables are appeared in the objective function and constraints and others are appeared in some constraints separately. Moreover, it is proved that both algorithms have at least R-linear convergence. To show the efficiency of algorithms, numerical test results are presented and compared to available GAMS solvers. According to the numerical results, in almost 80 percent of tests both algorithms compute the solution faster than the best solver in GAMS.


title: Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidance

abstract: We introduce Open3DIS, a novel solution designed to tackle the problem of Open-Vocabulary Instance Segmentation within 3D scenes. Objects within 3D environments exhibit diverse shapes, scales, and colors, making precise instance-level identification a challenging task. Recent advancements in Open-Vocabulary scene understanding have made significant strides in this area by employing class-agnostic 3D instance proposal networks for object localization and learning queryable features for each 3D mask. While these methods produce high-quality instance proposals, they struggle with identifying small-scale and geometrically ambiguous objects. The key idea of our method is a new module that aggregates 2D instance masks across frames and maps them to geometrically coherent point cloud regions as high-quality object proposals addressing the above limitations. These are then combined with 3D class-agnostic instance proposals to include a wide range of objects in the real world. To validate our approach, we conducted experiments on three prominent datasets, including ScanNet200, S3DIS, and Replica, demonstrating significant performance gains in segmenting objects with diverse categories over the state-of-the-art approaches.


title: Automatic Optimisation of Normalised Neural Networks

abstract: We propose automatic optimisation methods considering the geometry of matrix manifold for the normalised parameters of neural networks. Layerwise weight normalisation with respect to Frobenius norm is utilised to bound the Lipschitz constant and to enhance gradient reliability so that the trained networks are suitable for control applications. Our approach first initialises the network and normalises the data with respect to the $\ell^{2}$-$\ell^{2}$ gain of the initialised network. Then, the proposed algorithms take the update structure based on the exponential map on high-dimensional spheres. Given an update direction such as that of the negative Riemannian gradient, we propose two different ways to determine the stepsize for descent. The first algorithm utilises automatic differentiation of the objective function along the update curve defined on the combined manifold of spheres. The directional second-order derivative information can be utilised without requiring explicit construction of the Hessian. The second algorithm utilises the majorisation-minimisation framework via architecture-aware majorisation for neural networks. With these new developments, the proposed methods avoid manual tuning and scheduling of the learning rate, thus providing an automated pipeline for optimizing normalised neural networks.


title: What ultracold atoms tell us about the real-time dynamics of QCD in extreme conditions

abstract: I review developments of how compact table-top setups with ultracold atoms can help us to understand the more complex real-time dynamics of QCD probed in heavy-ion collision experiments.


title: A Framework of Full-Process Generation Design for Park Green Spaces Based on Remote Sensing Segmentation-GAN-Diffusion

abstract: The development of generative design driven by artificial intelligence algorithms is speedy. There are two research gaps in the current research: 1) Most studies only focus on the relationship between design elements and pay little attention to the external information of the site; 2) GAN and other traditional generative algorithms generate results with low resolution and insufficient details. To address these two problems, we integrate GAN, Stable diffusion multimodal large-scale image pre-training model to construct a full-process park generative design method: 1) First, construct a high-precision remote sensing object extraction system for automated extraction of urban environmental information; 2) Secondly, use GAN to construct a park design generation system based on the external environment, which can quickly infer and generate design schemes from urban environmental information; 3) Finally, introduce Stable Diffusion to optimize the design plan, fill in details, and expand the resolution of the plan by 64 times. This method can achieve a fully unmanned design automation workflow. The research results show that: 1) The relationship between the inside and outside of the site will affect the algorithm generation results. 2) Compared with traditional GAN algorithms, Stable diffusion significantly improve the information richness of the generated results.


title: Visualization and Assessment of Copula Symmetry

abstract: Visualization and assessment of copula structures are crucial for accurately understanding and modeling the dependencies in multivariate data analysis. In this paper, we introduce an innovative method that employs functional boxplots and rank-based testing procedures to evaluate copula symmetry. This approach is specifically designed to assess key characteristics such as reflection symmetry, radial symmetry, and joint symmetry. We first construct test functions for each specific property and then investigate the asymptotic properties of their empirical estimators. We demonstrate that the functional boxplot of these sample test functions serves as an informative visualization tool of a given copula structure, effectively measuring the departure from zero of the test function. Furthermore, we introduce a nonparametric testing procedure to assess the significance of deviations from symmetry, ensuring the accuracy and reliability of our visualization method. Through extensive simulation studies involving various copula models, we demonstrate the effectiveness of our testing approach. Finally, we apply our visualization and testing techniques to two real-world datasets: a nutritional habits survey with five variables and wind speed data from three locations in Saudi Arabia.


title: Fuzz Driver Synthesis for Rust Generic APIs

abstract: Fuzzing is a popular bug detection technique achieved by testing software executables with random inputs. This technique can also be extended to libraries by constructing executables that call library APIs, known as fuzz drivers. Automated fuzz driver synthesis has been an important research topic in recent years since it can facilitate the library fuzzing process. Nevertheless, existing approaches generally ignore generic APIs or simply treat them as normal APIs. As a result, they cannot generate effective fuzz drivers for generic APIs. This paper studies the automated fuzz driver synthesis problem for Rust libraries with generic APIs. The problem is essential because Rust emphasizes security, and generic APIs are widely employed in Rust crates. Each generic API can have numerous monomorphic versions as long as the type constraints are satisfied. The critical challenge to this problem lies in prioritizing these monomorphic versions and providing valid inputs for them. To address the problem, we extend existing API-dependency graphs to support generic APIs. By solving such dependencies and type constraints, we can generate a collection of candidate monomorphic APIs. Further, we apply a similarity-based filter to prune redundant versions, particularly if multiple monomorphic APIs adopt the identical trait implementation. Experimental results with 29 popular open-source libraries show that our approach can achieve promising generic API coverage with a low rate of invalid fuzz drivers. Besides, we find 23 bugs previously unknown in these libraries, with 18 bugs related to generic APIs.


title: Thermal leptogenesis in anisotropic cosmology

abstract: There is no evidence that the universe must have been homogeneous and isotropic before the big bang nucleosynthesis. The Bianchi type-I cosmology is the simplest homogeneous but anisotropic cosmology. In this work, we investigate thermal leptogenesis, as a baryogenesis scenario, in the Bianchi type-I cosmology. Our results show that for specific values of the anisotropy, the modified thermal leptogenesis generated more baryon asymmetry than the standard one. In this way, anisotropy can help to achieve low-scale leptogenesis.


title: Weak gravitational lensing and shadow of a GUP-modified Schwarzschild black hole in the presence of plasma

abstract: In this work, we have studied weak gravitational lensing effect around black hole and determine shadow radius in GUP-corrected-Schwarzschild spacetime (S-GUP) in presence of plasma environment. We started with orbits of photons around black hole in S-GUP. In addition, we have studied shadow and gravitational weak lensing around such black hole. By using observational data of EHT project for the M87* and Sgr A*, we have got constrains parameter $\epsilon$ in S-GUP gravity. Further to make a connection with observations, we investigate magnification and position of images formed as a result of lensing, and finally weak deflection angle and magnification for sources near M87* and Sgr A*.


title: Bengali Intent Classification with Generative Adversarial BERT

abstract: Intent classification is a fundamental task in natural language understanding, aiming to categorize user queries or sentences into predefined classes to understand user intent. The most challenging aspect of this particular task lies in effectively incorporating all possible classes of intent into a dataset while ensuring adequate linguistic variation. Plenty of research has been conducted in the related domains in rich-resource languages like English. In this study, we introduce BNIntent30, a comprehensive Bengali intent classification dataset containing 30 intent classes. The dataset is excerpted and translated from the CLINIC150 dataset containing a diverse range of user intents categorized over 150 classes. Furthermore, we propose a novel approach for Bengali intent classification using Generative Adversarial BERT to evaluate the proposed dataset, which we call GAN-BnBERT. Our approach leverages the power of BERT-based contextual embeddings to capture salient linguistic features and contextual information from the text data, while the generative adversarial network (GAN) component complements the model's ability to learn diverse representations of existing intent classes through generative modeling. Our experimental results demonstrate that the GAN-BnBERT model achieves superior performance on the newly introduced BNIntent30 dataset, surpassing the existing Bi-LSTM and the stand-alone BERT-based classification model.


title: DomainForensics: Exposing Face Forgery across Domains via Bi-directional Adaptation

abstract: Recent DeepFake detection methods have shown excellent performance on public datasets but are significantly degraded on new forgeries. Solving this problem is important, as new forgeries emerge daily with the continuously evolving generative techniques. Many efforts have been made for this issue by seeking the commonly existing traces empirically on data level. In this paper, we rethink this problem and propose a new solution from the unsupervised domain adaptation perspective. Our solution, called DomainForensics, aims to transfer the forgery knowledge from known forgeries to new forgeries. Unlike recent efforts, our solution does not focus on data view but on learning strategies of DeepFake detectors to capture the knowledge of new forgeries through the alignment of domain discrepancies. In particular, unlike the general domain adaptation methods which consider the knowledge transfer in the semantic class category, thus having limited application, our approach captures the subtle forgery traces. We describe a new bi-directional adaptation strategy dedicated to capturing the forgery knowledge across domains. Specifically, our strategy considers both forward and backward adaptation, to transfer the forgery knowledge from the source domain to the target domain in forward adaptation and then reverse the adaptation from the target domain to the source domain in backward adaptation. In forward adaptation, we perform supervised training for the DeepFake detector in the source domain and jointly employ adversarial feature adaptation to transfer the ability to detect manipulated faces from known forgeries to new forgeries. In backward adaptation, we further improve the knowledge transfer by coupling adversarial adaptation with self-distillation on new forgeries. This enables the detector to expose new forgery features from unlabeled data and avoid forgetting the known knowledge of known...


title: Bilayer crystals of trapped ions for quantum information processing

abstract: Trapped ion systems are a leading platform for quantum information processing, but they are currently limited to 1D and 2D arrays, which imposes restrictions on both their scalability and their range of applications. Here, we propose a path to overcome this limitation by demonstrating that Penning traps can be used to realize remarkably clean bilayer crystals, wherein hundreds of ions self-organize into two well-defined layers. These bilayer crystals are made possible by the inclusion of an anharmonic trapping potential, which is readily implementable with current technology. We study the normal modes of this system and discover salient differences compared to the modes of single-plane crystals. The bilayer geometry and the unique properties of the normal modes open new opportunities, in particular in quantum sensing and quantum simulation, that are not straightforward in single-plane crystals. Furthermore, we illustrate that it may be possible to extend the ideas presented here to realize multilayer crystals with more than two layers. Our work increases the dimensionality of trapped ion systems by efficiently utilizing all three spatial dimensions and lays the foundation for a new generation of quantum information processing experiments with multilayer 3D crystals of trapped ions.

categories: quant-ph cond-mat.mes-hall cond-mat.quant-gas physics.atom-ph physics.plasm-ph


title: Stability Analysis of Degenerate Einstein Model of Brownian Motion

abstract: Our Recent advancements in stochastic processes have illuminated a paradox associated with the Einstein model of Brownian motion. The model predicts an infinite propagation speed, conflicting with the second law of thermodynamics. The modified model successfully resolves the issue, establishing a finite propagation speed by introducing a concentration-dependent diffusion matrix. In this paper, we outline the necessary conditions for this property through a counter-example. The second part of the paper focuses on the stability analysis of the solution of the degenerate Einstein model. We introduce a functional dependence on the solution that satisfies a specific ordinary differential inequality. Our investigation explores the solution's dependence on the boundary and initial data of the original problem, demonstrating asymptotic stability under various conditions. These results have practical applications in understanding stochastic processes within bounded domains.

categories: math.AP math.PR physics.class-ph physics.flu-dyn


title: Concordance of Morse functions on manifolds

abstract: In this paper, the concordance of Morse functions is defined, and a necessary and sufficient condition for given two Morse functions to be concordant is presented and is compared with the cobordism criterion. Cobordism of Morse functions on smooth closed manifolds is an equivalence relation defined by using cobordisms of manifolds and fold maps. Given two Morse functions, it is important to decide whether they are cobordant or not, and this problem was first solved for surfaces and then for manifolds of general dimensions by Ikegami-Saeki, Kalm\'ar, and Ikegami. On the other hand, for Morse functions on the same manifold, we can consider a stronger equivalence relation called concordance.


title: State Estimation for Linear Systems with Quadratic Outputs

abstract: This letter deals with the problem of state estimation for a class of systems involving linear dynamics with multiple quadratic output measurements. We propose a systematic approach to immerse the original system into a linear time-varying (LTV) system of a higher dimension. The methodology extends the original system by incorporating a minimum number of auxiliary states, ensuring that the resulting extended system exhibits both linear dynamics and linear output. Consequently, any Kalman-type observer can showcase global state estimation, provided the system is uniformly observable.


title: Null energy condition violation during inflation and pulsar timing array observations

abstract: Recently, evidence of stochastic gravitational wave background (SGWB) signals observed by pulsar timing array (PTA) collaborations, has prompted investigations into their origins. We explore the compatibility of a proposed inflationary scenario, incorporating an intermediate null energy condition (NEC)-violating phase, with the PTA observations. The NEC violation potentially amplifies the primordial tensor power spectrum, offering a promising explanation for PTA observations. Numerical analyses, primarily focused on NANOGrav's 15-year results, reveal the model's compatibility with PTA data. Notably, the model predicts a nearly scale-invariant GW spectrum in the mHz frequency range, which sets our scenario apart from other interpretations predicting a red primordial GW spectrum on smaller scales.


title: Out-of-Distribution Detection in Long-Tailed Recognition with Calibrated Outlier Class Learning

abstract: Existing out-of-distribution (OOD) methods have shown great success on balanced datasets but become ineffective in long-tailed recognition (LTR) scenarios where 1) OOD samples are often wrongly classified into head classes and/or 2) tail-class samples are treated as OOD samples. To address these issues, current studies fit a prior distribution of auxiliary/pseudo OOD data to the long-tailed in-distribution (ID) data. However, it is difficult to obtain such an accurate prior distribution given the unknowingness of real OOD samples and heavy class imbalance in LTR. A straightforward solution to avoid the requirement of this prior is to learn an outlier class to encapsulate the OOD samples. The main challenge is then to tackle the aforementioned confusion between OOD samples and head/tail-class samples when learning the outlier class. To this end, we introduce a novel calibrated outlier class learning (COCL) approach, in which 1) a debiased large margin learning method is introduced in the outlier class learning to distinguish OOD samples from both head and tail classes in the representation space and 2) an outlier-class-aware logit calibration method is defined to enhance the long-tailed classification confidence. Extensive empirical results on three popular benchmarks CIFAR10-LT, CIFAR100-LT, and ImageNet-LT demonstrate that COCL substantially outperforms state-of-the-art OOD detection methods in LTR while being able to improve the classification accuracy on ID data. Code is available at https://github.com/mala-lab/COCL.


title: MM-TTS: Multi-modal Prompt based Style Transfer for Expressive Text-to-Speech Synthesis

abstract: The style transfer task in Text-to-Speech refers to the process of transferring style information into text content to generate corresponding speech with a specific style. However, most existing style transfer approaches are either based on fixed emotional labels or reference speech clips, which cannot achieve flexible style transfer. Recently, some methods have adopted text descriptions to guide style transfer. In this paper, we propose a more flexible multi-modal and style controllable TTS framework named MM-TTS. It can utilize any modality as the prompt in unified multi-modal prompt space, including reference speech, emotional facial images, and text descriptions, to control the style of the generated speech in a system. The challenges of modeling such a multi-modal style controllable TTS mainly lie in two aspects:1)aligning the multi-modal information into a unified style space to enable the input of arbitrary modality as the style prompt in a single system, and 2)efficiently transferring the unified style representation into the given text content, thereby empowering the ability to generate prompt style-related voice. To address these problems, we propose an aligned multi-modal prompt encoder that embeds different modalities into a unified style space, supporting style transfer for different modalities. Additionally, we present a new adaptive style transfer method named Style Adaptive Convolutions to achieve a better style representation. Furthermore, we design a Rectified Flow based Refiner to solve the problem of over-smoothing Mel-spectrogram and generate audio of higher fidelity. Since there is no public dataset for multi-modal TTS, we construct a dataset named MEAD-TTS, which is related to the field of expressive talking head. Our experiments on the MEAD-TTS dataset and out-of-domain datasets demonstrate that MM-TTS can achieve satisfactory results based on multi-modal prompts.


title: Phonon-bottleneck enhanced exciton emission in 2D perovskites

abstract: Layered halide perovskites exhibit remarkable optoelectronic properties and technological promise, driven by strongly bound excitons. The interplay of spin-orbit and exchange coupling creates a rich excitonic landscape, determining their optical signatures and exciton dynamics. Despite the dark excitonic ground state, surprisingly efficient emission from higher-energy bright states has puzzled the scientific community, sparking debates on relaxation mechanisms. Combining low-temperature magneto-optical measurements with sophisticated many-particle theory, we elucidate the origin of the bright exciton emission in perovskites by tracking the thermalization of dark and bright excitons under a magnetic field. We clearly attribute the unexpectedly high emission to a pronounced phonon-bottleneck effect, considerably slowing down the relaxation towards the energetically lowest dark states. We demonstrate that this bottleneck can be tuned by manipulating the bright-dark energy splitting and optical phonon energies, offering valuable insights and strategies for controlling exciton emission in layered perovskite materials that is crucial for optoelectronics applications.


title: Local Polyakov-loop fluctuation and center domains in quark-gluon plasma with many colors

abstract: The deconfinement transition in non-Abelian gauge theory is understood as spontaneous breaking of $\mathbb{Z}_N$ symmetry at high temperatures. Accordingly, quark-gluon plasma generally includes some partial cells called center domains, each with a homogeneous Polyakov-loop expectation value. In this work, constructing an effective action describing the deconfinement vacuum of Yang-Mills theory with $N$ colors, we discuss the properties of center domains. First, we evaluate the spatial correlation of local Polyakov-loop fluctuation and demonstrate that some fluctuation becomes a Nambu-Goldstone-like mode in the large-$N$ limit. We also discuss surface tension between two $\mathbb{Z}_N$ center domains. Second, we estimate the global vacuum-to-vacuum transition in a single center domain. We find that some threshold volume exists, where a domain larger than this volume is stable, and vice versa. Identifying the threshold as the lower bound of a stable center domain volume, we quantitatively argue the typical volume scale of center domains.


title: M-Estimation in Censored Regression Model using Instrumental Variables under Endogeneity

abstract: We propose and study M-estimation to estimate the parameters in the censored regression model in the presence of endogeneity, i.e., the Tobit model. In the course of this study, we follow two-stage procedures: the first stage consists of applying control function procedures to address the issue of endogeneity using instrumental variables, and the second stage applies the M-estimation technique to estimate the unknown parameters involved in the model. The large sample properties of the proposed estimators are derived and analyzed. The finite sample properties of the estimators are studied through Monte Carlo simulation and a real data application related to women's labor force participation.


title: On real forms of Fermat hypersurfaces

abstract: In this paper, we compute the number of real forms of Fermat hypersurfaces for degree $d \ge 3$ except the degree 4 surface case, and give explicit descriptions of them.


title: Pedestrian Attribute Recognition via CLIP based Prompt Vision-Language Fusion

abstract: Existing pedestrian attribute recognition (PAR) algorithms adopt pre-trained CNN (e.g., ResNet) as their backbone network for visual feature learning, which might obtain sub-optimal results due to the insufficient employment of the relations between pedestrian images and attribute labels. In this paper, we formulate PAR as a vision-language fusion problem and fully exploit the relations between pedestrian images and attribute labels. Specifically, the attribute phrases are first expanded into sentences, and then the pre-trained vision-language model CLIP is adopted as our backbone for feature embedding of visual images and attribute descriptions. The contrastive learning objective connects the vision and language modalities well in the CLIP-based feature space, and the Transformer layers used in CLIP can capture the long-range relations between pixels. Then, a multi-modal Transformer is adopted to fuse the dual features effectively and feed-forward network is used to predict attributes. To optimize our network efficiently, we propose the region-aware prompt tuning technique to adjust very few parameters (i.e., only the prompt vectors and classification heads) and fix both the pre-trained VL model and multi-modal Transformer. Our proposed PAR algorithm only adjusts 0.75% learnable parameters compared with the fine-tuning strategy. It also achieves new state-of-the-art performance on both standard and zero-shot settings for PAR, including RAPv1, RAPv2, WIDER, PA100K, and PETA-ZS, RAP-ZS datasets. The source code and pre-trained models will be released on https://github.com/Event-AHU/OpenPAR.


title: An appointment with Reproducing Kernel Hilbert Space generated by Generalized Gaussian RBF as $L^2-$measure

abstract: Gaussian Radial Basis Function (RBF) Kernels are the most-often-employed kernels in artificial intelligence and machine learning routines for providing optimally-best results in contrast to their respective counter-parts. However, a little is known about the application of the Generalized Gaussian Radial Basis Function on various machine learning algorithms namely, kernel regression, support vector machine (SVM) and pattern-recognition via neural networks. The results that are yielded by Generalized Gaussian RBF in the kernel sense outperforms in stark contrast to Gaussian RBF Kernel, Sigmoid Function and ReLU Function. This manuscript demonstrates the application of the Generalized Gaussian RBF in the kernel sense on the aforementioned machine learning routines along with the comparisons against the aforementioned functions as well.


title: Discretionary Trees: Understanding Street-Level Bureaucracy via Machine Learning

abstract: Street-level bureaucrats interact directly with people on behalf of government agencies to perform a wide range of functions, including, for example, administering social services and policing. A key feature of street-level bureaucracy is that the civil servants, while tasked with implementing agency policy, are also granted significant discretion in how they choose to apply that policy in individual cases. Using that discretion could be beneficial, as it allows for exceptions to policies based on human interactions and evaluations, but it could also allow biases and inequities to seep into important domains of societal resource allocation. In this paper, we use machine learning techniques to understand street-level bureaucrats' behavior. We leverage a rich dataset that combines demographic and other information on households with information on which homelessness interventions they were assigned during a period when assignments were not formulaic. We find that caseworker decisions in this time are highly predictable overall, and some, but not all of this predictivity can be captured by simple decision rules. We theorize that the decisions not captured by the simple decision rules can be considered applications of caseworker discretion. These discretionary decisions are far from random in both the characteristics of such households and in terms of the outcomes of the decisions. Caseworkers typically only apply discretion to households that would be considered less vulnerable. When they do apply discretion to assign households to more intensive interventions, the marginal benefits to those households are significantly higher than would be expected if the households were chosen at random; there is no similar reduction in marginal benefit to households that are discretionarily allocated less intensive interventions, suggesting that caseworkers are improving outcomes using their knowledge.


title: Nonparametric Strategy Test

abstract: We present a nonparametric statistical test for determining whether an agent is following a given mixed strategy in a repeated strategic-form game given samples of the agent's play. This involves two components: determining whether the agent's frequencies of pure strategies are sufficiently close to the target frequencies, and determining whether the pure strategies selected are independent between different game iterations. Our integrated test involves applying a chi-squared goodness of fit test for the first component and a generalized Wald-Wolfowitz runs test for the second component. The results from both tests are combined using Bonferroni correction to produce a complete test for a given significance level $\alpha.$ We applied the test to publicly available data of human rock-paper-scissors play. The data consists of 50 iterations of play for 500 human players. We test with a null hypothesis that the players are following a uniform random strategy independently at each game iteration. Using a significance level of $\alpha = 0.05$, we conclude that 305 (61%) of the subjects are following the target strategy.


title: An Interpretable Deep Learning Approach for Skin Cancer Categorization

abstract: Skin cancer is a serious worldwide health issue, precise and early detection is essential for better patient outcomes and effective treatment. In this research, we use modern deep learning methods and explainable artificial intelligence (XAI) approaches to address the problem of skin cancer detection. To categorize skin lesions, we employ four cutting-edge pre-trained models: XceptionNet, EfficientNetV2S, InceptionResNetV2, and EfficientNetV2M. Image augmentation approaches are used to reduce class imbalance and improve the generalization capabilities of our models. Our models decision-making process can be clarified because of the implementation of explainable artificial intelligence (XAI). In the medical field, interpretability is essential to establish credibility and make it easier to implement AI driven diagnostic technologies into clinical workflows. We determined the XceptionNet architecture to be the best performing model, achieving an accuracy of 88.72%. Our study shows how deep learning and explainable artificial intelligence (XAI) can improve skin cancer diagnosis, laying the groundwork for future developments in medical image analysis. These technologies ability to allow for early and accurate detection could enhance patient care, lower healthcare costs, and raise the survival rates for those with skin cancer. Source Code: https://github.com/Faysal-MD/An-Interpretable-Deep-Learning?Approach-for-Skin-Cancer-Categorization-IEEE2023


title: Magnetic Fluctuations in Niobium Pentoxide

abstract: Using a spin-polarized muon beam we were able to capture magnetic dynamics in an amorphous niobium pentoxide thin film. Muons are used to probe internal magnetic fields produced by defects. Magnetic fluctuations could be described by the dynamical Kubo-Toyabe model considering a time-dependent local magnetic field. We state that observed fluctuations result from the correlated motion of electron spins. We expect that oxygen vacancies play a significant role in these films and lead to a complex magnetic field distribution which is non-stationary. The characteristic average rate of magnetic field change is on the order of 100~MHz. The observed dynamics may provide insight into potential noise sources in Nb-based superconducting devices, while also highlighting the limitations imposed by amorphous oxides.


title: HE-DKSAP: Privacy-Preserving Stealth Address Protocol via Additively Homomorphic Encryption

abstract: Blockchain transactions have gained widespread adoption across various industries, largely attributable to their unparalleled transparency and robust security features. Nevertheless, this technique introduces various privacy concerns, including pseudonymity, Sybil attacks, and potential susceptibilities to quantum computing, to name a few. In response to these challenges, innovative privacy-enhancing solutions like zero-knowledge proofs, homomorphic encryption, and stealth addresses (SA) have been developed. Among the various schemes, SA stands out as it prevents the association of a blockchain transaction's output with the recipient's public address, thereby ensuring transactional anonymity. However, the basic SA schemes have exhibited vulnerabilities to key leakage and quantum computing attacks. To address these shortcomings, we present a pioneering solution - Homomorphic Encryption-based Dual-Key Stealth Address Protocol (HE-DKSAP), which can be further extended to Fully HE-DKSAP (FHE-DKSAP). By leveraging the power of homomorphic encryption, HE-DKSAP introduces a novel approach to safeguarding transaction privacy and preventing potential quantum computing attacks. This paper delves into the core principles of HE-DKSAP, highlighting its capacity to enhance privacy, scalability, and security in programmable blockchains. Through a comprehensive exploration of its design architecture, security analysis, and practical implementations, this work establishes a privacy-preserving, practical, and efficient stealth address protocol via additively homomorphic encryption.


title: Some Properties of normal subgroups determined from character tables

abstract: Gcharacter tables of a finite group G were defined before. These tables can be very useful to obtain certain structural information of a normal subgroup from the character table of G. We analyze certain structural properties of normal subgroups which can be determined using their Gcharacter tables. For instance, we prove an extension of the Thompsons theorem from minimal Ginvariant characters of a normal subgroup. We also obtain a variation of Taketas theorem for hypercentral normal subgroups considering their minimal G-invariant characters. This generalization allows us to introduce a new class of nilpotent groups, the class of nMIgroups, whose members verify that its nilpotency class is bounded by the number of irreducible character degrees of the group.


title: Cross-Domain Robustness of Transformer-based Keyphrase Generation

abstract: Modern models for text generation show state-of-the-art results in many natural language processing tasks. In this work, we explore the effectiveness of abstractive text summarization models for keyphrase selection. A list of keyphrases is an important element of a text in databases and repositories of electronic documents. In our experiments, abstractive text summarization models fine-tuned for keyphrase generation show quite high results for a target text corpus. However, in most cases, the zero-shot performance on other corpora and domains is significantly lower. We investigate cross-domain limitations of abstractive text summarization models for keyphrase generation. We present an evaluation of the fine-tuned BART models for the keyphrase selection task across six benchmark corpora for keyphrase extraction including scientific texts from two domains and news texts. We explore the role of transfer learning between different domains to improve the BART model performance on small text corpora. Our experiments show that preliminary fine-tuning on out-of-domain corpora can be effective under conditions of a limited number of samples.


title: Bengali License Plate Recognition: Unveiling Clarity with CNN and GFP-GAN

abstract: Automated License Plate Recognition(ALPR) is a system that automatically reads and extracts data from vehicle license plates using image processing and computer vision techniques. The Goal of LPR is to identify and read the license plate number accurately and quickly, even under challenging, conditions such as poor lighting, angled or obscured plates, and different plate fonts and layouts. The proposed method consists of processing the Bengali low-resolution blurred license plates and identifying the plate's characters. The processes include image restoration using GFPGAN, Maximizing contrast, Morphological image processing like dilation, feature extraction and Using Convolutional Neural Networks (CNN), character segmentation and recognition are accomplished. A dataset of 1292 images of Bengali digits and characters was prepared for this project.


title: Can persistent homology whiten Transformer-based black-box models? A case study on BERT compression

abstract: Large Language Models (LLMs) like BERT have gained significant prominence due to their remarkable performance in various natural language processing tasks. However, they come with substantial computational and memory costs. Additionally, they are essentially black-box models, challenging to explain and interpret. In this article, we propose Optimus BERT Compression and Explainability (OBCE), a methodology to bring explainability to BERT models using persistent homology, aiming to measure the importance of each neuron by studying the topological characteristics of their outputs. As a result, we can compress BERT significantly by reducing the number of parameters (58.47% of the original parameters for BERT Base, 52.3% for BERT Large). We evaluated our methodology on the standard GLUE Benchmark, comparing the results with state-of-the-art techniques and achieving outstanding results. Consequently, our methodology can "whiten" BERT models by providing explainability to its neurons and reducing the model's size, making it more suitable for deployment on resource-constrained devices.