title: Self-organizing Multiagent Target Enclosing under Limited Information and Safety Guarantees

abstract: This paper introduces an approach to address the target enclosing problem using non-holonomic multiagent systems, where agents autonomously self-organize themselves in the desired formation around a fixed target. Our approach combines global enclosing behavior and local collision avoidance mechanisms by devising a novel potential function and sliding manifold. In our approach, agents independently move toward the desired enclosing geometry when apart and activate the collision avoidance mechanism when a collision is imminent, thereby guaranteeing inter-agent safety. We rigorously show that an agent does not need to ensure safety with every other agent and put forth a concept of the nearest colliding agent (for any arbitrary agent) with whom ensuring safety is sufficient to avoid collisions in the entire swarm. The proposed control eliminates the need for a fixed or pre-established agent arrangement around the target and requires only relative information between an agent and the target. This makes our design particularly appealing for scenarios with limited global information, hence significantly reducing communication requirements. We finally present simulation results to vindicate the efficacy of the proposed method.


title: Bayesian Inference for Consistent Predictions in Overparameterized Nonlinear Regression

abstract: The remarkable generalization performance of large-scale models has been challenging the conventional wisdom of the statistical learning theory. Although recent theoretical studies have shed light on this behavior in linear models and nonlinear classifiers, a comprehensive understanding of overparameterization in nonlinear regression models is still lacking. This study explores the predictive properties of overparameterized nonlinear regression within the Bayesian framework, extending the methodology of the adaptive prior considering the intrinsic spectral structure of the data. Posterior contraction is established for generalized linear and single-neuron models with Lipschitz continuous activation functions, demonstrating the consistency in the predictions of the proposed approach. Moreover, the Bayesian framework enables uncertainty estimation of the predictions. The proposed method was validated via numerical simulations and a real data application, showing its ability to achieve accurate predictions and reliable uncertainty estimates. This work provides a theoretical understanding of the advantages of overparameterization and a principled Bayesian approach to large nonlinear models.


title: On the equivalence between Fourier-based and Wasserstein distances for probability measures on $\mathbb N$

abstract: In this manuscript we investigate the equivalence of Fourier-based metrics on discrete state spaces with the well-known Wasserstein distances. While the use of Fourier-based metrics in continuous state spaces is ubiquitous since its introduction by Giuseppe Toscani and his colleagues [9, 14, 16] in the study of kinetic-type partial differential equations, the introduction of its discrete analog is recent [2] and seems to be far less studied. In this work, various relations between Fourier-based metrics and Wasserstein distances are shown to hold when the state space is the set of non-negative integers $\mathbb N$. Lastly, we also describe potential applications of such equivalence of metrics in models from econophysics which motivate the present work.


title: Trustless Audits without Revealing Data or Models

abstract: There is an increasing conflict between business incentives to hide models and data as trade secrets, and the societal need for algorithmic transparency. For example, a rightsholder wishing to know whether their copyrighted works have been used during training must convince the model provider to allow a third party to audit the model and data. Finding a mutually agreeable third party is difficult, and the associated costs often make this approach impractical. In this work, we show that it is possible to simultaneously allow model providers to keep their model weights (but not architecture) and data secret while allowing other parties to trustlessly audit model and data properties. We do this by designing a protocol called ZkAudit in which model providers publish cryptographic commitments of datasets and model weights, alongside a zero-knowledge proof (ZKP) certifying that published commitments are derived from training the model. Model providers can then respond to audit requests by privately computing any function F of the dataset (or model) and releasing the output of F alongside another ZKP certifying the correct execution of F. To enable ZkAudit, we develop new methods of computing ZKPs for SGD on modern neural nets for simple recommender systems and image classification models capable of high accuracies on ImageNet. Empirically, we show it is possible to provide trustless audits of DNNs, including copyright, censorship, and counterfactual audits with little to no loss in accuracy.


title: On Innermost Stable Spherical Orbits near a rotating black hole: A numerical study of the particle motion near the plunging region

abstract: According to General Relativity, astrophysical black holes are described by a small number of parameters. Apart from the mass of the black hole (M), among the most interesting characteristics is the spin (a), which determines the degree of rotation, i.e., the angular momentum of the black hole. The latter is observationally constrained by the spectral and timing properties of the radiation signal emerging from an accretion disk of matter orbiting near the event horizon. In the case of planar (standard, equatorial) accretion disk, it is the location of the Innermost Stable Circular Orbit (ISCO) that determines the observable radiation characteristics, and this way allows us to measure the spin. In this paper, we discuss a more general case of the Innermost Stable Spherical Orbits (ISSO) extending above and below the equatorial plane. To this end, we study the non-equatorial geodesic motion of particles following inclined, spherical, relativistically precessing trajectories with the aim of exploring the boundary between the regions of stable (energetically bound) and escaping (energetically unbound) motion. The concept of the ISSO radius should play a role in determining the inner rim of a tilted or geometrically thick accretion flow. We demonstrate that the region of inclined bound orbits has a complicated structure due to enhanced precession near the inner rim. We also explore the fate of particles launched below the radius of the Marginally Bound Spherical Orbit (MBSO): these may either plunge into the event horizon or escape to radial infinity.


title: The interplay between additive and symmetric large sets and their combinatorial applications

abstract: The study of symmetric structures is a new trend in Ramsey theory. Recently in [7], Di Nasso initiated a systematic study of symmetrization of classical Ramsey theoretical results, and proved a symmetric version of several Ramsey theoretic results. In this paper Di Nasso asked if his method could be adapted to find new non-linear Diophantine equations that are partition regular [7,Final remarks (4)]. By analyzing additive, multiplicative, and symmetric large sets, we construct new partition regular equations that give a first affirmative answer to this question. A special case of our result shows that if $P$ is a polynomial with no constant term then the equation $x+P(y-x)=z+w+zw$, where $y\neq x$ is partition regular. Also we prove several new monochromatic patterns involving additive, multiplicative, and symmetric structures. Throughout our work, we use tools from the Algebra of the Stone-\v{C}ech Compactifications of discrete semigroups.


title: Essential annuli in genus two handlebody exteriors

abstract: We classify all potential configurations of essential annuli in a genus two atoroidal handlebody exterior in the $3$-sphere, building on two recent classifications: the classification of the JSJ-graph of the exterior and the classification of essential annuli in the exterior. In contrast to knots, genus two handlebody exteriors may contain infinitely many non-isotopic essential annuli, due to the JSJ-graph classification. Our main result characterizes the numbers of different types of essential annuli in such an infinite family.


title: Undecidability of tiling the plane with a fixed number of Wang bars

abstract: To study the fixed parameter undecidability of tiling problem for a set of Wang tiles, Jeandel and Rolin show that the tiling problem for a set of 44 Wang bars is undecidable. In this paper, we improve their result by proving that whether a set of 29 Wang bars can tile the plane is undecidable. As a consequence, the tiling problem for a set of Wang tiles with color deficiency of 25 is also undecidable.


title: Exploring UAV Networking from the Terrain Information Completeness Perspective: A Tutorial

abstract: Terrain information is a crucial factor affecting the performance of unmanned aerial vehicle (UAV) networks. As a tutorial, this article provides a unique perspective on the completeness of terrain information, summarizing and enhancing the research on terrain-based UAV deployment. In the presence of complete terrain information, two highly discussed topics are UAV-aided map construction and dynamic trajectory design based on maps. We propose a case study illustrating the mutually reinforcing relationship between them. When terrain information is incomplete, and only terrain-related feature parameters are available, we discuss how existing models map terrain features to blockage probabilities. By introducing the application of this model with stochastic geometry, a case study is proposed to analyze the accuracy of the model. When no terrain information is available, UAVs gather terrain information during the real-time networking process and determine the next position by collected information. This real-time search method is currently limited to relay communication. In the case study, we extend it to a multi-user scenario and summarize three trade-offs of the method. Finally, we conduct a qualitative analysis to assess the impact of three factors that have been overlooked in terrain-based UAV deployment.


title: Super Apps and the Digital Markets Act

abstract: The Digital Markets Act (DMA) aims to ensure contestability and fairness in digital markets, particularly focusing on regulating Big Tech companies. The paper explores the DMA's capacity to address both current and future challenges in digital market contestability and fairness, spotlighting the trend towards platform integration and the potential rise of "super-apps" akin to WeChat and KakaoTalk. Specifically, it investigates WhatsApp, owned by Meta, as a gatekeeper that might expand its service offerings, integrating additional functionalities like AI and metaverse technologies. The paper discusses whether the DMA's obligations, such as mandated interoperability and data portability, can mitigate the emergent risks to market fairness and contestability from such integrations. Despite recognizing that the DMA has the potential to address many issues arising from platform integration, it suggests the necessity for adaptability and a complementary relationship with traditional antitrust law to ensure sustained contestability and fairness in evolving digital markets.


title: Irrational-window-filter projection method and application to quasiperiodic Schr\"odinger eigenproblems

abstract: In this paper, we propose a new algorithm, the irrational-window-filter projection method (IWFPM), for solving arbitrary dimensional global quasiperiodic systems. Based on the projection method (PM), IWFPM further utilizes the concentrated distribution of Fourier coefficients to filter out relevant spectral points using an irrational window. Moreover, a corresponding index-shift transform is designed to make the Fast Fourier Transform available. The corresponding error analysis on the function approximation level is also given. We apply IWFPM to 1D, 2D, and 3D quasiperiodic Schr\"odinger eigenproblems to demonstrate its accuracy and efficiency. IWFPM exhibits a significant computational advantage over PM for both extended and localized quantum states. Furthermore, the widespread existence of such spectral point distribution feature can endow IWFPM with significant potential for broader applications in quasiperiodic systems.


title: First ALMA observations of the HD 105211 debris disc: A warm dust component close to a gigayear-old star

abstract: Most debris discs consist of a gas-poor, cold dust belt located tens to hundreds of astronomical units away from the host star. Many cold dust belts exhibit distinct structures attributed to the dynamic interaction of planetary systems. Moreover, in a few systems, additional warm components can be found closer to the central star, resembling the asteroid belt or zodiacal dust in our Solar System. In this work, we investigate the structure of the disc surrounding the nearby F2V star HD 105211, which has a warm excess and a potential asymmetry in the cold belt. We applied the CASA pipeline to obtain the ALMA 1.3 mm continuum images. Then we constructed the SED and performed MCMC simulations to fit a model to the ALMA visibility data. To characterise the disc asymmetry, we analysed the ALMA images of two individual observation blocks and compared them to the previous Herschel images. Our modelling reveals that the disc is a narrow ring (23.6+-4.6 au) with low eccentricity positioned at a distance of 133.7+-1.6 au from the central star, which differs from the broad disc (100+-20 au) starting at an inner edge of 87+-2.5 au, inferred from the Herschel images. We found that both observation blocks show excess emission at the stellar position, while OB1 shows an offset between the star and the phase centre, and OB2 shows brightness clumps. We used a two-temperature model to fit the infrared SED and used the ALMA detection to constrain the warm component to a nearly pure blackbody model. The relatively low ratio of actual radius to blackbody radius of the HD105211 debris disc indicates that this system is depleted in small grains, which could indicate that it is dynamically cold. The excess emission from the stellar position suggests that there should be a warm mm-sized dust component close to the star, for which we suggest two possible origins: in situ asteroid belt or comet delivery.


title: Distributed No-Regret Learning for Multi-Stage Systems with End-to-End Bandit Feedback

abstract: This paper studies multi-stage systems with end-to-end bandit feedback. In such systems, each job needs to go through multiple stages, each managed by a different agent, before generating an outcome. Each agent can only control its own action and learn the final outcome of the job. It has neither knowledge nor control on actions taken by agents in the next stage. The goal of this paper is to develop distributed online learning algorithms that achieve sublinear regret in adversarial environments. The setting of this paper significantly expands the traditional multi-armed bandit problem, which considers only one agent and one stage. In addition to the exploration-exploitation dilemma in the traditional multi-armed bandit problem, we show that the consideration of multiple stages introduces a third component, education, where an agent needs to choose its actions to facilitate the learning of agents in the next stage. To solve this newly introduced exploration-exploitation-education trilemma, we propose a simple distributed online learning algorithm, $\epsilon-$EXP3. We theoretically prove that the $\epsilon-$EXP3 algorithm is a no-regret policy that achieves sublinear regret. Simulation results show that the $\epsilon-$EXP3 algorithm significantly outperforms existing no-regret online learning algorithms for the traditional multi-armed bandit problem.


title: IITK at SemEval-2024 Task 2: Exploring the Capabilities of LLMs for Safe Biomedical Natural Language Inference for Clinical Trials

abstract: Large Language models (LLMs) have demonstrated state-of-the-art performance in various natural language processing (NLP) tasks across multiple domains, yet they are prone to shortcut learning and factual inconsistencies. This research investigates LLMs' robustness, consistency, and faithful reasoning when performing Natural Language Inference (NLI) on breast cancer Clinical Trial Reports (CTRs) in the context of SemEval 2024 Task 2: Safe Biomedical Natural Language Inference for Clinical Trials. We examine the reasoning capabilities of LLMs and their adeptness at logical problem-solving. A comparative analysis is conducted on pre-trained language models (PLMs), GPT-3.5, and Gemini Pro under zero-shot settings using Retrieval-Augmented Generation (RAG) framework, integrating various reasoning chains. The evaluation yields an F1 score of 0.69, consistency of 0.71, and a faithfulness score of 0.90 on the test dataset.


title: Cluster-based Video Summarization with Temporal Context Awareness

abstract: In this paper, we present TAC-SUM, a novel and efficient training-free approach for video summarization that addresses the limitations of existing cluster-based models by incorporating temporal context. Our method partitions the input video into temporally consecutive segments with clustering information, enabling the injection of temporal awareness into the clustering process, setting it apart from prior cluster-based summarization methods. The resulting temporal-aware clusters are then utilized to compute the final summary, using simple rules for keyframe selection and frame importance scoring. Experimental results on the SumMe dataset demonstrate the effectiveness of our proposed approach, outperforming existing unsupervised methods and achieving comparable performance to state-of-the-art supervised summarization techniques. Our source code is available for reference at \url{https://github.com/hcmus-thesis-gulu/TAC-SUM}.


title: From quasi-symmetric to Schur expansions with applications to symmetric chain decompositions and plethysm

abstract: It is an important problem in algebraic combinatorics to deduce the Schur function expansion of a symmetric function whose expansion in terms of the fundamental quasisymmetric function is known. For example, formulas are known for the fundamental expansion of a Macdonald symmetric function and for the plethysm of two Schur functions, while the Schur expansions of these expressions are still elusive. Egge, Loehr and Warrington provided a method to obtain the Schur expansion from the fundamental expansion by replacing each quasisymmetric function by a Schur function (not necessarily indexed by a partition) and using straightening rules to obtain the Schur expansion. Here we provide a new method that only involves the coefficients of the quasisymmetric functions indexed by partitions and the quasi-Kostka matrix. As an application, we identify the lexicographically largest term in the Schur expansion of the plethysm of two Schur functions. We provide the Schur expansion of $s_w[s_h](x,y)$ for $w=2,3,4$ using novel symmetric chain decompositions of Young's lattice for partitions in a $w\times h$ box. For $w=4$, this is first known combinatorial expression for the coefficient of $s_{\lambda}$ in $s_{w}[s_{h}]$ for two-row partitions $\lambda$, and for $w=3$ the combinatorial expression is new.


title: IITK at SemEval-2024 Task 1: Contrastive Learning and Autoencoders for Semantic Textual Relatedness in Multilingual Texts

abstract: This paper describes our system developed for the SemEval-2024 Task 1: Semantic Textual Relatedness. The challenge is focused on automatically detecting the degree of relatedness between pairs of sentences for 14 languages including both high and low-resource Asian and African languages. Our team participated in two subtasks consisting of Track A: supervised and Track B: unsupervised. This paper focuses on a BERT-based contrastive learning and similarity metric based approach primarily for the supervised track while exploring autoencoders for the unsupervised track. It also aims on the creation of a bigram relatedness corpus using negative sampling strategy, thereby producing refined word embeddings.


title: Joint Visual and Text Prompting for Improved Object-Centric Perception with Multimodal Large Language Models

abstract: Multimodal Large Language Models (MLLMs) such as GPT-4V and Gemini Pro face challenges in achieving human-level perception in Visual Question Answering (VQA), particularly in object-oriented perception tasks which demand fine-grained understanding of object identities, locations or attributes, as indicated by empirical findings. This is mainly due to their limited capability to effectively integrate complex visual cues with textual information and potential object hallucinations. In this paper, we present a novel approach, Joint Visual and Text Prompting (VTPrompt), that employs fine-grained visual information to enhance the capability of MLLMs in VQA, especially for object-oriented perception. VTPrompt merges visual and text prompts to extract key concepts from textual questions and employs a detection model to highlight relevant objects as visual prompts in images. The processed images alongside text prompts are subsequently fed into MLLMs to produce more accurate answers. Our experiments with GPT-4V and Gemini Pro, on three benchmarks, i.e., MME , MMB and POPE, demonstrate significant improvements. Particularly, our method led to a score improvement of up to 183.5 for GPT-4V on MME and enhanced MMB performance by 8.17\% for GPT-4V and 15.69\% for Gemini Pro.


title: Predictable Verification using Intrinsic Definitions

abstract: We propose a novel mechanism of defining data structures using intrinsic definitions that avoids recursion and instead utilizes monadic maps satisfying local conditions. We show that intrinsic definitions are a powerful mechanism that can capture a variety of data structures naturally. We show that they also enable a predictable verification methodology that allows engineers to write ghost code to update monadic maps and perform verification using reduction to decidable logics. We evaluate our methodology using Boogie and prove a suite of data structure manipulating programs correct.


title: Language Models as Critical Thinking Tools: A Case Study of Philosophers

abstract: Current work in language models (LMs) helps us speed up or even skip thinking by accelerating and automating cognitive work. But can LMs help us with critical thinking -- thinking in deeper, more reflective ways which challenge assumptions, clarify ideas, and engineer new concepts? We treat philosophy as a case study in critical thinking, and interview 21 professional philosophers about how they engage in critical thinking and on their experiences with LMs. We find that philosophers do not find LMs to be useful because they lack a sense of selfhood (memory, beliefs, consistency) and initiative (curiosity, proactivity). We propose the selfhood-initiative model for critical thinking tools to characterize this gap. Using the model, we formulate three roles LMs could play as critical thinking tools: the Interlocutor, the Monitor, and the Respondent. We hope that our work inspires LM researchers to further develop LMs as critical thinking tools and philosophers and other 'critical thinkers' to imagine intellectually substantive uses of LMs.


abstract: Long-tailed imbalance distribution is a common issue in practical computer vision applications. Previous works proposed methods to address this problem, which can be categorized into several classes: re-sampling, re-weighting, transfer learning, and feature augmentation. In recent years, diffusion models have shown an impressive generation ability in many sub-problems of deep computer vision. However, its powerful generation has not been explored in long-tailed problems. We propose a new approach, the Latent-based Diffusion Model for Long-tailed Recognition (LDMLR), as a feature augmentation method to tackle the issue. First, we encode the imbalanced dataset into features using the baseline model. Then, we train a Denoising Diffusion Implicit Model (DDIM) using these encoded features to generate pseudo-features. Finally, we train the classifier using the encoded and pseudo-features from the previous two steps. The model's accuracy shows an improvement on the CIFAR-LT and ImageNet-LT datasets by using the proposed method.


title: MedIAnomaly: A comparative study of anomaly detection in medical images

abstract: Anomaly detection (AD) aims at detecting abnormal samples that deviate from the expected normal patterns. Generally, it can be trained on merely normal data without the requirement for abnormal samples, and thereby plays an important role in the recognition of rare diseases and health screening in the medical domain. Despite numerous related studies, we observe a lack of a fair and comprehensive evaluation, which causes some ambiguous conclusions and hinders the development of this field. This paper focuses on building a benchmark with unified implementation and comparison to address this problem. In particular, seven medical datasets with five image modalities, including chest X-rays, brain MRIs, retinal fundus images, dermatoscopic images, and histopathology whole slide images are organized for extensive evaluation. Twenty-seven typical AD methods, including reconstruction and self-supervised learning-based methods, are involved in comparison of image-level anomaly classification and pixel-level anomaly segmentation. Furthermore, we for the first time formally explore the effect of key components in existing methods, clearly revealing unresolved challenges and potential future directions. The datasets and code are available at \url{https://github.com/caiyu6666/MedIAnomaly}.


title: $f(R,\square R)$-gravity and equivalency with the modified GUP Scalar field models

abstract: Inspired by the generalization of scalar field gravitational models with a minimum length we study the equivalent theory in modified theories of gravity. The quadratic Generalized Uncertainty Principle (GUP) gives rise to a deformed Heisenberg algebra in the application, resulting in the emergence of additional degrees of freedom described by higher-order derivatives. The new degrees of freedom can be attributed to the introduction of a new scalar field, trasforming the resulting theory into a two-scalar field theory. Thus, in order to describe all the degrees of freedom we investigate special forms of the sixth-order modify $f\left( R,\square R\right) -$theory of gravity, where the gravitational Lagrangian has similar properties~to~that of the GUP scalar field theory. Finally, the cosmological applications are discussed, and we show that the de Sitter universe can be recovered without introducing a cosmological constant.


title: IITK at SemEval-2024 Task 4: Hierarchical Embeddings for Detection of Persuasion Techniques in Memes

abstract: Memes are one of the most popular types of content used in an online disinformation campaign. They are primarily effective on social media platforms since they can easily reach many users. Memes in a disinformation campaign achieve their goal of influencing the users through several rhetorical and psychological techniques, such as causal oversimplification, name-calling, and smear. The SemEval 2024 Task 4 \textit{Multilingual Detection of Persuasion Technique in Memes} on identifying such techniques in the memes is divided across three sub-tasks: ($\mathbf{1}$) Hierarchical multi-label classification using only textual content of the meme, ($\mathbf{2}$) Hierarchical multi-label classification using both, textual and visual content of the meme and ($\mathbf{3}$) Binary classification of whether the meme contains a persuasion technique or not using it's textual and visual content. This paper proposes an ensemble of Class Definition Prediction (CDP) and hyperbolic embeddings-based approaches for this task. We enhance meme classification accuracy and comprehensiveness by integrating HypEmo's hierarchical label embeddings (Chen et al., 2023) and a multi-task learning framework for emotion prediction. We achieve a hierarchical F1-score of 0.60, 0.67, and 0.48 on the respective sub-tasks.


title: Automated Computer Program Evaluation and Projects -- Our Experiences

abstract: This paper provides a few approaches to automating computer programming and project submission tasks, that we have been following for the last six years and have found to be successful. The approaches include using CodeRunner with Learning Management System (LMS) integration for programming practice and evaluation, and Git (GitHub) for project submissions and automatic code evaluation. In this paper, we describe the details of how we set up the tools and customized those for computer science courses. Based on our experiences, we also provide a few insights on using these tools for effective learning.


title: Q-PEFT: Query-dependent Parameter Efficient Fine-tuning for Text Reranking with Large Language Models

abstract: Parameter Efficient Fine-Tuning (PEFT) methods have been extensively utilized in Large Language Models (LLMs) to improve the down-streaming tasks without the cost of fine-tuing the whole LLMs. Recent studies have shown how to effectively use PEFT for fine-tuning LLMs in ranking tasks with convincing performance; there are some limitations, including the learned prompt being fixed for different documents, overfitting to specific tasks, and low adaptation ability. In this paper, we introduce a query-dependent parameter efficient fine-tuning (Q-PEFT) approach for text reranking to leak the information of the true queries to LLMs and then make the generation of true queries from input documents much easier. Specifically, we utilize the query to extract the top-$k$ tokens from concatenated documents, serving as contextual clues. We further augment Q-PEFT by substituting the retrieval mechanism with a multi-head attention layer to achieve end-to-end training and cover all the tokens in the documents, guiding the LLMs to generate more document-specific synthetic queries, thereby further improving the reranking performance. Extensive experiments are conducted on four public datasets, demonstrating the effectiveness of our proposed approach.


title: On the vorticity threshold for steady water waves

abstract: This paper presents a comprehensive analysis of two-dimensional water waves characterized by a significant adverse constant vorticity over flows without stagnation points. Surprisingly, we discover qualitative distinctions between this scenario and those featuring favorable vorticity. Our findings reveal that in the presence of large adverse vorticity, neither Stokes waves nor solitary waves can approach extreme waves exhibiting surface stagnation points. Conversely, we demonstrate that global bifurcation curves always lead to unidirectional Stokes and solitary waves with precisely one stagnation point located at the bottom right beneath the crest. In contrast, it is known that any favorable or even small adverse vorticity eliminates the possibility of bottom stagnation, leading to extreme waves exhibiting surface singularities. Additionally, we establish several novel facts, including new bounds for both amplitude and the Froude number.


title: Scale invariance beyond criticality within the mean-field analysis of tensorial field theories

abstract: We continue the series of articles on the application of Landau-Ginzburg mean-field theory to unveil the basic phase structure of tensorial field theories which are characterized by combinatorially non-local interactions. Among others, this class covers tensor field theories (TFT) which lead to a new class of conformal field theories highly relevant for investigations on the AdS/CFT conjecture. Moreover, it also encompasses models within the tensorial group field theory (TGFT) approach to quantum gravity. Crucially, we find in the infrared that the effective mass of such theories generically vanishes not only at criticality but also throughout the entire phase of non-vanishing vacuum expectation value due to the non-locality of the interactions. As a consequence, one encounters there the emergence of scale invariance which is potentially enhanced to conformal invariance on configuration space.


title: IITK at SemEval-2024 Task 10: Who is the speaker? Improving Emotion Recognition and Flip Reasoning in Conversations via Speaker Embeddings

abstract: This paper presents our approach for the SemEval-2024 Task 10: Emotion Discovery and Reasoning its Flip in Conversations. For the Emotion Recognition in Conversations (ERC) task, we utilize a masked-memory network along with speaker participation. We propose a transformer-based speaker-centric model for the Emotion Flip Reasoning (EFR) task. We also introduce Probable Trigger Zone, a region of the conversation that is more likely to contain the utterances causing the emotion to flip. For sub-task 3, the proposed approach achieves a 5.9 (F1 score) improvement over the task baseline. The ablation study results highlight the significance of various design choices in the proposed method.


title: DATENeRF: Depth-Aware Text-based Editing of NeRFs

abstract: Recent advancements in diffusion models have shown remarkable proficiency in editing 2D images based on text prompts. However, extending these techniques to edit scenes in Neural Radiance Fields (NeRF) is complex, as editing individual 2D frames can result in inconsistencies across multiple views. Our crucial insight is that a NeRF scene's geometry can serve as a bridge to integrate these 2D edits. Utilizing this geometry, we employ a depth-conditioned ControlNet to enhance the coherence of each 2D image modification. Moreover, we introduce an inpainting approach that leverages the depth information of NeRF scenes to distribute 2D edits across different images, ensuring robustness against errors and resampling challenges. Our results reveal that this methodology achieves more consistent, lifelike, and detailed edits than existing leading methods for text-driven NeRF scene editing.


title: VTR: An Optimized Vision Transformer for SAR ATR Acceleration on FPGA

abstract: Synthetic Aperture Radar (SAR) Automatic Target Recognition (ATR) is a key technique used in military applications like remote-sensing image recognition. Vision Transformers (ViTs) are the current state-of-the-art in various computer vision applications, outperforming their CNN counterparts. However, using ViTs for SAR ATR applications is challenging due to (1) standard ViTs require extensive training data to generalize well due to their low locality; the standard SAR datasets, however, have a limited number of labeled training data which reduces the learning capability of ViTs; (2) ViTs have a high parameter count and are computation intensive which makes their deployment on resource-constrained SAR platforms difficult. In this work, we develop a lightweight ViT model that can be trained directly on small datasets without any pre-training by utilizing the Shifted Patch Tokenization (SPT) and Locality Self-Attention (LSA) modules. We directly train this model on SAR datasets which have limited training samples to evaluate its effectiveness for SAR ATR applications. We evaluate our proposed model, that we call VTR (ViT for SAR ATR), on three widely used SAR datasets: MSTAR, SynthWakeSAR, and GBSAR. Further, we propose a novel FPGA accelerator for VTR, in order to enable deployment for real-time SAR ATR applications.


title: Maximal regular ideals of algebras related to the dual of Orlicz Fig\`{a}-Talamanca Herz algebra

abstract: Let $G$ be a locally compact group and the pair $(\Phi,\Psi)$ be a complementary pair of Young functions satisfying the $\Delta_2$-condition. Let $A_\Phi(G)$ be the Orlicz analog of the Fig\`{a}-Talamanca Herz algebra associated with the function $\Phi.$ The dual of the algebra $A_\Phi(G)$ is the space of $\Psi$-pseudomeasures, denoted $PM_\Psi(G).$ In this article, we aim to characterize the maximal regular left (right or two-sided) ideals of the Banach algebras $\mathcal{A}^{'}$ and $\mathcal{B}^{''}.$ The space $\mathcal{A}$ is any of the closed subspaces $C_{\delta,\Psi}(\widehat{G}), PF_\Psi(G), M(\widehat{G}), AP_\Psi(\widehat{G}), WAP_\Psi(\widehat{G}), UCB_\Psi(\widehat{G})$ or $PM_\Psi({G}),$ of $PM_\Psi(G),$ and the space $\mathcal{B}$ is any of the Banach algebras $W_\Phi(G)$ or $B_\Phi(G).$ We further characterize the minimal left ideals of $\mathcal{A}^{'}.$ Moreover, we also prove the necessary and sufficient conditions for the existence of minimal ideals in the Banach algebras $A_\Phi(G)$ and $\mathcal{B}.$


title: The Isomorphism Problem for Oligomorphic Groups with Weak Elimination of Imaginaries

abstract: In [21] it was asked if equality on the reals is sharp as a lower bound for the complexity of topological isomorphism between oligomorphic groups. We prove that under the assumption of weak elimination of imaginaries this is indeed the case. Our methods are model theoretic and they also have applications on the classical problem of reconstruction of isomorphisms of permutation groups from (topological) isomorphisms of automorphisms groups. As a concrete application, we give an explicit description of $\mathrm{Aut}(\mathrm{GL}(V))$ for any vector space $V$ of dimension $\aleph_0$ over a finite field, in affinity with the classical description for finite dimensional spaces due to Schreier and van der Waerden.


title: A Morphology-Based Investigation of Positional Encodings

abstract: Contemporary deep learning models effectively handle languages with diverse morphology despite not being directly integrated into them. Morphology and word order are closely linked, with the latter incorporated into transformer-based models through positional encodings. This prompts a fundamental inquiry: Is there a correlation between the morphological complexity of a language and the utilization of positional encoding in pre-trained language models? In pursuit of an answer, we present the first study addressing this question, encompassing 22 languages and 5 downstream tasks. Our findings reveal that the importance of positional encoding diminishes with increasing morphological complexity in languages. Our study motivates the need for a deeper understanding of positional encoding, augmenting them to better reflect the different languages under consideration.


title: Frequency Decomposition-Driven Unsupervised Domain Adaptation for Remote Sensing Image Semantic Segmentation

abstract: Cross-domain semantic segmentation of remote sensing (RS) imagery based on unsupervised domain adaptation (UDA) techniques has significantly advanced deep-learning applications in the geosciences. Recently, with its ingenious and versatile architecture, the Transformer model has been successfully applied in RS-UDA tasks. However, existing UDA methods mainly focus on domain alignment in the high-level feature space. It is still challenging to retain cross-domain local spatial details and global contextual semantics simultaneously, which is crucial for the RS image semantic segmentation task. To address these problems, we propose novel high/low-frequency decomposition (HLFD) techniques to guide representation alignment in cross-domain semantic segmentation. Specifically, HLFD attempts to decompose the feature maps into high- and low-frequency components before performing the domain alignment in the corresponding subspaces. Secondly, to further facilitate the alignment of decomposed features, we propose a fully global-local generative adversarial network, namely GLGAN, to learn domain-invariant detailed and semantic features across domains by leveraging global-local transformer blocks (GLTBs). By integrating HLFD techniques and the GLGAN, a novel UDA framework called FD-GLGAN is developed to improve the cross-domain transferability and generalization capability of semantic segmentation models. Extensive experiments on two fine-resolution benchmark datasets, namely ISPRS Potsdam and ISPRS Vaihingen, highlight the effectiveness and superiority of the proposed approach as compared to the state-of-the-art UDA methods. The source code for this work will be accessible at https://github.com/sstary/SSRS.


title: $K_{1}^{\pm}$ mesons moving in nuclear matter

abstract: Observing the mass shifts of mesons immersed in nuclear matter is interesting, as the changes are expected to shed light on the effects of chiral symmetry breaking on the origin of hadron masses. At the same time, it is important to understand the momentum dependence of the masses for spin-1 mesons, as the changes manifest differently across the two polarization modes. Here, the mass shifts of $K_{1}^{\pm}$ mesons with finite three-momentum in nuclear medium are studied in the QCD sum rule approach. We find that the mass of $K_{1}^{+}$($K_{1}^{-}$) meson is increased(decreased) by the non-trivial momentum effect in both the transverse and longitudinal modes. Specifically, compared to its rest mass in the nuclear medium, in the transverse mode, the mass of $K_{1}^{+}(K_{1}^{-})$ is observed to shift by +2(-55) MeV, while in the longitudinal mode, the mass shift is +13(-11) MeV, all at a momentum of 0.5 GeV. Exploring the medium modifications of $K_{1}$ meson through kaon beams at J-PARC will provide insights on the partial restoration of chiral symmetry in nuclear matter.


title: Heat flows from hot to cold: A simple rigorous example of thermalization in an isolated macroscopic quantum system

abstract: In the present note, we discuss a simple example of a macroscopic quantum many-body system in which the approach to thermal equilibrium from an arbitrary initial state in the microcanonical energy shell is proved without relying on any unproven assumptions. The model, which is equivalent to a free fermion chain, is designed to be a toy model for a weakly heat-conducting one-dimensional solid. We take a phenomenological point of view and perceive that the system is in thermal equilibrium when the measured coarse-grained energy distribution is uniform. The result on thermalization reported here is a variation (and an improvement) of our previous result on the irreversible expansion in a free fermion chain. As far as we know, this is the first concrete and rigorous realization of the philosophy on the foundation of equilibrium statistical mechanics proposed by von Neumann in 1929, and further developed recently by Goldstein, Lebowitz, Mastrodonato, Tumulka, and Zangh\`\i and the present author, namely, to characterize thermal equilibrium from a macroscopic viewpoint and to make use of the strong ETH to control the long-time dynamics. This note will be the most technical part of my longer article on thermalization, "What is thermal equilibrium and how do we get there?". I am making this document public at this stage since I have already announced (and will announce) the results at some of my talks.

categories: cond-mat.stat-mech math-ph math.MP quant-ph


title: Impact of Fairness Regulations on Institutions' Policies and Population Qualifications

abstract: The proliferation of algorithmic systems has fueled discussions surrounding the regulation and control of their social impact. Herein, we consider a system whose primary objective is to maximize utility by selecting the most qualified individuals. To promote demographic parity in the selection algorithm, we consider penalizing discrimination across social groups. We examine conditions under which a discrimination penalty can effectively reduce disparity in the selection. Additionally, we explore the implications of such a penalty when individual qualifications may evolve over time in response to the imposed penalizing policy. We identify scenarios where the penalty could hinder the natural attainment of equity within the population. Moreover, we propose certain conditions that can counteract this undesirable outcome, thus ensuring fairness.


title: Quantum Speedup for Some Geometric 3SUM-Hard Problems and Beyond

abstract: The classical 3SUM conjecture states that the class of 3SUM-hard problems does not admit a truly subquadratic $O(n^{2-\delta})$-time algorithm, where $\delta >0$, in classical computing. The geometric 3SUM-hard problems have widely been studied in computational geometry and recently, these problems have been examined under the quantum computing model. For example, Ambainis and Larka [TQC'20] designed a quantum algorithm that can solve many geometric 3SUM-hard problems in $O(n^{1+o(1)})$-time, whereas Buhrman [ITCS'22] investigated lower bounds under quantum 3SUM conjecture that claims there does not exist any sublinear $O(n^{1-\delta})$-time quantum algorithm for the 3SUM problem. The main idea of Ambainis and Larka is to formulate a 3SUM-hard problem as a search problem, where one needs to find a point with a certain property over a set of regions determined by a line arrangement in the plane. The quantum speed-up then comes from the application of the well-known quantum search technique called Grover search over all regions. This paper further generalizes the technique of Ambainis and Larka for some 3SUM-hard problems when a solution may not necessarily correspond to a single point or the search regions do not immediately correspond to the subdivision determined by a line arrangement. Given a set of $n$ points and a positive number $q$, we design $O(n^{1+o(1)})$-time quantum algorithms to determine whether there exists a triangle among these points with an area at most $q$ or a unit disk that contains at least $q$ points. We also give an $O(n^{1+o(1)})$-time quantum algorithm to determine whether a given set of intervals can be translated so that it becomes contained in another set of given intervals and discuss further generalizations.


title: Incoherent non-Hermitian skin effect in photonic quantum walks

abstract: The non-Hermitian skin effect describes the concentration of an extensive number of eigenstates near the boundaries of certain dissipative systems. This phenomenon has raised a huge interest in different areas of physics, including photonics, deeply expanding our understanding of non-Hermitian systems and opening up new avenues in both fundamental and applied aspects of topological phenomena. The skin effect has been associated to a nontrivial point-gap spectral topology and has been experimentally demonstrated in a variety of synthetic matter systems, including photonic lattices. In most of physical models exhibiting the non-Hermitian skin effect full or partial wave coherence is generally assumed. Here we push the concept of skin effect into the fully incoherent regime and show that rather generally (but not universally) the non-Hermitian skin effect persists under dephasing dynamics. The results are illustrated by considering incoherent light dynamics in non-Hermitian photonic quantum walks.


title: Robust Anderson transition in non-Hermitian photonic quasicrystals

abstract: Anderson localization, i.e. the suppression of diffusion in lattices with random or incommensurate disorder, is a fragile interference phenomenon which is spoiled out in the presence of dephasing effects or fluctuating disorder. As a consequence, Anderson localization-delocalization phase transitions observed in Hermitian systems, such as in one-dimensional quasicrystals when the amplitude of the incommensurate potential is increased above a threshold, are washed out when dephasing effects are included. Here we consider localization-delocalization spectral phase transitions occurring in non-Hermitian quasicrystals with local incommensurate gain and loss, and show that, contrary to the Hermitian case, the non-Hermitian phase transition is robust against dephasing effects. The results are illustrated by considering synthetic quasicrystals in photonic mesh lattices.


title: Soft-Prompting with Graph-of-Thought for Multi-modal Representation Learning

abstract: The chain-of-thought technique has been received well in multi-modal tasks. It is a step-by-step linear reasoning process that adjusts the length of the chain to improve the performance of generated prompts. However, human thought processes are predominantly non-linear, as they encompass multiple aspects simultaneously and employ dynamic adjustment and updating mechanisms. Therefore, we propose a novel Aggregation-Graph-of-Thought (AGoT) mechanism for soft-prompt tuning in multi-modal representation learning. The proposed AGoT models the human thought process not only as a chain but also models each step as a reasoning aggregation graph to cope with the overlooked multiple aspects of thinking in single-step reasoning. This turns the entire reasoning process into prompt aggregation and prompt flow operations. Experiments show that our multi-modal model enhanced with AGoT soft-prompting achieves good results in several tasks such as text-image retrieval, visual question answering, and image recognition. In addition, we demonstrate that it has good domain generalization performance due to better reasoning.


title: Electromagnetically-Consistent Modeling and Optimization of Mutual Coupling in RIS-Assisted Multi-User MIMO Communication Systems

abstract: Mutual Coupling (MC) is an unavoidable feature in Reconfigurable Intelligent Surfaces (RISs) with sub-wavelength inter-element spacing. Its inherent presence naturally leads to non-local RIS structures, which can be efficiently described via non-diagonal phase shift matrices. In this paper, we focus on optimizing MC in RIS-assisted multi-user MIMO wireless communication systems. We particularly formulate a novel problem to jointly optimize active and passive beamforming as well as MC in a physically consistent manner. To characterize MC, we deploy scattering parameters and propose a novel approach to optimize them through an offline optimization method, rather than optimizing MC on the fly. Our numerical results showcase that the system performance increases with the proposed MC optimization, and this improvement is achievable without the need for optimizing MC on-the-fly, which can be rather cumbersome.


title: The Case for Developing a Foundation Model for Planning-like Tasks from Scratch

abstract: Foundation Models (FMs) have revolutionized many areas of computing, including Automated Planning and Scheduling (APS). For example, a recent study found them useful for planning problems: plan generation, language translation, model construction, multi-agent planning, interactive planning, heuristics optimization, tool integration, and brain-inspired planning. Besides APS, there are many seemingly related tasks involving the generation of a series of actions with varying guarantees of their executability to achieve intended goals, which we collectively call planning-like (PL) tasks like business processes, programs, workflows, and guidelines, where researchers have considered using FMs. However, previous works have primarily focused on pre-trained, off-the-shelf FMs and optionally fine-tuned them. This paper discusses the need for a comprehensive FM for PL tasks from scratch and explores its design considerations. We argue that such an FM will open new and efficient avenues for PL problem-solving, just like LLMs are creating for APS.


title: Compilation of Modular and General Sparse Workspaces

abstract: Recent years have seen considerable work on compiling sparse tensor algebra expressions. This paper addresses a shortcoming in that work, namely how to generate efficient code (in time and space) that scatters values into a sparse result tensor. We address this shortcoming through a compiler design that generates code that uses sparse intermediate tensors (sparse workspaces) as efficient adapters between compute code that scatters and result tensors that do not support random insertion. Our compiler automatically detects sparse scattering behavior in tensor expressions and inserts necessary intermediate workspace tensors. We present an algorithm template for workspace insertion that is the backbone of our code generation algorithm. Our algorithm template is modular by design, supporting sparse workspaces that span multiple user-defined implementations. Our evaluation shows that sparse workspaces can be up to 27.12$\times$ faster than the dense workspaces of prior work. On the other hand, dense workspaces can be up to 7.58$\times$ faster than the sparse workspaces generated by our compiler in other situations, which motivates our compiler design that supports both. Our compiler produces sequential code that is competitive with hand-optimized linear and tensor algebra libraries on the expressions they support, but that generalizes to any other expression. Sparse workspaces are also more memory efficient than dense workspaces as they compress away zeros. This compression can asymptotically decrease memory usage, enabling tensor computations on data that would otherwise run out of memory.


title: Adaptive Polynomial Chaos Expansion for Uncertainty Quantification and Optimization of Horn Antennas at SubTHz Frequencies

abstract: Sub-terahertz (subTHz) antennas will play an important role in the next generations of wireless communication systems. However, when comes to the subTHz frequency spectrum, the antenna fabrication tolerance needs to be accurately considered during the design stage. The classic approach to studying the average performance of an antenna design considering fabrication tolerances is through the use of the Monte-Carlo (MC) method. In this paper, we propose an adaptive polynomial chaos expansion (PCE) method for the uncertainty quantification analysis of subTHz horn antennas with flat-top radiation patterns. The proposed method builds a surrogate model of the antenna's response to electromagnetic (EM) excitation and estimates its statistical moments with accuracy close to the reference MC method, but with a much smaller computational complexity of roughly two orders of magnitude. Moreover, the surrogate model based on PCE can substitute full-wave EM solvers in producing samples for electromagnetic quantities of interest, resulting in significant computational efficiency gains during optimization tasks. To this end, we successfully combined PCE with the particle swarm optimization method to design the free parameters of a horn antenna at $95$ GHz for a flat-top gain.


title: Early Adoption of Generative AI by Global Business Leaders: Insights from an INSEAD Alumni Survey

abstract: How are new technologies like generative AI quickly adopted and used by executive and managerial leaders to create value in organizations? A survey of INSEAD's global alumni base revealed several intriguing insights into perceptions and engagements with generative AI across a broad spectrum of demographics, industries, and geographies. Notably, there's a prevailing optimism about the role of generative AI in enhancing productivity and innovation, as evidenced by the 90% of respondents being excited about its time-saving and efficiency benefits. Analysis revealed different attitudes about adoption and use across demographic variables. Younger respondents are significantly more excited about generative AI and more likely to be using it at work and in personal life than older participants. Those in Europe have a somewhat more distant view of generative AI than those in North America in Asia, in that they see the gains more likely to be captured by organizations than individuals, and are less likely to be using it in professional and personal contexts than those in North America and Asia. This may also be related to the fact that those in Europe are more likely to be working in Financial Services and less likely to be working in Information Technology industries than those in North America and Asia. Despite this, those in Europe are more likely to see AGI happening faster than those in North America, although this may reflect less interaction with generative AI in personal and professional contexts. These findings collectively underscore the complex and multifaceted perceptions of generative AI's role in society, pointing to both its promising potential and the challenges it presents.


title: BeyondScene: Higher-Resolution Human-Centric Scene Generation With Pretrained Diffusion

abstract: Generating higher-resolution human-centric scenes with details and controls remains a challenge for existing text-to-image diffusion models. This challenge stems from limited training image size, text encoder capacity (limited tokens), and the inherent difficulty of generating complex scenes involving multiple humans. While current methods attempted to address training size limit only, they often yielded human-centric scenes with severe artifacts. We propose BeyondScene, a novel framework that overcomes prior limitations, generating exquisite higher-resolution (over 8K) human-centric scenes with exceptional text-image correspondence and naturalness using existing pretrained diffusion models. BeyondScene employs a staged and hierarchical approach to initially generate a detailed base image focusing on crucial elements in instance creation for multiple humans and detailed descriptions beyond token limit of diffusion model, and then to seamlessly convert the base image to a higher-resolution output, exceeding training image size and incorporating details aware of text and instances via our novel instance-aware hierarchical enlargement process that consists of our proposed high-frequency injected forward diffusion and adaptive joint diffusion. BeyondScene surpasses existing methods in terms of correspondence with detailed text descriptions and naturalness, paving the way for advanced applications in higher-resolution human-centric scene creation beyond the capacity of pretrained diffusion models without costly retraining. Project page: https://janeyeon.github.io/beyond-scene.


title: TCAN: Text-oriented Cross Attention Network for Multimodal Sentiment Analysis

abstract: Multimodal Sentiment Analysis (MSA) endeavors to understand human sentiment by leveraging language, visual, and acoustic modalities. Despite the remarkable performance exhibited by previous MSA approaches, the presence of inherent multimodal heterogeneities poses a challenge, with the contribution of different modalities varying considerably. Past research predominantly focused on improving representation learning techniques and feature fusion strategies. However, many of these efforts overlooked the variation in semantic richness among different modalities, treating each modality uniformly. This approach may lead to underestimating the significance of strong modalities while overemphasizing the importance of weak ones. Motivated by these insights, we introduce a Text-oriented Cross-Attention Network (TCAN), emphasizing the predominant role of the text modality in MSA. Specifically, for each multimodal sample, by taking unaligned sequences of the three modalities as inputs, we initially allocate the extracted unimodal features into a visual-text and an acoustic-text pair. Subsequently, we implement self-attention on the text modality and apply text-queried cross-attention to the visual and acoustic modalities. To mitigate the influence of noise signals and redundant features, we incorporate a gated control mechanism into the framework. Additionally, we introduce unimodal joint learning to gain a deeper understanding of homogeneous emotional tendencies across diverse modalities through backpropagation. Experimental results demonstrate that TCAN consistently outperforms state-of-the-art MSA methods on two datasets (CMU-MOSI and CMU-MOSEI).


title: A self-attention model for robust rigid slice-to-volume registration of functional MRI

abstract: Functional Magnetic Resonance Imaging (fMRI) is vital in neuroscience, enabling investigations into brain disorders, treatment monitoring, and brain function mapping. However, head motion during fMRI scans, occurring between shots of slice acquisition, can result in distortion, biased analyses, and increased costs due to the need for scan repetitions. Therefore, retrospective slice-level motion correction through slice-to-volume registration (SVR) is crucial. Previous studies have utilized deep learning (DL) based models to address the SVR task; however, they overlooked the uncertainty stemming from the input stack of slices and did not assign weighting or scoring to each slice. In this work, we introduce an end-to-end SVR model for aligning 2D fMRI slices with a 3D reference volume, incorporating a self-attention mechanism to enhance robustness against input data variations and uncertainties. It utilizes independent slice and volume encoders and a self-attention module to assign pixel-wise scores for each slice. We conducted evaluation experiments on 200 images involving synthetic rigid motion generated from 27 subjects belonging to the test set, from the publicly available Healthy Brain Network (HBN) dataset. Our experimental results demonstrate that our model achieves competitive performance in terms of alignment accuracy compared to state-of-the-art deep learning-based methods (Euclidean distance of $0.93$ [mm] vs. $1.86$ [mm]). Furthermore, our approach exhibits significantly faster registration speed compared to conventional iterative methods ($0.096$ sec. vs. $1.17$ sec.). Our end-to-end SVR model facilitates real-time head motion tracking during fMRI acquisition, ensuring reliability and robustness against uncertainties in inputs. source code, which includes the training and evaluations, will be available soon.


title: Exhaustive Exploitation of Nature-inspired Computation for Cancer Screening in an Ensemble Manner

abstract: Accurate screening of cancer types is crucial for effective cancer detection and precise treatment selection. However, the association between gene expression profiles and tumors is often limited to a small number of biomarker genes. While computational methods using nature-inspired algorithms have shown promise in selecting predictive genes, existing techniques are limited by inefficient search and poor generalization across diverse datasets. This study presents a framework termed Evolutionary Optimized Diverse Ensemble Learning (EODE) to improve ensemble learning for cancer classification from gene expression data. The EODE methodology combines an intelligent grey wolf optimization algorithm for selective feature space reduction, guided random injection modeling for ensemble diversity enhancement, and subset model optimization for synergistic classifier combinations. Extensive experiments were conducted across 35 gene expression benchmark datasets encompassing varied cancer types. Results demonstrated that EODE obtained significantly improved screening accuracy over individual and conventionally aggregated models. The integrated optimization of advanced feature selection, directed specialized modeling, and cooperative classifier ensembles helps address key challenges in current nature-inspired approaches. This provides an effective framework for robust and generalized ensemble learning with gene expression biomarkers. Specifically, we have opened EODE source code on Github at https://github.com/wangxb96/EODE.


title: Matter in Discrete Space-Times

abstract: The unitary representations of the Poincare group of a discrete space-time are constructed, following the Wigner method in continuum relativity. They can be interpreted as elementary particles with one significant new feature: the momentum space being the 4-torus is identified as the Brillouin zone of space-time where all physical phenomena occur. Consequently 4-momentum is defined and conserved only modulo a reciprocal lattice vector of the order of the Planck mass, implying that there is no notion of an invariant mass except when it vanishes. In particular the propagation of massive particles have superluminal phases under very large (trans-Planckian) boosts. This behaviour leads to new features in early cosmology which are not in conflict with current knowledge.

categories: gr-qc hep-ph hep-th math-ph math.MP quant-ph


title: Efficient Learning Using Spiking Neural Networks Equipped With Affine Encoders and Decoders

abstract: We study the learning problem associated with spiking neural networks. Specifically, we consider hypothesis sets of spiking neural networks with affine temporal encoders and decoders and simple spiking neurons having only positive synaptic weights. We demonstrate that the positivity of the weights continues to enable a wide range of expressivity results, including rate-optimal approximation of smooth functions or approximation without the curse of dimensionality. Moreover, positive-weight spiking neural networks are shown to depend continuously on their parameters which facilitates classical covering number-based generalization statements. Finally, we observe that from a generalization perspective, contrary to feedforward neural networks or previous results for general spiking neural networks, the depth has little to no adverse effect on the generalization capabilities.


title: NPB-REC: A Non-parametric Bayesian Deep-learning Approach for Undersampled MRI Reconstruction with Uncertainty Estimation

abstract: The ability to reconstruct high-quality images from undersampled MRI data is vital in improving MRI temporal resolution and reducing acquisition times. Deep learning methods have been proposed for this task, but the lack of verified methods to quantify the uncertainty in the reconstructed images hampered clinical applicability. We introduce "NPB-REC", a non-parametric fully Bayesian framework, for MRI reconstruction from undersampled data with uncertainty estimation. We use Stochastic Gradient Langevin Dynamics during training to characterize the posterior distribution of the network parameters. This enables us to both improve the quality of the reconstructed images and quantify the uncertainty in the reconstructed images. We demonstrate the efficacy of our approach on a multi-coil MRI dataset from the fastMRI challenge and compare it to the baseline End-to-End Variational Network (E2E-VarNet). Our approach outperforms the baseline in terms of reconstruction accuracy by means of PSNR and SSIM ($34.55$, $0.908$ vs. $33.08$, $0.897$, $p<0.01$, acceleration rate $R=8$) and provides uncertainty measures that correlate better with the reconstruction error (Pearson correlation, $R=0.94$ vs. $R=0.91$). Additionally, our approach exhibits better generalization capabilities against anatomical distribution shifts (PSNR and SSIM of $32.38$, $0.849$ vs. $31.63$, $0.836$, $p<0.01$, training on brain data, inference on knee data, acceleration rate $R=8$). NPB-REC has the potential to facilitate the safe utilization of deep learning-based methods for MRI reconstruction from undersampled data. Code and trained models are available at \url{https://github.com/samahkh/NPB-REC}.


title: Continuum envelops on Fargues-Fontaine curves and elliptic curves

abstract: In this paper, we apply the theory of Bridgeland stability conditions, which was originated from string theory, to study the derived category of coherent sheaves on Fargues--Fontaine curves. This leads us to consider the quasi-coherent sheaves $\mathcal{O}(\theta^{\pm})$ via the convergents of an irrational number $\theta$. We define the continuum envelop $\mathrm{QCoh}_{\mathbb{R}}(X_{FF})$ to be the smallest abelian subcategory in $\mathrm{QCoh}(X_{FF})$ containing $\mathrm{Coh}(X_{FF})$ and $\mathcal{O}(\theta^{\pm})$. We study the homological algebra of $\mathrm{QCoh}_{\mathbb{R}}(X_{FF})$ via Farey diagrams. We show that the homological property of $\mathcal{O}(\theta^{\pm})$ depends heavily on the arithmetic property of $\theta$. The Fargues--Fontaine curves present strong similarity with complex elliptic curves in this point of view.


title: Fast and Simple Sorting Using Partial Information

abstract: We consider the problem of sorting a set of items having an unknown total order by doing binary comparisons of the items, given the outcomes of some pre-existing comparisons. We present a simple algorithm with a running time of $O(m+n+\log T)$, where $n$, $m$, and $T$ are the number of items, the number of pre-existing comparisons, and the number of total orders consistent with the outcomes of the pre-existing comparisons, respectively. The algorithm does $O(\log T)$ comparisons. Our running time and comparison bounds are best possible up to constant factors, thus resolving a problem that has been studied intensely since 1976 (Fredman, Theoretical Computer Science). The best previous algorithm with a bound of $O(\log T)$ on the number of comparisons has a time bound of $O(n^{2.5})$ and is significantly more complicated. Our algorithm combines three classic algorithms: topological sort, heapsort with the right kind of heap, and efficient insertion into a sorted list.


title: A generalized hand-eye calibration dual quaternion matrix equation

abstract: In the field of robotics research, a crucial applied problem is the hand-eye calibration issue. The corresponding matrix equation $AX=YB$ in hand-eye calibration can be equivalently transformed into the dual quaternion equation $q_Aq_X=q_Yq_B$. However, the dual quaternion equation $q_Aq_X=q_Yq_B$ is merely a specific case of the more general dual quaternion matrix equation $AX-YB=C$, which also holds significant applications in system and control theory. Therefore, we in this paper establish the solvability conditions of the dual quaternion matrix equation $AX-YB=C$ and provide a general expression for its solutions when it is solvable. As an application, we investigate the analytical solutions of the dual quaternion matrix equation $AX=YB$. Finally, we validate the main results of this paper through a numerical example.


title: A quantum algorithm for the Kalman filter using block encoding

abstract: Quantum algorithms offer significant speed-ups over their classical counterparts in various applications. In this paper, we develop quantum algorithms for the Kalman filter widely used in classical control engineering using the block encoding method. The entire calculation process is achieved by performing matrix operations on Hamiltonians based on the block encoding framework, including addition, multiplication, and inversion, which can be completed in a unified framework compared to previous quantum algorithms for solving control problems. We demonstrate that the quantum algorithm exponentially accelerates the computation of the Kalman filter compared to traditional methods. The time complexity can be reduced from $O(n^3)$ to $O(\kappa poly\log(n/\epsilon)\log(1/\epsilon'))$, where $n$ represents the matrix dimension, $\kappa$ denotes the condition number for the matrix to be inverted, $\epsilon$ indicates desired precision in block encoding, $\epsilon'$ signifies desired precision in matrix inversion. This paper provides a comprehensive quantum solution for implementing the Kalman filter and serves as an attempt to broaden the scope of quantum computation applications. Finally, we present an illustrative example implemented in Qiskit (a Python-based open-source toolkit) as a proof-of-concept.


title: Cloud-Scale Molecular Gas Properties of the Antennae Merger: A Comparative Study with PHANGS-ALMA Galaxies and NGC 3256

abstract: We present observations of the central 9 kpc of the Antennae merger (NGC 4038/9) at 55 pc resolution in the CO 2-1 line obtained with the Atacama Large Millimeter/submillimeter Array (ALMA). We use a pixel-based analysis to compare the gas properties in the Antennae to those in 70 nearby spiral galaxies from the PHANGS-ALMA survey, as well as the merger and nearest luminous infrared galaxy NGC 3256. Compared to PHANGS galaxies at matched spatial resolution, the molecular gas in the Antennae exhibits some of the highest surface densities, velocity dispersions, peak brightness temperatures, and turbulent pressures. However, the virial parameters in the Antennae are consistent with many of the PHANGS galaxies. NGC 3256 has similar gas surface densities but higher nuclear velocity dispersions than the Antennae, as well as higher system-wide peak brightness temperatures and virial parameters. NGC 3256 is at a later stage in the merging process than the Antennae, which may result in more intense merger-driven gas flows that could drive up the turbulence in the gas. The high virial parameters in NGC 3256 may indicate that this increased turbulence is suppressing future star formation as NGC 3256 moves out of the starburst phase. In comparison, the relatively normal virial parameters in the Antennae may imply that it is about to undergo a new burst of star formation.


title: Rethinking Self-training for Semi-supervised Landmark Detection: A Selection-free Approach

abstract: Self-training is a simple yet effective method for semi-supervised learning, during which pseudo-label selection plays an important role for handling confirmation bias. Despite its popularity, applying self-training to landmark detection faces three problems: 1) The selected confident pseudo-labels often contain data bias, which may hurt model performance; 2) It is not easy to decide a proper threshold for sample selection as the localization task can be sensitive to noisy pseudo-labels; 3) coordinate regression does not output confidence, making selection-based self-training infeasible. To address the above issues, we propose Self-Training for Landmark Detection (STLD), a method that does not require explicit pseudo-label selection. Instead, STLD constructs a task curriculum to deal with confirmation bias, which progressively transitions from more confident to less confident tasks over the rounds of self-training. Pseudo pretraining and shrink regression are two essential components for such a curriculum, where the former is the first task of the curriculum for providing a better model initialization and the latter is further added in the later rounds to directly leverage the pseudo-labels in a coarse-to-fine manner. Experiments on three facial and one medical landmark detection benchmark show that STLD outperforms the existing methods consistently in both semi- and omni-supervised settings.


title: Learning Instance-Aware Correspondences for Robust Multi-Instance Point Cloud Registration in Cluttered Scenes

abstract: Multi-instance point cloud registration estimates the poses of multiple instances of a model point cloud in a scene point cloud. Extracting accurate point correspondence is to the center of the problem. Existing approaches usually treat the scene point cloud as a whole, overlooking the separation of instances. Therefore, point features could be easily polluted by other points from the background or different instances, leading to inaccurate correspondences oblivious to separate instances, especially in cluttered scenes. In this work, we propose MIRETR, Multi-Instance REgistration TRansformer, a coarse-to-fine approach to the extraction of instance-aware correspondences. At the coarse level, it jointly learns instance-aware superpoint features and predicts per-instance masks. With instance masks, the influence from outside of the instance being concerned is minimized, such that highly reliable superpoint correspondences can be extracted. The superpoint correspondences are then extended to instance candidates at the fine level according to the instance masks. At last, an efficient candidate selection and refinement algorithm is devised to obtain the final registrations. Extensive experiments on three public benchmarks demonstrate the efficacy of our approach. In particular, MIRETR outperforms the state of the arts by 16.6 points on F1 score on the challenging ROBI benchmark. Code and models are available at https://github.com/zhiyuanYU134/MIRETR.


title: EVT-enriched Radio Maps for URLLC

abstract: This paper introduces a sophisticated and adaptable framework combining extreme value theory with radio maps to spatially model extreme channel conditions accurately. Utilising existing signal-to-noise ratio (SNR) measurements and leveraging Gaussian processes, our approach predicts the tail of the SNR distribution, which entails estimating the parameters of a generalised Pareto distribution, at unobserved locations. This innovative method offers a versatile solution adaptable to various resource allocation challenges in ultra-reliable low-latency communications. We evaluate the performance of this method in a rate maximisation problem with defined outage constraints and compare it with a benchmark in the literature. Notably, the proposed approach meets the outage demands in a larger percentage of the coverage area and reaches higher transmission rates.


title: Spectral GNN via Two-dimensional (2-D) Graph Convolution

abstract: Spectral Graph Neural Networks (GNNs) have achieved tremendous success in graph learning. As an essential part of spectral GNNs, spectral graph convolution extracts crucial frequency information in graph data, leading to superior performance of spectral GNNs in downstream tasks. However, in this paper, we show that existing spectral GNNs remain critical drawbacks in performing the spectral graph convolution. Specifically, considering the spectral graph convolution as a construction operation towards target output, we prove that existing popular convolution paradigms cannot construct the target output with mild conditions on input graph signals, causing spectral GNNs to fall into suboptimal solutions. To address the issues, we rethink the spectral graph convolution from a more general two-dimensional (2-D) signal convolution perspective and propose a new convolution paradigm, named 2-D graph convolution. We prove that 2-D graph convolution unifies existing graph convolution paradigms, and is capable to construct arbitrary target output. Based on the proposed 2-D graph convolution, we further propose ChebNet2D, an efficient and effective GNN implementation of 2-D graph convolution through applying Chebyshev interpolation. Extensive experiments on benchmark datasets demonstrate both effectiveness and efficiency of the ChebNet2D.


title: Bivariate measure-inducing quasi-copulas

abstract: It is well known that every bivariate copula induces a positive measure on the Borel $\sigma$-algebra on $[0,1]^2$, but there exist bivariate quasi-copulas that do not induce a signed measure on the same $\sigma$-algebra. In this paper we show that a signed measure induced by a bivariate quasi-copula can always be expressed as an infinite combination of measures induced by copulas. With this we are able to give the first characterization of measure-inducing quasi-copulas in the bivariate setting.


title: Co-Occ: Coupling Explicit Feature Fusion with Volume Rendering Regularization for Multi-Modal 3D Semantic Occupancy Prediction

abstract: 3D semantic occupancy prediction is a pivotal task in the field of autonomous driving. Recent approaches have made great advances in 3D semantic occupancy predictions on a single modality. However, multi-modal semantic occupancy prediction approaches have encountered difficulties in dealing with the modality heterogeneity, modality misalignment, and insufficient modality interactions that arise during the fusion of different modalities data, which may result in the loss of important geometric and semantic information. This letter presents a novel multi-modal, i.e., LiDAR-camera 3D semantic occupancy prediction framework, dubbed Co-Occ, which couples explicit LiDAR-camera feature fusion with implicit volume rendering regularization. The key insight is that volume rendering in the feature space can proficiently bridge the gap between 3D LiDAR sweeps and 2D images while serving as a physical regularization to enhance LiDAR-camera fused volumetric representation. Specifically, we first propose a Geometric- and Semantic-aware Fusion (GSFusion) module to explicitly enhance LiDAR features by incorporating neighboring camera features through a K-nearest neighbors (KNN) search. Then, we employ volume rendering to project the fused feature back to the image planes for reconstructing color and depth maps. These maps are then supervised by input images from the camera and depth estimations derived from LiDAR, respectively. Extensive experiments on the popular nuScenes and SemanticKITTI benchmarks verify the effectiveness of our Co-Occ for 3D semantic occupancy prediction. The project page is available at https://rorisis.github.io/Co-Occ_project-page/.


title: Diffusion Time-step Curriculum for One Image to 3D Generation

abstract: Score distillation sampling~(SDS) has been widely adopted to overcome the absence of unseen views in reconstructing 3D objects from a \textbf{single} image. It leverages pre-trained 2D diffusion models as teacher to guide the reconstruction of student 3D models. Despite their remarkable success, SDS-based methods often encounter geometric artifacts and texture saturation. We find out the crux is the overlooked indiscriminate treatment of diffusion time-steps during optimization: it unreasonably treats the student-teacher knowledge distillation to be equal at all time-steps and thus entangles coarse-grained and fine-grained modeling. Therefore, we propose the Diffusion Time-step Curriculum one-image-to-3D pipeline (DTC123), which involves both the teacher and student models collaborating with the time-step curriculum in a coarse-to-fine manner. Extensive experiments on NeRF4, RealFusion15, GSO and Level50 benchmark demonstrate that DTC123 can produce multi-view consistent, high-quality, and diverse 3D assets. Codes and more generation demos will be released in https://github.com/yxymessi/DTC123.


title: Multiplicatively spectrum-preserving maps on $C^{*}$-algebras

abstract: We study surjective maps between the sets of all self-adjoint elements of unital $C^*$-algebras which satisfy the multiplicatively spectrum-preserving property. We show that such maps are characterized by Jordan isomorphisms and central symmetries. This is an answer to a problem posed by Moln\'ar.


title: Enhancing Video Summarization with Context Awareness

abstract: Video summarization is a crucial research area that aims to efficiently browse and retrieve relevant information from the vast amount of video content available today. With the exponential growth of multimedia data, the ability to extract meaningful representations from videos has become essential. Video summarization techniques automatically generate concise summaries by selecting keyframes, shots, or segments that capture the video's essence. This process improves the efficiency and accuracy of various applications, including video surveillance, education, entertainment, and social media. Despite the importance of video summarization, there is a lack of diverse and representative datasets, hindering comprehensive evaluation and benchmarking of algorithms. Existing evaluation metrics also fail to fully capture the complexities of video summarization, limiting accurate algorithm assessment and hindering the field's progress. To overcome data scarcity challenges and improve evaluation, we propose an unsupervised approach that leverages video data structure and information for generating informative summaries. By moving away from fixed annotations, our framework can produce representative summaries effectively. Moreover, we introduce an innovative evaluation pipeline tailored specifically for video summarization. Human participants are involved in the evaluation, comparing our generated summaries to ground truth summaries and assessing their informativeness. This human-centric approach provides valuable insights into the effectiveness of our proposed techniques. Experimental results demonstrate that our training-free framework outperforms existing unsupervised approaches and achieves competitive results compared to state-of-the-art supervised methods.


title: SportsHHI: A Dataset for Human-Human Interaction Detection in Sports Videos

abstract: Video-based visual relation detection tasks, such as video scene graph generation, play important roles in fine-grained video understanding. However, current video visual relation detection datasets have two main limitations that hinder the progress of research in this area. First, they do not explore complex human-human interactions in multi-person scenarios. Second, the relation types of existing datasets have relatively low-level semantics and can be often recognized by appearance or simple prior information, without the need for detailed spatio-temporal context reasoning. Nevertheless, comprehending high-level interactions between humans is crucial for understanding complex multi-person videos, such as sports and surveillance videos. To address this issue, we propose a new video visual relation detection task: video human-human interaction detection, and build a dataset named SportsHHI for it. SportsHHI contains 34 high-level interaction classes from basketball and volleyball sports. 118,075 human bounding boxes and 50,649 interaction instances are annotated on 11,398 keyframes. To benchmark this, we propose a two-stage baseline method and conduct extensive experiments to reveal the key factors for a successful human-human interaction detector. We hope that SportsHHI can stimulate research on human interaction understanding in videos and promote the development of spatio-temporal context modeling techniques in video visual relation detection.


title: Efficient and Green Large Language Models for Software Engineering: Vision and the Road Ahead

abstract: Large Language Models (LLMs) have recently shown remarkable capabilities in various software engineering tasks, spurring the rapid development of the Large Language Models for Software Engineering (LLM4SE) area. However, limited attention has been paid to crafting efficient LLM4SE solutions that demand minimal time and memory resources, as well as green LLM4SE solutions that reduce energy consumption and carbon emissions. This 2030 Software Engineering position paper aims to redirect the focus of the research community towards the efficiency and greenness of LLM4SE, while also sharing potential research directions to achieve this goal. It commences with a brief overview of the significance of LLM4SE and highlights the need for efficient and green LLM4SE solutions. Subsequently, the paper presents a vision for a future where efficient and green LLM4SE revolutionizes the software engineering tool landscape, benefiting various stakeholders, including industry, individual practitioners, and society. The paper then delineates a roadmap for future research, outlining specific research paths and potential solutions for the research community to pursue. While not intended to be a definitive guide, the paper aims to inspire further progress, with the ultimate goal of establishing efficient and green LLM4SE as a central element in the future of software engineering.


title: Optimization of Lightweight Malware Detection Models For AIoT Devices

abstract: Malware intrusion is problematic for Internet of Things (IoT) and Artificial Intelligence of Things (AIoT) devices as they often reside in an ecosystem of connected devices, such as a smart home. If any devices are infected, the whole ecosystem can be compromised. Although various Machine Learning (ML) models are deployed to detect malware and network intrusion, generally speaking, robust high-accuracy models tend to require resources not found in all IoT devices, compared to less robust models defined by weak learners. In order to combat this issue, Fadhilla proposed a meta-learner ensemble model comprised of less robust prediction results inherent with weak learner ML models to produce a highly robust meta-learning ensemble model. The main problem with the prior research is that it cannot be deployed in low-end AIoT devices due to the limited resources comprising processing power, storage, and memory (the required libraries quickly exhaust low-end AIoT devices' resources.) Hence, this research aims to optimize the proposed super learner meta-learning ensemble model to make it viable for low-end AIoT devices. We show the library and ML model memory requirements associated with each optimization stage and emphasize that optimization of current ML models is necessitated for low-end AIoT devices. Our results demonstrate that we can obtain similar accuracy and False Positive Rate (FPR) metrics from high-end AIoT devices running the derived ML model, with a lower inference duration and smaller memory footprint.


title: The moduli space of a rational map is Carath\'eodory hyperbolic

abstract: Let $f$ be a rational map of degree $d\geq 2$. The moduli space $\mathcal{M}_f$, introduced by McMullen and Sullivan, is a complex analytic space consisting all quasiconformal conjugacy classes of $f$. For $f$ that is not flexible Latt\`es, we show that there is a normal affine variety $X_f$ of dimension $2d-2$ and a holomorphic injection $i:\mathcal{M}_f\to X_f$ such that $i(\mathcal{M}_f)$ is precompact in $X_f$. In particular $\mathcal{M}_f$ is Carath\'eodory hyperbolic (i.e. bounded holomorphic functions separate points in $\mathcal{M}_f$), provided that $f$ is not flexible Latt\`es. This solves a conjecture of McMullen. When $d\geq 4$, we give a concrete construction of $X_f$ as the normalization of the Zariski closure of the image of the reciprocal multiplier spectrum morphism.


title: The inverse Faraday effect at Mie resonances

abstract: Nowadays, dielectric nanophotonics enables almost lossless resonant interaction between light and matter at the nanoscale. We show both theoretically and by electromagnetic simulations, that the peculiar nature of Mie-resonance induced effective magnetic fields contrasts sharply with the optomagnetism of smooth bulk materials. Mie resonances produce strongly nonuniform effective magnetic fields generated by the inverse Faraday effect. Different orders of optical resonances are characterized by different types of the effective magnetic field patterns. The number of point-like inverse Faraday effect sources can be controlled by adjusting the pump wavelength, allowing for the selective launch of spin waves with submicron wavelengths. A distinguish feature of the Mie-resonance-induced effective magnetic fields is the vortex structure that can be used for the magnetic skyrmion generation. The proposed approach considerably broadens the scope of nanoscale optomagnetism.


title: A Map of Exploring Human Interaction patterns with LLM: Insights into Collaboration and Creativity

abstract: The outstanding performance capabilities of large language model have driven the evolution of current AI system interaction patterns. This has led to considerable discussion within the Human-AI Interaction (HAII) community. Numerous studies explore this interaction from technical, design, and empirical perspectives. However, the majority of current literature reviews concentrate on interactions across the wider spectrum of AI, with limited attention given to the specific realm of interaction with LLM. We searched for articles on human interaction with LLM, selecting 110 relevant publications meeting consensus definition of Human-AI interaction. Subsequently, we developed a comprehensive Mapping Procedure, structured in five distinct stages, to systematically analyze and categorize the collected publications. Applying this methodical approach, we meticulously mapped the chosen studies, culminating in a detailed and insightful representation of the research landscape. Overall, our review presents an novel approach, introducing a distinctive mapping method, specifically tailored to evaluate human-LLM interaction patterns. We conducted a comprehensive analysis of the current research in related fields, employing clustering techniques for categorization, which enabled us to clearly delineate the status and challenges prevalent in each identified area.


title: Ferroelectric metals in van der Waals bilayers

abstract: The combination of metallicity and ferroelectricity breaks traditional boundaries, paving new avenues for innovative electronic materials and devices. This breakthrough is particularly notable, as metallicity and ferroelectricity have traditionally been considered mutually exclusive physical properties. In this work, starting with non-polar metallic single layers, we propose a general scheme for designing 2D ferroelectric metals (FEMs) based on van der Waals interaction. By first-principles calculations, we further substantiate the feasibility of the design scheme in real materials such as FeSe and H-MnTe2. Notably, this scheme unveils unique metallic ferroelectricity, characterized by reversing polarization through interlayer sliding. Furthermore, the combination of inherent magnetism with sliding ferroelectricity leads to multiferroicity. The investigated design scheme and observed phenomena have broad applicability across 2D materials. Our results not only pave the way for research in 2D FEMs but also offer promising prospects for foundational studies of coupled physical phenomena in 2D lattices.


title: Towards Architecting Sustainable MLOps: A Self-Adaptation Approach

abstract: In today's dynamic technological landscape, sustainability has emerged as a pivotal concern, especially with respect to architecting Machine Learning enabled Systems (MLS). Many ML models fail in transitioning to production, primarily hindered by uncertainties due to data variations, evolving requirements, and model instabilities. Machine Learning Operations (MLOps) offers a promising solution by enhancing adaptability and technical sustainability in MLS. However, MLOps itself faces challenges related to environmental impact, technical maintenance, and economic concerns. Over the years, self-adaptation has emerged as a potential solution to handle uncertainties. This paper introduces a novel approach employing self-adaptive principles integrated into the MLOps architecture through a MAPE-K loop to bolster MLOps sustainability. By autonomously responding to uncertainties, including data, model dynamics, and environmental variations, our approach aims to address the sustainability concerns of a given MLOps pipeline identified by an architect at design time. Further, we implement the method for a Smart City use case to display the capabilities of our approach.


title: Anomaly Induced Inflation in the Minimal Quartic Extension of Einstein's Gravity

abstract: A particular extension of Einstein's General Relativity up to and including quartic terms in the curvature tensor is minimal in the sense that it has a unique maximally symmetric vacuum and only a massless spin-2 excitation in its spectrum around the vacuum. We study the inflation phase of the universe in the minimal quartic extension of Einstein's gravity in the presence of trace anomaly terms in the Standard Model and the Minimal Supersymmetric Standard Model and show that the theory allows a quasi-de Sitter phase with a sufficient number of $e$-foldings and is compatible with the spectral index and the tensor to scalar ratio.

categories: gr-qc astro-ph.CO hep-th math-ph math.MP


title: Diffusive logistic equation with a non Lipschitz nonlinear boundary condition arising from coastal fishery harvesting: the resonant case

abstract: For bifurcation analysis, we study the positive solution set for a semilinear elliptic equation of the logistic type, equipped with a sublinear boundary condition modeling coastal fishery harvesting. This work is a continuation of the author's previous studies, where certain results were obtained in a non resonant case, including the existence, uniqueness, multiplicity, and strong positivity for positive solutions. In this paper, we consider the delicate resonant case and develop a sort of non standard bifurcation technique at zero to evaluate the positive solution set depending on a parameter. The nonlinear boundary condition is not right-differentiable at zero.


title: To Cool or not to Cool? Temperature Network Meets Large Foundation Models via DRO

abstract: The temperature parameter plays a profound role during training and/or inference with large foundation models (LFMs) such as large language models (LLMs) and CLIP models. Particularly, it adjusts the logits in the softmax function in LLMs, which is crucial for next token generation, and it scales the similarities in the contrastive loss for training CLIP models. A significant question remains: Is it viable to learn a neural network to predict a personalized temperature of any input data for enhancing LFMs"? In this paper, we present a principled framework for learning a small yet generalizable temperature prediction network (TempNet) to improve LFMs. Our solution is composed of a novel learning framework with a robust loss underpinned by constrained distributionally robust optimization (DRO), and a properly designed TempNet with theoretical inspiration. TempNet can be trained together with a large foundation model from scratch or learned separately given a pretrained foundation model. It is not only useful for predicting personalized temperature to promote the training of LFMs but also generalizable and transferable to new tasks. Our experiments on LLMs and CLIP models demonstrate that TempNet greatly improves the performance of existing solutions or models, e.g. Table 1. The code to reproduce the experimental results in this paper can be found at https://github.com/zhqiu/TempNet.


title: Convex Reformulation of LMI-Based Distributed Controller Design with a Class of Non-Block-Diagonal Lyapunov Functions

abstract: This study addresses a distributed state feedback controller design problem for continuous-time linear time-invariant systems by means of linear matrix inequalities (LMI). As the exact convexification is still open, the block-diagonal relaxation of Lyapunov functions has been prevalent despite its conservatism. In this work, we target a class of non-block-diagonal Lyapunov functions that has the same sparsity as distributed controllers. By leveraging a block-diagonal factorization of sparse matrices and Finsler's lemma, we first present a (nonlinear) matrix inequality for stabilizing distributed controllers with such Lyapunov functions, which boils down to a necessary and sufficient condition for such controllers if the sparsity pattern is chordal. As a relaxation of the inequality, we derive an LMI that completely covers the conventional relaxation and then provide analogous results for $H_\infty$ control. Lastly, numerical examples underscore the efficacy of our results.